Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-06-19T19:53:42Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-06-19T19:53:42Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260619 19:53:42.585525 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:46791
--webserver_interface=127.0.105.190
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 19:53:42.950199 430 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:42.950521 430 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:42.950590 430 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 19:53:42.959681 430 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 19:53:42.959790 430 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:42.959847 430 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 19:53:42.959887 430 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 19:53:42.970778 430 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:46791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:42.972452 430 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:42.974385 430 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 19:53:42.984465 436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:42.984398 438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:42.984588 435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:42.985330 430 server_base.cc:1061] running on GCE node
I20260619 19:53:42.986130 430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:42.987749 430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 19:53:42.988976 430 hybrid_clock.cc:648] HybridClock initialized: now 1781898822988913 us; error 60 us; skew 500 ppm
I20260619 19:53:42.989338 430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:42.991634 430 webserver.cc:533] Webserver started at http://127.0.105.190:45299/ using document root <none> and password file <none>
I20260619 19:53:42.992432 430 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:42.992573 430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:42.992959 430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 19:53:42.995582 430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/instance:
uuid: "031619d60e724837bd292c5ce23d0aff"
format_stamp: "Formatted at 2026-06-19 19:53:42 on dist-test-slave-wkdj"
I20260619 19:53:42.996490 430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal/instance:
uuid: "031619d60e724837bd292c5ce23d0aff"
format_stamp: "Formatted at 2026-06-19 19:53:42 on dist-test-slave-wkdj"
I20260619 19:53:43.002744 430 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260619 19:53:43.006477 444 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:43.007990 430 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 19:53:43.008191 430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
uuid: "031619d60e724837bd292c5ce23d0aff"
format_stamp: "Formatted at 2026-06-19 19:53:42 on dist-test-slave-wkdj"
I20260619 19:53:43.008438 430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:53:43.027518 430 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:43.028478 430 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:43.028806 430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:43.052053 430 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.190:46791
I20260619 19:53:43.052119 495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.190:46791 every 8 connection(s)
I20260619 19:53:43.053730 430 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/info.pb
I20260619 19:53:43.056217 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 430
I20260619 19:53:43.056509 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal/instance
I20260619 19:53:43.058517 496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:43.059196 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:45849
--webserver_interface=127.0.105.189
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 19:53:43.066960 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } has no permanent_uuid. Determining permanent_uuid...
I20260619 19:53:43.086380 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } has no permanent_uuid. Determining permanent_uuid...
W20260619 19:53:43.087764 447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.189:45849: connect: Connection refused (error 111)
W20260619 19:53:43.089442 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:45849: Network error: Client connection negotiation failed: client connection to 127.0.105.189:45849: connect: Connection refused (error 111)
I20260619 19:53:43.138891 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } attempt: 1
W20260619 19:53:43.141191 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:45849: Network error: Client connection negotiation failed: client connection to 127.0.105.189:45849: connect: Connection refused (error 111)
I20260619 19:53:43.209514 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } attempt: 2
W20260619 19:53:43.211639 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:45849: Network error: Client connection negotiation failed: client connection to 127.0.105.189:45849: connect: Connection refused (error 111)
I20260619 19:53:43.303015 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } attempt: 3
W20260619 19:53:43.305126 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:45849: Network error: Client connection negotiation failed: client connection to 127.0.105.189:45849: connect: Connection refused (error 111)
W20260619 19:53:43.437615 498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:43.437960 498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:43.438032 498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 19:53:43.447561 498 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 19:53:43.447716 498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:43.447778 498 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 19:53:43.447819 498 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 19:53:43.448421 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } attempt: 4
W20260619 19:53:43.450476 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.189:45849: Network error: Client connection negotiation failed: client connection to 127.0.105.189:45849: connect: Connection refused (error 111)
I20260619 19:53:43.459510 498 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.189:45849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:43.461329 498 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:43.463311 498 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 19:53:43.472812 506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:43.473130 509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:43.472806 507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:43.473965 498 server_base.cc:1061] running on GCE node
I20260619 19:53:43.474825 498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:43.476464 498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 19:53:43.477769 498 hybrid_clock.cc:648] HybridClock initialized: now 1781898823477691 us; error 71 us; skew 500 ppm
I20260619 19:53:43.478220 498 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:43.480610 498 webserver.cc:533] Webserver started at http://127.0.105.189:42965/ using document root <none> and password file <none>
I20260619 19:53:43.481428 498 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:43.481554 498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:43.481946 498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 19:53:43.488420 498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data/instance:
uuid: "6cc90ee2d59d4dddae6790dd92b20cb5"
format_stamp: "Formatted at 2026-06-19 19:53:43 on dist-test-slave-wkdj"
I20260619 19:53:43.489336 498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal/instance:
uuid: "6cc90ee2d59d4dddae6790dd92b20cb5"
format_stamp: "Formatted at 2026-06-19 19:53:43 on dist-test-slave-wkdj"
I20260619 19:53:43.495440 498 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260619 19:53:43.505718 515 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:43.507576 498 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.011s sys 0.000s
I20260619 19:53:43.507820 498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal
uuid: "6cc90ee2d59d4dddae6790dd92b20cb5"
format_stamp: "Formatted at 2026-06-19 19:53:43 on dist-test-slave-wkdj"
I20260619 19:53:43.508067 498 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:53:43.540584 498 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:43.541600 498 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:43.541942 498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:43.568467 498 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.189:45849
I20260619 19:53:43.568472 566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.189:45849 every 8 connection(s)
I20260619 19:53:43.570256 498 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/data/info.pb
I20260619 19:53:43.575412 567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:43.580580 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 498
I20260619 19:53:43.580832 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-1/wal/instance
I20260619 19:53:43.581936 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:44433
--webserver_interface=127.0.105.188
--webserver_port=0
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 19:53:43.583072 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } has no permanent_uuid. Determining permanent_uuid...
I20260619 19:53:43.603726 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } has no permanent_uuid. Determining permanent_uuid...
I20260619 19:53:43.615370 567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } has no permanent_uuid. Determining permanent_uuid...
W20260619 19:53:43.616694 516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
W20260619 19:53:43.618629 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.667994 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 1
W20260619 19:53:43.670473 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.738768 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 2
W20260619 19:53:43.740801 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.749848 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } attempt: 5
I20260619 19:53:43.758252 496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } has no permanent_uuid. Determining permanent_uuid...
W20260619 19:53:43.760449 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.811689 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 1
W20260619 19:53:43.813720 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.832057 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 3
W20260619 19:53:43.834226 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.881986 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 2
W20260619 19:53:43.884156 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
W20260619 19:53:43.961272 569 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:43.961687 569 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:43.961825 569 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 19:53:43.970878 569 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 19:53:43.971050 569 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:43.971175 569 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 19:53:43.971279 569 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 19:53:43.977465 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 4
W20260619 19:53:43.979833 567 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:43.983067 569 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:44433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:43.984830 569 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:43.986711 569 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260619 19:53:43.990409 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 3
W20260619 19:53:43.992630 496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.188:44433: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
W20260619 19:53:43.996381 579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:43.996431 578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:43.996678 581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:43.997349 569 server_base.cc:1061] running on GCE node
I20260619 19:53:43.998185 569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:44.000082 569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 19:53:44.001372 569 hybrid_clock.cc:648] HybridClock initialized: now 1781898824001318 us; error 40 us; skew 500 ppm
I20260619 19:53:44.001842 569 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:44.004473 569 webserver.cc:533] Webserver started at http://127.0.105.188:42109/ using document root <none> and password file <none>
I20260619 19:53:44.005309 569 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:44.005455 569 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:44.005856 569 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 19:53:44.008509 569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/instance:
uuid: "2d38b77ff37948e19592b36b6d884fe0"
format_stamp: "Formatted at 2026-06-19 19:53:44 on dist-test-slave-wkdj"
I20260619 19:53:44.009377 569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal/instance:
uuid: "2d38b77ff37948e19592b36b6d884fe0"
format_stamp: "Formatted at 2026-06-19 19:53:44 on dist-test-slave-wkdj"
I20260619 19:53:44.015522 569 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260619 19:53:44.019490 587 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:44.021247 569 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 19:53:44.021497 569 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
uuid: "2d38b77ff37948e19592b36b6d884fe0"
format_stamp: "Formatted at 2026-06-19 19:53:44 on dist-test-slave-wkdj"
I20260619 19:53:44.021755 569 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:53:44.043069 569 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:44.044147 569 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:44.044461 569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:44.068543 638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:44433 every 8 connection(s)
I20260619 19:53:44.068580 569 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:44433
I20260619 19:53:44.070914 569 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
I20260619 19:53:44.075713 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 569
I20260619 19:53:44.075948 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal/instance
I20260619 19:53:44.077208 639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:44.084803 639 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } has no permanent_uuid. Determining permanent_uuid...
I20260619 19:53:44.104470 639 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } has no permanent_uuid. Determining permanent_uuid...
I20260619 19:53:44.114301 639 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } has no permanent_uuid. Determining permanent_uuid...
I20260619 19:53:44.129050 639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Bootstrap starting.
I20260619 19:53:44.132915 639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:44.133985 639 log.cc:826] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:44.137411 639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: No bootstrap required, opened a new log
I20260619 19:53:44.142828 639 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.143249 639 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:44.143354 639 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d38b77ff37948e19592b36b6d884fe0, State: Initialized, Role: FOLLOWER
I20260619 19:53:44.143965 639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.144819 648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.145085 648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.146363 639 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 19:53:44.158831 659 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 19:53:44.159035 659 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 19:53:44.154803 569 master_runner.cc:187] Error getting master registration for 127.0.105.190:46791: OK, instance_id { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" instance_seqno: 1781898823045797 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 19:53:44.161377 569 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 19:53:44.169900 496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 4
I20260619 19:53:44.182104 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Bootstrap starting.
I20260619 19:53:44.186743 496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:44.188336 496 log.cc:826] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:44.192565 496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: No bootstrap required, opened a new log
I20260619 19:53:44.200498 496 raft_consensus.cc:359] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.200876 496 raft_consensus.cc:385] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:44.201005 496 raft_consensus.cc:740] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 031619d60e724837bd292c5ce23d0aff, State: Initialized, Role: FOLLOWER
I20260619 19:53:44.201761 496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.202931 662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.203271 662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.204314 496 sys_catalog.cc:565] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: configured and running, proceeding with master startup.
W20260619 19:53:44.215883 673 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 19:53:44.216022 673 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 19:53:44.215168 430 master_runner.cc:187] Error getting master registration for 127.0.105.189:45849: OK, instance_id { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" instance_seqno: 1781898823561021 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 19:53:44.222854 430 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 19:53:44.279151 567 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } attempt: 5
W20260619 19:53:44.282573 450 tablet.cc:2406] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 19:53:44.296710 593 tablet.cc:2406] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:53:44.299067 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Bootstrap starting.
I20260619 19:53:44.304617 567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:44.306238 567 log.cc:826] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:44.310647 567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: No bootstrap required, opened a new log
I20260619 19:53:44.320597 567 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.321046 567 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:44.321167 567 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc90ee2d59d4dddae6790dd92b20cb5, State: Initialized, Role: FOLLOWER
I20260619 19:53:44.322278 567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.325505 676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.327390 676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.328258 567 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 19:53:44.358688 498 master_runner.cc:264] No leader master found from master 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:53:44.358852 498 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 19:53:44.366319 687 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 19:53:44.366611 687 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260619 19:53:44.545590 521 tablet.cc:2406] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:53:44.587270 662 raft_consensus.cc:493] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:44.587577 662 raft_consensus.cc:515] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.589637 662 leader_election.cc:290] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:44.591362 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:44.591935 542 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 031619d60e724837bd292c5ce23d0aff in term 0.
I20260619 19:53:44.592809 614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d38b77ff37948e19592b36b6d884fe0" is_pre_election: true
I20260619 19:53:44.593287 614 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 031619d60e724837bd292c5ce23d0aff in term 0.
I20260619 19:53:44.594408 445 leader_election.cc:304] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff, 2d38b77ff37948e19592b36b6d884fe0; no voters:
I20260619 19:53:44.596390 662 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:44.596547 662 raft_consensus.cc:493] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:44.596671 662 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:44.600353 662 raft_consensus.cc:515] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.602126 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5"
I20260619 19:53:44.602341 542 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:44.605865 542 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 031619d60e724837bd292c5ce23d0aff in term 1.
I20260619 19:53:44.606765 447 leader_election.cc:304] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5; no voters:
I20260619 19:53:44.611008 614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d38b77ff37948e19592b36b6d884fe0"
I20260619 19:53:44.611281 614 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:44.614775 614 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 031619d60e724837bd292c5ce23d0aff in term 1.
I20260619 19:53:44.616031 662 leader_election.cc:290] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 1 election: Requested vote from peers 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:44.616731 662 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:44.617214 662 raft_consensus.cc:697] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 1 LEADER]: Becoming Leader. State: Replica: 031619d60e724837bd292c5ce23d0aff, State: Running, Role: LEADER
I20260619 19:53:44.618000 662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:44.633909 689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 031619d60e724837bd292c5ce23d0aff. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.634382 689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:44.648329 691 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 19:53:44.651001 691 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 19:53:44.669569 614 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Refusing update from remote peer 031619d60e724837bd292c5ce23d0aff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:44.671257 689 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 19:53:44.679554 542 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Refusing update from remote peer 031619d60e724837bd292c5ce23d0aff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:44.680778 689 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:44.713209 676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 031619d60e724837bd292c5ce23d0aff. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.713521 676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.716629 694 mvcc.cc:204] Tried to move back new op lower bound from 7298657585833218048 to 7298657585648242688. Current Snapshot: MvccSnapshot[applied={T|T < 7298657585833218048}]
I20260619 19:53:44.729965 676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.730247 676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.744361 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 031619d60e724837bd292c5ce23d0aff. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.744707 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.748624 689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.748874 689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:44.749500 696 mvcc.cc:204] Tried to move back new op lower bound from 7298657585833218048 to 7298657585648242688. Current Snapshot: MvccSnapshot[applied={T|T < 7298657585833218048}]
I20260619 19:53:44.751989 691 catalog_manager.cc:1382] Generated new cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:53:44.752131 691 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 19:53:44.764333 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.764576 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:44.771576 700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "031619d60e724837bd292c5ce23d0aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:44.771893 700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:44.793715 691 catalog_manager.cc:1405] Generated new certificate authority record
I20260619 19:53:44.795570 691 catalog_manager.cc:1539] Loading token signing keys...
I20260619 19:53:44.809340 691 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Generated new TSK 0
I20260619 19:53:44.810647 691 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 19:53:44.851519 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.129:0
--local_ip_for_outbound_sockets=127.0.105.129
--webserver_interface=127.0.105.129
--webserver_port=0
--tserver_master_addrs=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260619 19:53:45.162397 659 catalog_manager.cc:1294] Loaded cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:53:45.162535 659 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: loading cluster ID for follower catalog manager: success
I20260619 19:53:45.166641 659 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: acquiring CA information for follower catalog manager: success
I20260619 19:53:45.169977 659 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 19:53:45.236666 702 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:45.236994 702 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:45.237077 702 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 19:53:45.246227 702 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:45.246416 702 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.129
I20260619 19:53:45.256985 702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.129
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:45.258598 702 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:45.260421 702 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 19:53:45.270516 707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:45.270486 708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:45.270987 710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:45.271903 702 server_base.cc:1061] running on GCE node
I20260619 19:53:45.272516 702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:45.273826 702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 19:53:45.275194 702 hybrid_clock.cc:648] HybridClock initialized: now 1781898825275058 us; error 61 us; skew 500 ppm
I20260619 19:53:45.275579 702 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:45.278288 702 webserver.cc:533] Webserver started at http://127.0.105.129:46163/ using document root <none> and password file <none>
I20260619 19:53:45.279644 702 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:45.279837 702 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:45.280228 702 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 19:53:45.282944 702 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data/instance:
uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
format_stamp: "Formatted at 2026-06-19 19:53:45 on dist-test-slave-wkdj"
I20260619 19:53:45.283929 702 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/instance:
uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
format_stamp: "Formatted at 2026-06-19 19:53:45 on dist-test-slave-wkdj"
I20260619 19:53:45.289471 702 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 19:53:45.293200 716 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:45.294773 702 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:45.294986 702 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal
uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
format_stamp: "Formatted at 2026-06-19 19:53:45 on dist-test-slave-wkdj"
I20260619 19:53:45.295243 702 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:53:45.309387 702 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:45.310006 721 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:45.310227 721 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:45.310807 702 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:45.311115 702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:45.312319 702 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260619 19:53:45.312620 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:45.312681 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:45.313336 721 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
I20260619 19:53:45.313563 588 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0; no voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:53:45.314066 721 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:53:45.314869 702 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 19:53:45.314958 702 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:45.315097 702 ts_tablet_manager.cc:616] Registered 0 tablets
I20260619 19:53:45.315192 702 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260619 19:53:45.356724 702 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.129:41107
I20260619 19:53:45.356786 829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.129:41107 every 8 connection(s)
I20260619 19:53:45.358351 702 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/data/info.pb
I20260619 19:53:45.365155 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 702
I20260619 19:53:45.365473 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/instance
I20260619 19:53:45.370501 687 catalog_manager.cc:1294] Loaded cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:53:45.370805 687 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: loading cluster ID for follower catalog manager: success
I20260619 19:53:45.378057 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.130:0
--local_ip_for_outbound_sockets=127.0.105.130
--webserver_interface=127.0.105.130
--webserver_port=0
--tserver_master_addrs=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260619 19:53:45.385270 687 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: acquiring CA information for follower catalog manager: success
I20260619 19:53:45.390888 687 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 19:53:45.421615 832 heartbeater.cc:344] Connected to a master server at 127.0.105.189:45849
I20260619 19:53:45.422020 832 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:45.421689 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:53:45.422411 830 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:45.423429 830 heartbeater.cc:507] Master 127.0.105.188:44433 requested a full tablet report, sending...
I20260619 19:53:45.423460 832 heartbeater.cc:507] Master 127.0.105.189:45849 requested a full tablet report, sending...
I20260619 19:53:45.423928 831 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:45.424072 831 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:45.424638 831 heartbeater.cc:507] Master 127.0.105.190:46791 requested a full tablet report, sending...
I20260619 19:53:45.426185 532 ts_manager.cc:194] Registered new tserver with Master: b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:45.426275 604 ts_manager.cc:194] Registered new tserver with Master: b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:45.428337 460 ts_manager.cc:194] Registered new tserver with Master: b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:45.430080 460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.129:38489
W20260619 19:53:45.767349 840 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:45.767668 840 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:45.767804 840 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260619 19:53:45.775976 844 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:45.776238 844 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
W20260619 19:53:45.777267 840 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:45.777475 840 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.130
I20260619 19:53:45.777733 844 leader_election.cc:290] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:45.778215 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:45.778391 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d38b77ff37948e19592b36b6d884fe0" is_pre_election: true
I20260619 19:53:45.778971 516 leader_election.cc:304] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc90ee2d59d4dddae6790dd92b20cb5; no voters: 031619d60e724837bd292c5ce23d0aff, 2d38b77ff37948e19592b36b6d884fe0
I20260619 19:53:45.779359 844 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:53:45.789394 840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.130
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:45.791385 840 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:45.793515 840 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 19:53:45.804440 846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:45.804540 847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:45.806713 849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:45.807121 840 server_base.cc:1061] running on GCE node
I20260619 19:53:45.807812 840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:45.808876 840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 19:53:45.810156 840 hybrid_clock.cc:648] HybridClock initialized: now 1781898825810098 us; error 35 us; skew 500 ppm
I20260619 19:53:45.810545 840 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:45.813053 840 webserver.cc:533] Webserver started at http://127.0.105.130:40887/ using document root <none> and password file <none>
I20260619 19:53:45.813834 840 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:45.813978 840 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:45.814368 840 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 19:53:45.816920 840 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data/instance:
uuid: "95181cc281b946c8b81aa825232d9498"
format_stamp: "Formatted at 2026-06-19 19:53:45 on dist-test-slave-wkdj"
I20260619 19:53:45.817660 840 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/instance:
uuid: "95181cc281b946c8b81aa825232d9498"
format_stamp: "Formatted at 2026-06-19 19:53:45 on dist-test-slave-wkdj"
I20260619 19:53:45.823652 840 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260619 19:53:45.827531 855 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:45.829905 840 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260619 19:53:45.830103 840 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal
uuid: "95181cc281b946c8b81aa825232d9498"
format_stamp: "Formatted at 2026-06-19 19:53:45 on dist-test-slave-wkdj"
I20260619 19:53:45.830340 840 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:53:45.867676 840 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:45.868606 840 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:45.868944 840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:45.869895 840 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260619 19:53:45.871695 840 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 19:53:45.871788 840 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:45.871870 840 ts_tablet_manager.cc:616] Registered 0 tablets
I20260619 19:53:45.871927 840 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:45.913061 840 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.130:37425
I20260619 19:53:45.913159 967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.130:37425 every 8 connection(s)
I20260619 19:53:45.914881 840 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/data/info.pb
I20260619 19:53:45.915683 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 840
I20260619 19:53:45.916033 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/instance
I20260619 19:53:45.922960 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.131:0
--local_ip_for_outbound_sockets=127.0.105.131
--webserver_interface=127.0.105.131
--webserver_port=0
--tserver_master_addrs=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260619 19:53:45.933452 831 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:45.947724 977 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:45.949010 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:53:45.949282 977 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:45.949554 968 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:45.950882 968 heartbeater.cc:507] Master 127.0.105.188:44433 requested a full tablet report, sending...
I20260619 19:53:45.951121 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:45.952905 977 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
I20260619 19:53:45.953568 970 heartbeater.cc:344] Connected to a master server at 127.0.105.189:45849
I20260619 19:53:45.953745 970 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:45.953889 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:45.952983 604 ts_manager.cc:194] Registered new tserver with Master: 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:45.954823 970 heartbeater.cc:507] Master 127.0.105.189:45849 requested a full tablet report, sending...
I20260619 19:53:45.954545 590 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0; no voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:53:45.956089 532 ts_manager.cc:194] Registered new tserver with Master: 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:45.956477 977 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:53:45.957819 969 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:45.957986 969 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:45.958468 969 heartbeater.cc:507] Master 127.0.105.190:46791 requested a full tablet report, sending...
I20260619 19:53:45.959432 460 ts_manager.cc:194] Registered new tserver with Master: 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:45.960254 460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.130:55019
W20260619 19:53:46.333850 976 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:46.334179 976 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:46.334358 976 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 19:53:46.343781 976 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:46.344004 976 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.131
I20260619 19:53:46.355947 976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.131
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:46.357770 976 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:46.360342 976 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 19:53:46.371533 984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:46.371605 985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:46.371511 987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:46.372798 976 server_base.cc:1061] running on GCE node
I20260619 19:53:46.373570 976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:46.374833 976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 19:53:46.376294 976 hybrid_clock.cc:648] HybridClock initialized: now 1781898826376192 us; error 122 us; skew 500 ppm
I20260619 19:53:46.376703 976 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:46.379753 976 webserver.cc:533] Webserver started at http://127.0.105.131:37247/ using document root <none> and password file <none>
I20260619 19:53:46.380671 976 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:46.380779 976 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:46.381201 976 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 19:53:46.384671 976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data/instance:
uuid: "e78a44e2c8824fe7bce462e9d33f660c"
format_stamp: "Formatted at 2026-06-19 19:53:46 on dist-test-slave-wkdj"
I20260619 19:53:46.385916 976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/instance:
uuid: "e78a44e2c8824fe7bce462e9d33f660c"
format_stamp: "Formatted at 2026-06-19 19:53:46 on dist-test-slave-wkdj"
I20260619 19:53:46.391907 976 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260619 19:53:46.395855 993 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:46.397619 976 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260619 19:53:46.397848 976 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal
uuid: "e78a44e2c8824fe7bce462e9d33f660c"
format_stamp: "Formatted at 2026-06-19 19:53:46 on dist-test-slave-wkdj"
I20260619 19:53:46.398062 976 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:53:46.424526 976 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:46.425597 976 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:46.425884 976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:46.427049 976 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260619 19:53:46.429039 976 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 19:53:46.429141 976 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:46.429229 976 ts_tablet_manager.cc:616] Registered 0 tablets
I20260619 19:53:46.429308 976 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:46.462616 969 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:46.482497 1099 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:46.482692 1099 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:46.483559 1099 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
I20260619 19:53:46.484229 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:46.484242 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:46.485415 588 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0; no voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:53:46.485886 1099 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:53:46.487789 976 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.131:34819
I20260619 19:53:46.487890 1106 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.131:34819 every 8 connection(s)
I20260619 19:53:46.489408 976 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/data/info.pb
I20260619 19:53:46.495879 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 976
I20260619 19:53:46.496168 422 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/instance
I20260619 19:53:46.516587 1109 heartbeater.cc:344] Connected to a master server at 127.0.105.189:45849
I20260619 19:53:46.516765 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:53:46.517220 1107 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:46.517217 1109 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:46.517288 1108 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:46.517499 1108 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:46.518437 1107 heartbeater.cc:507] Master 127.0.105.188:44433 requested a full tablet report, sending...
I20260619 19:53:46.518558 1109 heartbeater.cc:507] Master 127.0.105.189:45849 requested a full tablet report, sending...
I20260619 19:53:46.518581 1108 heartbeater.cc:507] Master 127.0.105.190:46791 requested a full tablet report, sending...
I20260619 19:53:46.520287 604 ts_manager.cc:194] Registered new tserver with Master: e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:46.520275 460 ts_manager.cc:194] Registered new tserver with Master: e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:46.520309 532 ts_manager.cc:194] Registered new tserver with Master: e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:46.521148 460 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.131:38115
I20260619 19:53:46.530365 422 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260619 19:53:46.562844 461 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_6159673514964291b9b99a452f0f51dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:46.563063 459 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_6a0b609cc51c4ce289fd611b8a55a9dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:46.563684 457 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_f4ace0df5ae9413eb1ce33f274456057"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:46.563762 458 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_8af7c62bd4ef4a919d2a80f597b6d86d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:46.566237 461 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6159673514964291b9b99a452f0f51dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:46.567678 460 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_afcf8042005740d085932a1bf118aac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:46.573158 460 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afcf8042005740d085932a1bf118aac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:46.572606 459 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a0b609cc51c4ce289fd611b8a55a9dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:46.571597 457 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4ace0df5ae9413eb1ce33f274456057 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:46.576004 458 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8af7c62bd4ef4a919d2a80f597b6d86d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:46.577000 455 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_1b6a443b5cdb42fd87d7f11119c8dff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:46.579456 454 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_49dfacd1335c48f986eec87211ae648d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:46.580145 454 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49dfacd1335c48f986eec87211ae648d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:46.578025 455 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b6a443b5cdb42fd87d7f11119c8dff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:46.578308 456 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_ae64725971a948a694f59e7bb25ee382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:46.598016 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task38CK2r/build/asan/bin/kudu pid 430
I20260619 19:53:46.593853 453 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_d400497c7a1d46089fd57b84ae7a700e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:46.598031 456 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae64725971a948a694f59e7bb25ee382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:46.597437 452 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50766:
name: "default.Table_087d64f7b02347d7b800633b924e66b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:46.600260 453 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d400497c7a1d46089fd57b84ae7a700e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:46.600283 452 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_087d64f7b02347d7b800633b924e66b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:46.601241 491 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 19:53:46.702935 1161 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:46.703191 1161 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:46.703958 1161 leader_election.cc:290] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:46.704705 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d38b77ff37948e19592b36b6d884fe0" is_pre_election: true
I20260619 19:53:46.728856 471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:46.730315 516 leader_election.cc:304] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc90ee2d59d4dddae6790dd92b20cb5; no voters: 031619d60e724837bd292c5ce23d0aff, 2d38b77ff37948e19592b36b6d884fe0
I20260619 19:53:46.731911 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task38CK2r/build/asan/bin/kudu with pid 430
I20260619 19:53:46.736095 1161 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:53:46.754482 590 connection.cc:573] server connection from 127.0.0.1:51742 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:46.755507 516 connection.cc:573] server connection from 127.0.0.1:36998 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:46.755556 1117 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.190:46791)
W20260619 19:53:46.940493 831 heartbeater.cc:646] Failed to heartbeat to 127.0.105.190:46791 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111)
W20260619 19:53:46.969393 969 heartbeater.cc:646] Failed to heartbeat to 127.0.105.190:46791 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111)
I20260619 19:53:47.023962 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:47.025372 1108 heartbeater.cc:646] Failed to heartbeat to 127.0.105.190:46791 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111)
I20260619 19:53:47.232007 1169 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:47.232290 1169 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:47.233039 1169 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
I20260619 19:53:47.233613 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:47.233976 542 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d38b77ff37948e19592b36b6d884fe0 in term 1.
W20260619 19:53:47.234158 588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111)
I20260619 19:53:47.234509 590 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0, 6cc90ee2d59d4dddae6790dd92b20cb5; no voters:
I20260619 19:53:47.234794 1169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:53:47.234933 1169 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 031619d60e724837bd292c5ce23d0aff)
I20260619 19:53:47.235066 1169 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:53:47.235950 588 leader_election.cc:336] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791): Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111)
I20260619 19:53:47.237521 1169 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:47.238160 1169 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 election: Requested vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
I20260619 19:53:47.238685 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5"
I20260619 19:53:47.239013 542 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:53:47.239619 588 leader_election.cc:336] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791): Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111)
I20260619 19:53:47.241108 542 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d38b77ff37948e19592b36b6d884fe0 in term 2.
I20260619 19:53:47.241552 590 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0, 6cc90ee2d59d4dddae6790dd92b20cb5; no voters: 031619d60e724837bd292c5ce23d0aff
I20260619 19:53:47.241911 1169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:53:47.242436 1169 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 2 LEADER]: Becoming Leader. State: Replica: 2d38b77ff37948e19592b36b6d884fe0, State: Running, Role: LEADER
I20260619 19:53:47.242941 1169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:47.244527 1172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d38b77ff37948e19592b36b6d884fe0. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:47.244863 1172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:47.367854 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:46791
--webserver_interface=127.0.105.190
--webserver_port=45299
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 19:53:47.627517 542 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Refusing update from remote peer 2d38b77ff37948e19592b36b6d884fe0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20260619 19:53:47.628368 1172 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260619 19:53:47.630690 1178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d38b77ff37948e19592b36b6d884fe0. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:47.631349 1178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:47.634899 1178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:47.635171 1178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:47.635373 1169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:47.635622 1169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: LEADER
W20260619 19:53:47.636847 588 consensus_peers.cc:597] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 -> Peer 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791): Couldn't send request to peer 031619d60e724837bd292c5ce23d0aff. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:47.659458 1173 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 19:53:47.662552 1173 catalog_manager.cc:679] Loaded metadata for table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]
I20260619 19:53:47.663283 1173 catalog_manager.cc:679] Loaded metadata for table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]
I20260619 19:53:47.665458 1173 tablet_loader.cc:96] loaded metadata for tablet 08c6a1313bb840908c49d14960be0fc8 (table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5])
I20260619 19:53:47.665886 1173 tablet_loader.cc:96] loaded metadata for tablet 5a21352877f94e508038c2c44617c4c7 (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc])
I20260619 19:53:47.666167 1173 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 19:53:47.667357 1173 catalog_manager.cc:1294] Loaded cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:53:47.667454 1173 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 19:53:47.669003 1173 catalog_manager.cc:1539] Loading token signing keys...
I20260619 19:53:47.670090 1173 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Loaded TSK: 0
I20260619 19:53:47.671272 1173 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 19:53:47.705449 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_087d64f7b02347d7b800633b924e66b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.705658 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_1b6a443b5cdb42fd87d7f11119c8dff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.705758 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_49dfacd1335c48f986eec87211ae648d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.705471 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_d400497c7a1d46089fd57b84ae7a700e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.707060 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6159673514964291b9b99a452f0f51dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.707764 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49dfacd1335c48f986eec87211ae648d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.707906 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_afcf8042005740d085932a1bf118aac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.708117 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_8af7c62bd4ef4a919d2a80f597b6d86d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.708604 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afcf8042005740d085932a1bf118aac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.708814 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8af7c62bd4ef4a919d2a80f597b6d86d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.709436 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6a0b609cc51c4ce289fd611b8a55a9dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.707760 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b6a443b5cdb42fd87d7f11119c8dff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.711615 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d400497c7a1d46089fd57b84ae7a700e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.711122 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6159673514964291b9b99a452f0f51dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.712508 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a0b609cc51c4ce289fd611b8a55a9dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.713091 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_087d64f7b02347d7b800633b924e66b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.713958 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f4ace0df5ae9413eb1ce33f274456057"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.713980 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_ae64725971a948a694f59e7bb25ee382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.714726 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4ace0df5ae9413eb1ce33f274456057 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.714771 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae64725971a948a694f59e7bb25ee382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.715104 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f51b1ea66cbb4798b45b8847d8f1a52c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.715921 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f51b1ea66cbb4798b45b8847d8f1a52c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.715899 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_397009ed3ca44d379ed55f8b3c9b262e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.717367 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_397009ed3ca44d379ed55f8b3c9b262e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.731086 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_49dfacd1335c48f986eec87211ae648d" } new_table_name: "default.Table_c3eca0e04302460199b2dde61cbf8ed0" modify_external_catalogs: true
I20260619 19:53:47.733172 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8af7c62bd4ef4a919d2a80f597b6d86d" } new_table_name: "default.Table_12a0a4f870d04ef2b862367e14b1c07d" modify_external_catalogs: true
I20260619 19:53:47.739699 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f51b1ea66cbb4798b45b8847d8f1a52c" } new_table_name: "default.Table_5f953279c7ee4c4dbccc3be6283da4ce" modify_external_catalogs: true
I20260619 19:53:47.741174 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_397009ed3ca44d379ed55f8b3c9b262e" } new_table_name: "default.Table_dac8cb3e1d594f139948228663d117c0" modify_external_catalogs: true
I20260619 19:53:47.745086 603 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_1b6a443b5cdb42fd87d7f11119c8dff2" } new_table_name: "default.Table_fbf41d8a2bac4b7980202fac2ad060cd" modify_external_catalogs: true
I20260619 19:53:47.746621 601 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_d400497c7a1d46089fd57b84ae7a700e" } modify_external_catalogs: true
I20260619 19:53:47.746986 601 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_d400497c7a1d46089fd57b84ae7a700e" } modify_external_catalogs: true
I20260619 19:53:47.757139 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_087d64f7b02347d7b800633b924e66b7" } modify_external_catalogs: true
I20260619 19:53:47.757427 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_087d64f7b02347d7b800633b924e66b7" } modify_external_catalogs: true
I20260619 19:53:47.757530 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_6a0b609cc51c4ce289fd611b8a55a9dd" } modify_external_catalogs: true
I20260619 19:53:47.757772 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_6a0b609cc51c4ce289fd611b8a55a9dd" } modify_external_catalogs: true
W20260619 19:53:47.763115 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48a58620df904c09b459d3f7ff72bcf8 has no consensus state
W20260619 19:53:47.768332 1174 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:53:47.768786 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ce3e049ff5646d682ee9f9b37fea756 consensus state has no leader
W20260619 19:53:47.769091 1174 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:53:47.769301 1174 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 19:53:47.769498 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a2db4450a1a449b28f30933401ca0689 has no consensus state
W20260619 19:53:47.769896 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9652b7e593c4c2597a1f9268d67b6d1 has no consensus state
W20260619 19:53:47.781427 603 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4460c79a15140d5b643130f4e0329aa has no consensus state
I20260619 19:53:47.782703 601 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 33574ba39dc44f9283d0019ee340f687
I20260619 19:53:47.784432 599 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f4ace0df5ae9413eb1ce33f274456057" } modify_external_catalogs: true
I20260619 19:53:47.784686 599 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f4ace0df5ae9413eb1ce33f274456057" } modify_external_catalogs: true
I20260619 19:53:47.786300 602 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_ae64725971a948a694f59e7bb25ee382" } modify_external_catalogs: true
I20260619 19:53:47.786537 602 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_ae64725971a948a694f59e7bb25ee382" } modify_external_catalogs: true
W20260619 19:53:47.787032 1174 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 19:53:47.787268 1174 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:53:47.787456 1174 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 19:53:47.787593 1174 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
W20260619 19:53:47.798657 591 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_5f953279c7ee4c4dbccc3be6283da4ce [id=0342764f88ba49ce837448cf3e8fce60], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a2db4450a1a449b28f30933401ca0689 has no consensus state
I20260619 19:53:47.808736 604 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e387dba862cd44d780fed53d94fd5845
I20260619 19:53:47.808987 1174 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.190:46791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.190
--webserver_port=45299
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:53:47.809145 598 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e234967d83574675845aeeadeff3bc26
I20260619 19:53:47.813052 1174 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:53:47.813349 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 (DEFAULT_TABLE table=default.Table_12a0a4f870d04ef2b862367e14b1c07d [id=787ec176c1fa43a087c8a3226711cfbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.814286 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 08c6a1313bb840908c49d14960be0fc8 (DEFAULT_TABLE table=default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.814540 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 5a21352877f94e508038c2c44617c4c7 (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.814689 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 (DEFAULT_TABLE table=default.Table_c3eca0e04302460199b2dde61cbf8ed0 [id=3c9da136fa6d4578a5ad210801a2ccea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.815754 1174 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260619 19:53:47.815919 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a21352877f94e508038c2c44617c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.819517 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c6a1313bb840908c49d14960be0fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.820777 903 tablet_service.cc:1511] Processing CreateTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 (DEFAULT_TABLE table=default.Table_c3eca0e04302460199b2dde61cbf8ed0 [id=3c9da136fa6d4578a5ad210801a2ccea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.822299 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a58620df904c09b459d3f7ff72bcf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.823412 902 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 (DEFAULT_TABLE table=default.Table_12a0a4f870d04ef2b862367e14b1c07d [id=787ec176c1fa43a087c8a3226711cfbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.823998 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce3e049ff5646d682ee9f9b37fea756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.827288 900 tablet_service.cc:1511] Processing CreateTablet for tablet 5a21352877f94e508038c2c44617c4c7 (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.827507 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a58620df904c09b459d3f7ff72bcf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.827821 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a21352877f94e508038c2c44617c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.831485 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce3e049ff5646d682ee9f9b37fea756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.832041 901 tablet_service.cc:1511] Processing CreateTablet for tablet 08c6a1313bb840908c49d14960be0fc8 (DEFAULT_TABLE table=default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.832955 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c6a1313bb840908c49d14960be0fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.822472 765 tablet_service.cc:1511] Processing CreateTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 (DEFAULT_TABLE table=default.Table_c3eca0e04302460199b2dde61cbf8ed0 [id=3c9da136fa6d4578a5ad210801a2ccea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.843688 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a58620df904c09b459d3f7ff72bcf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.851099 764 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 (DEFAULT_TABLE table=default.Table_12a0a4f870d04ef2b862367e14b1c07d [id=787ec176c1fa43a087c8a3226711cfbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.851258 763 tablet_service.cc:1511] Processing CreateTablet for tablet 08c6a1313bb840908c49d14960be0fc8 (DEFAULT_TABLE table=default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.851837 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c6a1313bb840908c49d14960be0fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.851895 762 tablet_service.cc:1511] Processing CreateTablet for tablet 5a21352877f94e508038c2c44617c4c7 (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.852512 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a21352877f94e508038c2c44617c4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.852777 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce3e049ff5646d682ee9f9b37fea756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.854686 599 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 4c0b94800ac84d01a20cfb1589a8ef8f
I20260619 19:53:47.855340 602 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 12c4c1816bb943b38659c5f3581e0580
I20260619 19:53:47.856261 1200 tablet_bootstrap.cc:492] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:47.860600 1200 tablet_bootstrap.cc:654] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.863008 1200 log.cc:826] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:47.864584 1201 tablet_bootstrap.cc:492] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:47.870298 1201 tablet_bootstrap.cc:654] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.871968 1201 log.cc:826] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:47.874372 1200 tablet_bootstrap.cc:492] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:47.874878 1200 ts_tablet_manager.cc:1403] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.005s
I20260619 19:53:47.881531 1201 tablet_bootstrap.cc:492] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:47.881872 1201 ts_tablet_manager.cc:1403] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.010s
I20260619 19:53:47.883726 1200 raft_consensus.cc:359] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.884480 1200 raft_consensus.cc:385] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.884639 1200 raft_consensus.cc:740] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.885555 1200 consensus_queue.cc:260] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.890868 1201 raft_consensus.cc:359] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.891394 1201 raft_consensus.cc:385] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.891530 1201 raft_consensus.cc:740] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.892542 1201 consensus_queue.cc:260] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.894289 1200 ts_tablet_manager.cc:1434] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.019s user 0.016s sys 0.000s
I20260619 19:53:47.900188 1200 tablet_bootstrap.cc:492] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:47.901024 1201 ts_tablet_manager.cc:1434] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.019s user 0.015s sys 0.005s
I20260619 19:53:47.902184 1200 tablet_bootstrap.cc:654] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.905236 1201 tablet_bootstrap.cc:492] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:47.910238 1201 tablet_bootstrap.cc:654] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.911446 1200 tablet_bootstrap.cc:492] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:47.911670 1200 ts_tablet_manager.cc:1403] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260619 19:53:47.912729 1200 raft_consensus.cc:359] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:47.912998 1200 raft_consensus.cc:385] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.913147 1200 raft_consensus.cc:740] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.913489 1200 consensus_queue.cc:260] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:47.915359 1200 ts_tablet_manager.cc:1434] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:47.915704 1200 tablet_bootstrap.cc:492] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:47.916005 1208 tablet_bootstrap.cc:492] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:47.917625 1200 tablet_bootstrap.cc:654] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.921542 1039 tablet_service.cc:1511] Processing CreateTablet for tablet d4460c79a15140d5b643130f4e0329aa (DEFAULT_TABLE table=default.Table_fbf41d8a2bac4b7980202fac2ad060cd [id=878d66188d3347a9b4dca485c4204678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.921936 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4460c79a15140d5b643130f4e0329aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.921983 1208 tablet_bootstrap.cc:654] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:47.923269 971 tablet.cc:2406] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:53:47.923352 1208 log.cc:826] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:47.925330 1107 heartbeater.cc:499] Master 127.0.105.188:44433 was elected leader, sending a full tablet report...
I20260619 19:53:47.925611 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a2db4450a1a449b28f30933401ca0689 (DEFAULT_TABLE table=default.Table_5f953279c7ee4c4dbccc3be6283da4ce [id=0342764f88ba49ce837448cf3e8fce60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.926012 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2db4450a1a449b28f30933401ca0689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.926604 1201 tablet_bootstrap.cc:492] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:47.926754 1201 ts_tablet_manager.cc:1403] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.001s
I20260619 19:53:47.927323 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_b6822e2f028a4ee29e80309e9e006c0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.927783 1201 raft_consensus.cc:359] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.927959 1201 raft_consensus.cc:385] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.928040 1201 raft_consensus.cc:740] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:53:47.928182 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6822e2f028a4ee29e80309e9e006c0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.928332 1201 consensus_queue.cc:260] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.929883 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_b716080450d7415ebf6dfdc29033f87e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.930763 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b716080450d7415ebf6dfdc29033f87e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.931910 1201 ts_tablet_manager.cc:1434] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:47.934352 598 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_c3eca0e04302460199b2dde61cbf8ed0 [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 1 got 0
I20260619 19:53:47.934747 598 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5ce3e049ff5646d682ee9f9b37fea756 (table default.Table_12a0a4f870d04ef2b862367e14b1c07d [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 1 got 0
I20260619 19:53:47.935200 1201 tablet_bootstrap.cc:492] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:47.938469 1201 tablet_bootstrap.cc:654] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.939586 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_32f92f5c64464d989015e442afc82c76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.940192 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32f92f5c64464d989015e442afc82c76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.940237 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_cc82ca43b5cf464db8144b09e67a1b6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.940722 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc82ca43b5cf464db8144b09e67a1b6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.940912 1200 tablet_bootstrap.cc:492] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:47.941114 1200 ts_tablet_manager.cc:1403] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20260619 19:53:47.941926 1200 raft_consensus.cc:359] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.942202 1200 raft_consensus.cc:385] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.942338 1200 raft_consensus.cc:740] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.942291 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_e06b0d031cdd4c02a09e69ce2f27a2de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.942759 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e06b0d031cdd4c02a09e69ce2f27a2de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.942920 1208 tablet_bootstrap.cc:492] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:47.942934 1200 consensus_queue.cc:260] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.943313 1208 ts_tablet_manager.cc:1403] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.003s
I20260619 19:53:47.944793 1200 ts_tablet_manager.cc:1434] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260619 19:53:47.945174 1200 tablet_bootstrap.cc:492] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:47.946945 1200 tablet_bootstrap.cc:654] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.950839 1201 tablet_bootstrap.cc:492] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:47.951176 1201 ts_tablet_manager.cc:1403] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260619 19:53:47.952175 1201 raft_consensus.cc:359] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.952461 1201 raft_consensus.cc:385] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.952595 1201 raft_consensus.cc:740] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.952715 1200 tablet_bootstrap.cc:492] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:47.952901 1200 ts_tablet_manager.cc:1403] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260619 19:53:47.953024 1201 consensus_queue.cc:260] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.953773 1200 raft_consensus.cc:359] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.954010 1200 raft_consensus.cc:385] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.954151 1200 raft_consensus.cc:740] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.954548 1200 consensus_queue.cc:260] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.955226 1200 ts_tablet_manager.cc:1434] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:47.955586 1200 tablet_bootstrap.cc:492] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:47.957479 1200 tablet_bootstrap.cc:654] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.957487 1201 ts_tablet_manager.cc:1434] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260619 19:53:47.958559 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_4208519822c84af797182dbde8dc4d82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.958657 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7b0feea3bf1f421da67989a58048ae25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.966184 1200 tablet_bootstrap.cc:492] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:47.966444 1200 ts_tablet_manager.cc:1403] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20260619 19:53:47.966822 595 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5ce3e049ff5646d682ee9f9b37fea756 (table default.Table_12a0a4f870d04ef2b862367e14b1c07d [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 1 got 0
I20260619 19:53:47.967458 1200 raft_consensus.cc:359] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.967712 1200 raft_consensus.cc:385] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.967831 1200 raft_consensus.cc:740] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.968168 1200 consensus_queue.cc:260] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.961437 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_cce57077140d46f9a0edd649b40aee9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.969729 1200 ts_tablet_manager.cc:1434] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:47.970163 1200 tablet_bootstrap.cc:492] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:47.970273 1201 tablet_bootstrap.cc:492] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:47.972041 1200 tablet_bootstrap.cc:654] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:47.972254 1201 tablet_bootstrap.cc:654] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:47.975486 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4208519822c84af797182dbde8dc4d82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.976886 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0feea3bf1f421da67989a58048ae25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.980414 1205 raft_consensus.cc:493] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:47.980672 1205 raft_consensus.cc:515] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.981226 1208 raft_consensus.cc:359] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.981673 1208 raft_consensus.cc:385] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.981796 1208 raft_consensus.cc:740] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.982877 1205 leader_election.cc:290] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:47.982831 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_125f5c06b70f432981352415671f36a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:47.983275 1208 consensus_queue.cc:260] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:47.983443 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_125f5c06b70f432981352415671f36a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:47.985230 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce57077140d46f9a0edd649b40aee9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.985363 1039 tablet_service.cc:1511] Processing CreateTablet for tablet c9652b7e593c4c2597a1f9268d67b6d1 (DEFAULT_TABLE table=default.Table_dac8cb3e1d594f139948228663d117c0 [id=48b2e4a0c57a49ba85be21c915aa9502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:47.985803 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9652b7e593c4c2597a1f9268d67b6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:47.988467 1208 ts_tablet_manager.cc:1434] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.045s user 0.008s sys 0.004s
I20260619 19:53:47.990913 1200 tablet_bootstrap.cc:492] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:47.991562 1200 ts_tablet_manager.cc:1403] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.007s
I20260619 19:53:47.992437 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a2a19e703d7d4d918901e6f436214186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:47.993224 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2a19e703d7d4d918901e6f436214186 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:47.993408 1201 tablet_bootstrap.cc:492] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:47.993611 1201 ts_tablet_manager.cc:1403] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.004s
I20260619 19:53:47.992632 1200 raft_consensus.cc:359] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:47.993942 1110 tablet.cc:2406] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:53:47.994550 1201 raft_consensus.cc:359] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:47.994767 1201 raft_consensus.cc:385] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.994863 1201 raft_consensus.cc:740] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.995249 1200 raft_consensus.cc:385] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:47.995183 1201 consensus_queue.cc:260] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:47.995530 1200 raft_consensus.cc:740] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:47.996095 1200 consensus_queue.cc:260] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:47.998471 1201 ts_tablet_manager.cc:1434] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20260619 19:53:47.999475 590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 48129.7us
I20260619 19:53:48.000295 1208 tablet_bootstrap.cc:492] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.000833 764 tablet_service.cc:1511] Processing CreateTablet for tablet d4460c79a15140d5b643130f4e0329aa (DEFAULT_TABLE table=default.Table_fbf41d8a2bac4b7980202fac2ad060cd [id=878d66188d3347a9b4dca485c4204678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.001370 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4460c79a15140d5b643130f4e0329aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.002592 1208 tablet_bootstrap.cc:654] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.008188 900 tablet_service.cc:1511] Processing CreateTablet for tablet d4460c79a15140d5b643130f4e0329aa (DEFAULT_TABLE table=default.Table_fbf41d8a2bac4b7980202fac2ad060cd [id=878d66188d3347a9b4dca485c4204678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.008764 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4460c79a15140d5b643130f4e0329aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.009588 762 tablet_service.cc:1511] Processing CreateTablet for tablet c9652b7e593c4c2597a1f9268d67b6d1 (DEFAULT_TABLE table=default.Table_dac8cb3e1d594f139948228663d117c0 [id=48b2e4a0c57a49ba85be21c915aa9502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.010074 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9652b7e593c4c2597a1f9268d67b6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.011574 763 tablet_service.cc:1511] Processing CreateTablet for tablet a2db4450a1a449b28f30933401ca0689 (DEFAULT_TABLE table=default.Table_5f953279c7ee4c4dbccc3be6283da4ce [id=0342764f88ba49ce837448cf3e8fce60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.011797 903 tablet_service.cc:1511] Processing CreateTablet for tablet a2db4450a1a449b28f30933401ca0689 (DEFAULT_TABLE table=default.Table_5f953279c7ee4c4dbccc3be6283da4ce [id=0342764f88ba49ce837448cf3e8fce60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.012020 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2db4450a1a449b28f30933401ca0689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.012264 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2db4450a1a449b28f30933401ca0689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.015547 902 tablet_service.cc:1511] Processing CreateTablet for tablet c9652b7e593c4c2597a1f9268d67b6d1 (DEFAULT_TABLE table=default.Table_dac8cb3e1d594f139948228663d117c0 [id=48b2e4a0c57a49ba85be21c915aa9502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.016029 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9652b7e593c4c2597a1f9268d67b6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.019882 968 heartbeater.cc:499] Master 127.0.105.188:44433 was elected leader, sending a full tablet report...
I20260619 19:53:48.024971 1200 ts_tablet_manager.cc:1434] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260619 19:53:48.025302 1200 tablet_bootstrap.cc:492] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.027087 1200 tablet_bootstrap.cc:654] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.035246 830 heartbeater.cc:499] Master 127.0.105.188:44433 was elected leader, sending a full tablet report...
W20260619 19:53:48.043804 1223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:53:48.044967 996 leader_election.cc:343] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: d4460c79a15140d5b643130f4e0329aa
I20260619 19:53:48.045979 1208 tablet_bootstrap.cc:492] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.046187 1208 ts_tablet_manager.cc:1403] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.011s
I20260619 19:53:48.047667 1208 raft_consensus.cc:359] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.047888 1208 raft_consensus.cc:385] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.048005 1208 raft_consensus.cc:740] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.048309 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4460c79a15140d5b643130f4e0329aa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:48.049634 996 leader_election.cc:343] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:48.049834 996 leader_election.cc:304] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:48.050331 1205 raft_consensus.cc:2749] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:48.048333 1208 consensus_queue.cc:260] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:48.050858 1225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:48.051457 1208 ts_tablet_manager.cc:1434] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:48.052167 1208 tablet_bootstrap.cc:492] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.053086 1206 raft_consensus.cc:493] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.053402 1174 server_base.cc:1061] running on GCE node
I20260619 19:53:48.053438 1206 raft_consensus.cc:515] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.054416 1208 tablet_bootstrap.cc:654] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.056370 1208 tablet_bootstrap.cc:492] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.056572 1208 ts_tablet_manager.cc:1403] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260619 19:53:48.057413 1208 raft_consensus.cc:359] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.057621 1208 raft_consensus.cc:385] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.057715 1208 raft_consensus.cc:740] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.057626 1206 leader_election.cc:290] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.057992 1208 consensus_queue.cc:260] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.065378 1201 tablet_bootstrap.cc:492] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.069804 1200 tablet_bootstrap.cc:492] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.070007 1200 ts_tablet_manager.cc:1403] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.013s
I20260619 19:53:48.070832 1200 raft_consensus.cc:359] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.071026 1200 raft_consensus.cc:385] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.071103 1200 raft_consensus.cc:740] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.071382 1200 consensus_queue.cc:260] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.074659 1200 ts_tablet_manager.cc:1434] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:48.076731 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 5ce3e049ff5646d682ee9f9b37fea756 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.077160 601 master_service.cc:960] ReplaceTablet: received request to replace tablet 08c6a1313bb840908c49d14960be0fc8 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.077247 1208 ts_tablet_manager.cc:1434] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.021s user 0.006s sys 0.005s
I20260619 19:53:48.078630 1208 tablet_bootstrap.cc:492] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.080992 1208 tablet_bootstrap.cc:654] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.081915 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce3e049ff5646d682ee9f9b37fea756" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.082319 1061 raft_consensus.cc:2468] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:53:48.083056 1202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:53:48.082953 859 leader_election.cc:304] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:48.083685 1206 raft_consensus.cc:2804] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.083850 1206 raft_consensus.cc:493] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.083956 1206 raft_consensus.cc:3060] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.084403 1174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:53:48.087617 1206 raft_consensus.cc:515] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.089359 1208 tablet_bootstrap.cc:492] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.089538 1208 ts_tablet_manager.cc:1403] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260619 19:53:48.090478 1201 tablet_bootstrap.cc:654] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.090413 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce3e049ff5646d682ee9f9b37fea756" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:48.090472 1208 raft_consensus.cc:359] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:48.090632 1061 raft_consensus.cc:3060] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.090790 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce3e049ff5646d682ee9f9b37fea756" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:48.090823 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce3e049ff5646d682ee9f9b37fea756" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:48.091282 785 raft_consensus.cc:2468] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:48.091543 1208 raft_consensus.cc:385] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.091662 1208 raft_consensus.cc:740] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.091938 1208 consensus_queue.cc:260] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:48.092479 1208 ts_tablet_manager.cc:1434] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:53:48.097936 1208 tablet_bootstrap.cc:492] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.099721 1208 tablet_bootstrap.cc:654] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.104183 1061 raft_consensus.cc:2468] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:48.105289 1201 tablet_bootstrap.cc:492] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:48.105106 859 leader_election.cc:304] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:48.105732 1201 ts_tablet_manager.cc:1403] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.001s
I20260619 19:53:48.107164 1201 raft_consensus.cc:359] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.107456 1201 raft_consensus.cc:385] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.107542 1201 raft_consensus.cc:740] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.108070 1201 consensus_queue.cc:260] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.111366 600 master_service.cc:960] ReplaceTablet: received request to replace tablet 5ce3e049ff5646d682ee9f9b37fea756 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.111720 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 5ce3e049ff5646d682ee9f9b37fea756 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.112762 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_dac8cb3e1d594f139948228663d117c0" } new_table_name: "default.Table_fabb0cf46d644f83bda6327cea44f709" modify_external_catalogs: true
I20260619 19:53:48.115242 598 master_service.cc:960] ReplaceTablet: received request to replace tablet 5ce3e049ff5646d682ee9f9b37fea756 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.116163 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5f953279c7ee4c4dbccc3be6283da4ce" } new_table_name: "default.Table_8b2950a5d623472892aa182117131970" modify_external_catalogs: true
W20260619 19:53:48.118883 833 tablet.cc:2406] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:53:48.124722 1208 tablet_bootstrap.cc:492] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.125178 1208 ts_tablet_manager.cc:1403] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.005s
I20260619 19:53:48.126670 1208 raft_consensus.cc:359] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.127108 1208 raft_consensus.cc:385] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.127291 1208 raft_consensus.cc:740] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.127564 604 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d4460c79a15140d5b643130f4e0329aa (table default.Table_fbf41d8a2bac4b7980202fac2ad060cd [id=878d66188d3347a9b4dca485c4204678]). Expected version 1 got 0
I20260619 19:53:48.127871 1208 consensus_queue.cc:260] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.128815 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_12a0a4f870d04ef2b862367e14b1c07d" } new_table_name: "default.Table_a5548affccc643a2af2409af28583af9" modify_external_catalogs: true
I20260619 19:53:48.129947 1208 ts_tablet_manager.cc:1434] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:48.131458 1208 tablet_bootstrap.cc:492] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.133996 1208 tablet_bootstrap.cc:654] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.137602 1235 raft_consensus.cc:2804] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:48.137733 1201 ts_tablet_manager.cc:1434] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.032s user 0.008s sys 0.017s
I20260619 19:53:48.138290 1201 tablet_bootstrap.cc:492] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.141114 1208 tablet_bootstrap.cc:492] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.141310 1208 ts_tablet_manager.cc:1403] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20260619 19:53:48.142184 1208 raft_consensus.cc:359] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.142408 1208 raft_consensus.cc:385] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.142537 1208 raft_consensus.cc:740] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.142828 1208 consensus_queue.cc:260] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.143332 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a (DEFAULT_TABLE table=default.Table_e06b0d031cdd4c02a09e69ce2f27a2de [id=d75cbf2f80d44ee5866d74eefe704686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.143815 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.144785 762 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a (DEFAULT_TABLE table=default.Table_e06b0d031cdd4c02a09e69ce2f27a2de [id=d75cbf2f80d44ee5866d74eefe704686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.145385 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.147222 1208 ts_tablet_manager.cc:1434] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260619 19:53:48.150974 1208 tablet_bootstrap.cc:492] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.151422 1200 tablet_bootstrap.cc:492] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.152604 1201 tablet_bootstrap.cc:654] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.152967 1208 tablet_bootstrap.cc:654] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.153234 1200 tablet_bootstrap.cc:654] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.153395 1206 leader_election.cc:290] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.153896 1235 raft_consensus.cc:697] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:48.155871 1235 consensus_queue.cc:237] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.156536 1208 tablet_bootstrap.cc:492] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.156773 1208 ts_tablet_manager.cc:1403] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260619 19:53:48.157848 1208 raft_consensus.cc:359] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.158119 1208 raft_consensus.cc:385] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.158217 1208 raft_consensus.cc:740] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.158588 1208 consensus_queue.cc:260] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.161931 1201 tablet_bootstrap.cc:492] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:48.162117 1201 ts_tablet_manager.cc:1403] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.008s
I20260619 19:53:48.162883 1229 raft_consensus.cc:493] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.162973 1201 raft_consensus.cc:359] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.163234 1201 raft_consensus.cc:385] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.163334 1201 raft_consensus.cc:740] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.163621 1201 consensus_queue.cc:260] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.164211 1201 ts_tablet_manager.cc:1434] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:53:48.164525 1201 tablet_bootstrap.cc:492] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.166129 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a (DEFAULT_TABLE table=default.Table_e06b0d031cdd4c02a09e69ce2f27a2de [id=d75cbf2f80d44ee5866d74eefe704686]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.168879 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.166656 1201 tablet_bootstrap.cc:654] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:48.173638 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9652b7e593c4c2597a1f9268d67b6d1 consensus state has no leader
I20260619 19:53:48.179437 1218 raft_consensus.cc:493] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.163060 1229 raft_consensus.cc:515] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.186039 1208 ts_tablet_manager.cc:1434] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.025s user 0.002s sys 0.002s
I20260619 19:53:48.179646 1218 raft_consensus.cc:515] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.188385 1218 leader_election.cc:290] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.194067 1229 leader_election.cc:290] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.198230 1200 tablet_bootstrap.cc:492] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.198403 1200 ts_tablet_manager.cc:1403] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.007s
I20260619 19:53:48.200806 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9652b7e593c4c2597a1f9268d67b6d1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.201174 1060 raft_consensus.cc:2468] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:48.200811 1200 raft_consensus.cc:359] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.203083 1200 raft_consensus.cc:385] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.203213 1200 raft_consensus.cc:740] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.203560 1200 consensus_queue.cc:260] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.204439 720 leader_election.cc:304] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:48.206058 1200 ts_tablet_manager.cc:1434] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260619 19:53:48.206323 1174 hybrid_clock.cc:648] HybridClock initialized: now 1781898828206179 us; error 103 us; skew 500 ppm
I20260619 19:53:48.206853 1174 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 19:53:48.207582 1229 raft_consensus.cc:2804] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.207785 1229 raft_consensus.cc:493] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.207892 1229 raft_consensus.cc:3060] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.210852 1229 raft_consensus.cc:515] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.212371 1229 leader_election.cc:290] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.212831 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9652b7e593c4c2597a1f9268d67b6d1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:48.213080 1060 raft_consensus.cc:3060] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.218191 596 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_5f953279c7ee4c4dbccc3be6283da4ce [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 1 got 0
I20260619 19:53:48.218142 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4460c79a15140d5b643130f4e0329aa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:48.218439 596 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d4460c79a15140d5b643130f4e0329aa (table default.Table_fbf41d8a2bac4b7980202fac2ad060cd [id=878d66188d3347a9b4dca485c4204678]). Expected version 1 got 0
I20260619 19:53:48.218614 596 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_fabb0cf46d644f83bda6327cea44f709 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 2 got 0
I20260619 19:53:48.218781 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9652b7e593c4c2597a1f9268d67b6d1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:48.219225 922 raft_consensus.cc:2468] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
W20260619 19:53:48.219587 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a2db4450a1a449b28f30933401ca0689 consensus state has no leader
W20260619 19:53:48.219573 719 leader_election.cc:343] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:48.220047 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_fbf41d8a2bac4b7980202fac2ad060cd" } new_table_name: "default.Table_2d591f5910164b6484fa365a3ecc5e8f" modify_external_catalogs: true
I20260619 19:53:48.219108 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9652b7e593c4c2597a1f9268d67b6d1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:48.220917 921 raft_consensus.cc:3060] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.225642 762 tablet_service.cc:1511] Processing CreateTablet for tablet f738fc8a167245c68181698f4b302176 (DEFAULT_TABLE table=default.Table_125f5c06b70f432981352415671f36a2 [id=cd3d8106476d40748b5940bfe4e46640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.225849 903 tablet_service.cc:1511] Processing CreateTablet for tablet f738fc8a167245c68181698f4b302176 (DEFAULT_TABLE table=default.Table_125f5c06b70f432981352415671f36a2 [id=cd3d8106476d40748b5940bfe4e46640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.226433 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f738fc8a167245c68181698f4b302176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.226562 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f738fc8a167245c68181698f4b302176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.231707 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4460c79a15140d5b643130f4e0329aa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.232162 1061 raft_consensus.cc:2468] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:48.235381 720 leader_election.cc:304] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:48.237766 1039 tablet_service.cc:1511] Processing CreateTablet for tablet f738fc8a167245c68181698f4b302176 (DEFAULT_TABLE table=default.Table_125f5c06b70f432981352415671f36a2 [id=cd3d8106476d40748b5940bfe4e46640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.238381 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f738fc8a167245c68181698f4b302176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.238787 921 raft_consensus.cc:2468] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:48.239547 719 leader_election.cc:304] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:48.240131 1218 raft_consensus.cc:2804] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.240285 1218 raft_consensus.cc:493] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.240396 1218 raft_consensus.cc:3060] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.245512 1040 tablet_service.cc:1511] Processing CreateTablet for tablet da8cc8a9266f43be995f7c4dcf2391f6 (DEFAULT_TABLE table=default.Table_4208519822c84af797182dbde8dc4d82 [id=a913d888b0ea4839847ecb8b6dafc17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.246075 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8cc8a9266f43be995f7c4dcf2391f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.246099 763 tablet_service.cc:1511] Processing CreateTablet for tablet da8cc8a9266f43be995f7c4dcf2391f6 (DEFAULT_TABLE table=default.Table_4208519822c84af797182dbde8dc4d82 [id=a913d888b0ea4839847ecb8b6dafc17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.246575 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8cc8a9266f43be995f7c4dcf2391f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.247540 900 tablet_service.cc:1511] Processing CreateTablet for tablet da8cc8a9266f43be995f7c4dcf2391f6 (DEFAULT_TABLE table=default.Table_4208519822c84af797182dbde8dc4d82 [id=a913d888b0ea4839847ecb8b6dafc17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.247997 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8cc8a9266f43be995f7c4dcf2391f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.250443 1060 raft_consensus.cc:2468] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:53:48.252345 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4460c79a15140d5b643130f4e0329aa consensus state has no leader
I20260619 19:53:48.252890 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c3eca0e04302460199b2dde61cbf8ed0" } new_table_name: "default.Table_37b1b87772ac4a31bd31a3fefe92a515" modify_external_catalogs: true
I20260619 19:53:48.257251 1218 raft_consensus.cc:515] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.258713 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4460c79a15140d5b643130f4e0329aa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:48.259088 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 5ce3e049ff5646d682ee9f9b37fea756
W20260619 19:53:48.259405 719 leader_election.cc:343] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:48.257633 1229 raft_consensus.cc:2804] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:48.260162 600 catalog_manager.cc:6784] ReplaceTablet: tablet 5ce3e049ff5646d682ee9f9b37fea756 deleted and replaced by tablet d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:53:48.260622 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4460c79a15140d5b643130f4e0329aa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:48.260865 1060 raft_consensus.cc:3060] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.261199 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cc82ca43b5cf464db8144b09e67a1b6a" } modify_external_catalogs: true
I20260619 19:53:48.261466 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cc82ca43b5cf464db8144b09e67a1b6a" } modify_external_catalogs: true
I20260619 19:53:48.263602 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e06b0d031cdd4c02a09e69ce2f27a2de" } modify_external_catalogs: true
I20260619 19:53:48.263813 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e06b0d031cdd4c02a09e69ce2f27a2de" } modify_external_catalogs: true
I20260619 19:53:48.265592 599 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_c3eca0e04302460199b2dde61cbf8ed0 [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 1 got 0
I20260619 19:53:48.265914 1218 leader_election.cc:290] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.267244 1060 raft_consensus.cc:2468] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:48.267925 720 leader_election.cc:304] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:48.268002 602 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b6822e2f028a4ee29e80309e9e006c0a" } modify_external_catalogs: true
I20260619 19:53:48.268208 602 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b6822e2f028a4ee29e80309e9e006c0a" } modify_external_catalogs: true
I20260619 19:53:48.268496 1218 raft_consensus.cc:2804] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:48.268707 1218 raft_consensus.cc:697] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:48.270731 1218 consensus_queue.cc:237] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.270874 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c889f13fbe49c3aab1e7f0d0d08e98) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.271059 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b716080450d7415ebf6dfdc29033f87e" } modify_external_catalogs: true
I20260619 19:53:48.271252 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b716080450d7415ebf6dfdc29033f87e" } modify_external_catalogs: true
I20260619 19:53:48.276752 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c889f13fbe49c3aab1e7f0d0d08e98) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.278976 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_32f92f5c64464d989015e442afc82c76" } modify_external_catalogs: true
I20260619 19:53:48.279258 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_32f92f5c64464d989015e442afc82c76" } modify_external_catalogs: true
I20260619 19:53:48.282275 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c889f13fbe49c3aab1e7f0d0d08e98) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.282931 1229 raft_consensus.cc:697] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:48.283510 1229 consensus_queue.cc:237] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.289243 1246 tablet_replica.cc:333] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.292450 1247 tablet_replica.cc:333] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:48.293125 1247 raft_consensus.cc:2243] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:48.293665 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:48.293918 1247 pending_rounds.cc:70] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:48.294179 1247 pending_rounds.cc:77] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657600134742016 op_type: NO_OP noop_request { }
I20260619 19:53:48.294492 1247 raft_consensus.cc:2889] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:48.294741 1247 raft_consensus.cc:2272] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.296672 763 tablet_service.cc:1558] Processing DeleteTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.297878 900 tablet_service.cc:1558] Processing DeleteTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.298342 1246 raft_consensus.cc:2243] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.298818 1247 ts_tablet_manager.cc:1916] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.299243 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.299458 1246 raft_consensus.cc:2272] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.301214 1246 ts_tablet_manager.cc:1916] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.305930 601 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 08c6a1313bb840908c49d14960be0fc8
I20260619 19:53:48.307742 603 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_c3eca0e04302460199b2dde61cbf8ed0 [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 1 got 0
I20260619 19:53:48.309408 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 08c6a1313bb840908c49d14960be0fc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d37d6f54a96471fad26a342cab984ef) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.309636 1247 ts_tablet_manager.cc:1929] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:48.309911 1247 log.cc:1199] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/5ce3e049ff5646d682ee9f9b37fea756
I20260619 19:53:48.310422 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 08c6a1313bb840908c49d14960be0fc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d37d6f54a96471fad26a342cab984ef) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.310585 1247 ts_tablet_manager.cc:1950] T 5ce3e049ff5646d682ee9f9b37fea756 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:48.310801 601 catalog_manager.cc:6784] ReplaceTablet: tablet 08c6a1313bb840908c49d14960be0fc8 deleted and replaced by tablet 2d37d6f54a96471fad26a342cab984ef
I20260619 19:53:48.311329 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a0857208b62b490cae07a3aa02b045c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.311549 1248 tablet_replica.cc:333] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:53:48.312270 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0857208b62b490cae07a3aa02b045c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.312280 1248 raft_consensus.cc:2243] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.312762 1248 raft_consensus.cc:2272] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.313277 1246 ts_tablet_manager.cc:1929] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.314404 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet f0fc9c0f9ba246f6b650c22a90a5cc1f
I20260619 19:53:48.315337 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_b760ff0be4ca4d64812fde6c972e080c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.316155 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b760ff0be4ca4d64812fde6c972e080c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.314775 1200 tablet_bootstrap.cc:492] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.318308 1200 tablet_bootstrap.cc:654] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:48.320051 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8c889f13fbe49c3aab1e7f0d0d08e98 has no consensus state
I20260619 19:53:48.320363 762 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.320557 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_b7a2a555121041ac8ae5440181d205da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.321218 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7a2a555121041ac8ae5440181d205da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.324604 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.324908 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 08c6a1313bb840908c49d14960be0fc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d37d6f54a96471fad26a342cab984ef) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.325172 902 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.325131 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 5ce3e049ff5646d682ee9f9b37fea756 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]) successfully deleted
I20260619 19:53:48.325489 1247 tablet_replica.cc:333] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:48.325729 1247 raft_consensus.cc:2243] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:48.325765 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 because the tablet was not found. No further retry: Not found: Tablet not found: a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:48.326057 1247 raft_consensus.cc:2272] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.326943 1247 ts_tablet_manager.cc:1916] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.328969 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a
I20260619 19:53:48.330030 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_c48a1b6e5cfe4746b6a342e1e43f325f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.330852 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c48a1b6e5cfe4746b6a342e1e43f325f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.331574 1246 log.cc:1199] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/5ce3e049ff5646d682ee9f9b37fea756
I20260619 19:53:48.332262 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.333053 1246 ts_tablet_manager.cc:1950] T 5ce3e049ff5646d682ee9f9b37fea756 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.335178 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.335307 1247 ts_tablet_manager.cc:1929] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.336133 1200 tablet_bootstrap.cc:492] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.336334 1200 ts_tablet_manager.cc:1403] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.007s
I20260619 19:53:48.336651 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_879260ad54894aa5839b8cb3df8f3e56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.337199 1200 raft_consensus.cc:359] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:48.337325 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_879260ad54894aa5839b8cb3df8f3e56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.337426 1200 raft_consensus.cc:385] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.337524 1200 raft_consensus.cc:740] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.337845 1200 consensus_queue.cc:260] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.338543 1205 raft_consensus.cc:493] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.338728 1205 raft_consensus.cc:515] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.335502 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.339453 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_3ed147ad3dd54cac8d31e443a31ae944"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.339596 1205 leader_election.cc:290] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:48.339888 1247 log.cc:1199] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/08c6a1313bb840908c49d14960be0fc8
W20260619 19:53:48.340044 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ed147ad3dd54cac8d31e443a31ae944 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.340619 1247 ts_tablet_manager.cc:1950] T 08c6a1313bb840908c49d14960be0fc8 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:48.340610 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c6a1313bb840908c49d14960be0fc8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:48.340875 785 raft_consensus.cc:2468] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
W20260619 19:53:48.341243 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48a58620df904c09b459d3f7ff72bcf8 consensus state has no leader
I20260619 19:53:48.341670 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a376ec2772bc4c7a8df567d4d24336d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.341804 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c6a1313bb840908c49d14960be0fc8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:48.342599 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a376ec2772bc4c7a8df567d4d24336d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.342767 1200 ts_tablet_manager.cc:1434] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260619 19:53:48.344152 996 leader_election.cc:304] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:48.344534 996 leader_election.cc:343] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:53:48.344668 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce3e049ff5646d682ee9f9b37fea756 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c889f13fbe49c3aab1e7f0d0d08e98) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.344712 1200 tablet_bootstrap.cc:492] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.345793 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 08c6a1313bb840908c49d14960be0fc8 (table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]) successfully deleted
W20260619 19:53:48.346268 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f because the tablet was not found. No further retry: Not found: Tablet not found: f0fc9c0f9ba246f6b650c22a90a5cc1f
I20260619 19:53:48.346518 1200 tablet_bootstrap.cc:654] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:48.346539 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a already in progress: creating tablet
I20260619 19:53:48.346971 1205 raft_consensus.cc:2804] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260619 19:53:48.347168 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 5ce3e049ff5646d682ee9f9b37fea756 because the tablet was not found. No further retry: Not found: Tablet not found: 5ce3e049ff5646d682ee9f9b37fea756
I20260619 19:53:48.347467 1205 raft_consensus.cc:493] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.347627 1205 raft_consensus.cc:3060] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.349367 597 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:53:48.349781 597 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_fabb0cf46d644f83bda6327cea44f709 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 2 got 0
I20260619 19:53:48.350443 1246 tablet_replica.cc:333] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.351480 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 5ce3e049ff5646d682ee9f9b37fea756 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]) successfully deleted
W20260619 19:53:48.351838 591 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 because the tablet was not found. No further retry: Not found: Tablet not found: a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:48.353524 1205 raft_consensus.cc:515] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.354161 1200 tablet_bootstrap.cc:492] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.354307 1200 ts_tablet_manager.cc:1403] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20260619 19:53:48.357999 762 tablet_service.cc:1511] Processing CreateTablet for tablet a9c566903d9848f0bbe046793922b778 (DEFAULT_TABLE table=default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.358171 902 tablet_service.cc:1511] Processing CreateTablet for tablet a9c566903d9848f0bbe046793922b778 (DEFAULT_TABLE table=default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.358516 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c566903d9848f0bbe046793922b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.358551 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c566903d9848f0bbe046793922b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.359045 901 tablet_service.cc:1511] Processing CreateTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 (DEFAULT_TABLE table=default.Table_cc82ca43b5cf464db8144b09e67a1b6a [id=4b2d780b8f1d4d8786bb33f2ec5ca8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.359436 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93ce0dc0b034f7fa87f74768a0e5ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.362632 900 tablet_service.cc:1511] Processing CreateTablet for tablet 9b11228f4e7747619127ffbb99123e9f (DEFAULT_TABLE table=default.Table_b716080450d7415ebf6dfdc29033f87e [id=8ac1c025b7224f29a7967cd91efb3a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.363188 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b11228f4e7747619127ffbb99123e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.363785 763 tablet_service.cc:1511] Processing CreateTablet for tablet 9b11228f4e7747619127ffbb99123e9f (DEFAULT_TABLE table=default.Table_b716080450d7415ebf6dfdc29033f87e [id=8ac1c025b7224f29a7967cd91efb3a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.364228 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b11228f4e7747619127ffbb99123e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.367591 764 tablet_service.cc:1511] Processing CreateTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 (DEFAULT_TABLE table=default.Table_cc82ca43b5cf464db8144b09e67a1b6a [id=4b2d780b8f1d4d8786bb33f2ec5ca8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.368196 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93ce0dc0b034f7fa87f74768a0e5ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.372507 1208 tablet_bootstrap.cc:492] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.375033 1208 tablet_bootstrap.cc:654] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.376675 1205 leader_election.cc:290] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:48.377312 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 9b11228f4e7747619127ffbb99123e9f
I20260619 19:53:48.377283 1200 raft_consensus.cc:359] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.377501 1200 raft_consensus.cc:385] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.377624 1200 raft_consensus.cc:740] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.377998 1200 consensus_queue.cc:260] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:48.378362 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 273279us
I20260619 19:53:48.378573 1200 ts_tablet_manager.cc:1434] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.024s user 0.000s sys 0.001s
I20260619 19:53:48.379211 1235 raft_consensus.cc:493] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.379191 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 9b11228f4e7747619127ffbb99123e9f (DEFAULT_TABLE table=default.Table_b716080450d7415ebf6dfdc29033f87e [id=8ac1c025b7224f29a7967cd91efb3a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.379453 1235 raft_consensus.cc:515] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:48.379828 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b11228f4e7747619127ffbb99123e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.380388 1235 leader_election.cc:290] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:48.381316 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a58620df904c09b459d3f7ff72bcf8" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:48.381575 785 raft_consensus.cc:2468] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:48.381850 1218 raft_consensus.cc:493] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.382001 1218 raft_consensus.cc:515] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.382355 1038 tablet_service.cc:1511] Processing CreateTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 (DEFAULT_TABLE table=default.Table_cc82ca43b5cf464db8144b09e67a1b6a [id=4b2d780b8f1d4d8786bb33f2ec5ca8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.382793 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93ce0dc0b034f7fa87f74768a0e5ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.382776 1218 leader_election.cc:290] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.383253 1205 raft_consensus.cc:493] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.383417 1205 raft_consensus.cc:515] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:48.383574 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2db4450a1a449b28f30933401ca0689" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.383843 1060 raft_consensus.cc:2468] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:48.384404 1039 tablet_service.cc:1511] Processing CreateTablet for tablet a9c566903d9848f0bbe046793922b778 (DEFAULT_TABLE table=default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.384444 720 leader_election.cc:304] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:48.384810 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c566903d9848f0bbe046793922b778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.385392 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2db4450a1a449b28f30933401ca0689" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:48.385650 921 raft_consensus.cc:2468] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:48.386063 858 leader_election.cc:304] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:48.387113 1218 raft_consensus.cc:2804] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.387269 1218 raft_consensus.cc:493] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.387374 1218 raft_consensus.cc:3060] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.390072 1218 raft_consensus.cc:515] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.391762 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2db4450a1a449b28f30933401ca0689" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:48.392005 921 raft_consensus.cc:3060] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.393934 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b11228f4e7747619127ffbb99123e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.394821 921 raft_consensus.cc:2468] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:48.394841 1205 leader_election.cc:290] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:48.395416 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b11228f4e7747619127ffbb99123e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.395522 719 leader_election.cc:304] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:48.395880 1229 raft_consensus.cc:2804] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:48.396046 1229 raft_consensus.cc:697] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:48.396325 1229 consensus_queue.cc:237] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:48.396502 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9b11228f4e7747619127ffbb99123e9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b11228f4e7747619127ffbb99123e9f already in progress: creating tablet
I20260619 19:53:48.397317 765 tablet_service.cc:1511] Processing CreateTablet for tablet 7400734402ca426aa34a3b7b482e59f1 (DEFAULT_TABLE table=default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.397799 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7400734402ca426aa34a3b7b482e59f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.399367 1235 raft_consensus.cc:2804] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.399485 1235 raft_consensus.cc:493] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.399590 1235 raft_consensus.cc:3060] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.405719 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2db4450a1a449b28f30933401ca0689" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:48.405967 1060 raft_consensus.cc:3060] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.406908 1246 raft_consensus.cc:2243] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.410794 1060 raft_consensus.cc:2468] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:48.410761 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_672e6fc5aebe40efbc58e5631f43b344"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.412695 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_50bd6a1e0f134316821a2d86cf553679"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.413350 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50bd6a1e0f134316821a2d86cf553679 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.413699 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b11228f4e7747619127ffbb99123e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.414182 1246 raft_consensus.cc:2272] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.414781 1246 ts_tablet_manager.cc:1916] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.414803 1218 leader_election.cc:290] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.415572 1235 raft_consensus.cc:515] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:48.416978 603 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_4208519822c84af797182dbde8dc4d82" } new_table_name: "default.Table_4926348283cd417fb921ee6e4b4b58ea" modify_external_catalogs: true
I20260619 19:53:48.417433 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a58620df904c09b459d3f7ff72bcf8" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:48.417688 785 raft_consensus.cc:3060] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.418488 1254 raft_consensus.cc:493] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.418659 1254 raft_consensus.cc:515] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.419474 1254 leader_election.cc:290] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:53:48.419781 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_672e6fc5aebe40efbc58e5631f43b344 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.422072 601 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c48a1b6e5cfe4746b6a342e1e43f325f" } new_table_name: "default.Table_795f746f2c61444fabf717551ba728e7" modify_external_catalogs: true
I20260619 19:53:48.421788 785 raft_consensus.cc:2468] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:48.422853 858 leader_election.cc:304] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:48.423285 1234 raft_consensus.cc:2804] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:48.423465 1234 raft_consensus.cc:697] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:48.423724 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:48.423823 1234 consensus_queue.cc:237] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:48.425983 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:48.426734 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 613372f5098b4c4fb69c4b88dd570f49 because the tablet was not found. No further retry: Not found: Tablet not found: 613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:48.427102 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7ffb8cd585bc42818dbf37ecbb2fd2c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.429171 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ffb8cd585bc42818dbf37ecbb2fd2c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.429874 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.430049 1200 tablet_bootstrap.cc:492] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.431319 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.431972 1200 tablet_bootstrap.cc:654] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.432602 597 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_37b1b87772ac4a31bd31a3fefe92a515 [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 2 got 0
I20260619 19:53:48.432974 597 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:53:48.433379 597 catalog_manager.cc:5696] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:48.434536 597 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d4460c79a15140d5b643130f4e0329aa (table default.Table_2d591f5910164b6484fa365a3ecc5e8f [id=878d66188d3347a9b4dca485c4204678]). Expected version 2 got 0
I20260619 19:53:48.434554 1246 ts_tablet_manager.cc:1929] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.434702 1246 log.cc:1199] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/08c6a1313bb840908c49d14960be0fc8
I20260619 19:53:48.434899 1235 leader_election.cc:290] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:48.435070 1246 ts_tablet_manager.cc:1950] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.435285 597 catalog_manager.cc:5696] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:48.435912 597 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_fabb0cf46d644f83bda6327cea44f709 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 2 got 0
I20260619 19:53:48.437012 1248 ts_tablet_manager.cc:1916] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.437425 1200 tablet_bootstrap.cc:492] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.437608 1200 ts_tablet_manager.cc:1403] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260619 19:53:48.438464 1200 raft_consensus.cc:359] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.438684 1200 raft_consensus.cc:385] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.438766 1200 raft_consensus.cc:740] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.444732 1200 consensus_queue.cc:260] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.445184 902 tablet_service.cc:1511] Processing CreateTablet for tablet 7400734402ca426aa34a3b7b482e59f1 (DEFAULT_TABLE table=default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.445632 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7400734402ca426aa34a3b7b482e59f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.445822 1246 tablet_replica.cc:333] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.446031 1246 raft_consensus.cc:2243] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.446512 762 tablet_service.cc:1511] Processing CreateTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f (DEFAULT_TABLE table=default.Table_b6822e2f028a4ee29e80309e9e006c0a [id=e2f073596be64b4c9e61b9a5f9962ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.446949 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.447192 900 tablet_service.cc:1511] Processing CreateTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f (DEFAULT_TABLE table=default.Table_b6822e2f028a4ee29e80309e9e006c0a [id=e2f073596be64b4c9e61b9a5f9962ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.447626 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.448042 1200 ts_tablet_manager.cc:1434] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260619 19:53:48.448626 1246 raft_consensus.cc:2272] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.450189 1200 tablet_bootstrap.cc:492] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.452427 1200 tablet_bootstrap.cc:654] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.453667 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a58620df904c09b459d3f7ff72bcf8" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.454080 1060 raft_consensus.cc:2468] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:48.454087 1246 ts_tablet_manager.cc:1916] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.455562 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a58620df904c09b459d3f7ff72bcf8" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:48.455845 1060 raft_consensus.cc:3060] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.459837 1060 raft_consensus.cc:2468] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:48.471518 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c6a1313bb840908c49d14960be0fc8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:48.471900 785 raft_consensus.cc:3060] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.476364 785 raft_consensus.cc:2468] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:48.480491 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a58620df904c09b459d3f7ff72bcf8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:48.482136 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a58620df904c09b459d3f7ff72bcf8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:48.483593 785 raft_consensus.cc:2393] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:48.484723 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a21352877f94e508038c2c44617c4c7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:48.485145 785 raft_consensus.cc:2468] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:48.486152 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a21352877f94e508038c2c44617c4c7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:48.486454 921 raft_consensus.cc:2468] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:48.491950 763 tablet_service.cc:1511] Processing CreateTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f (DEFAULT_TABLE table=default.Table_a2a19e703d7d4d918901e6f436214186 [id=71e32801a3984b37a60e1597394442e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.492568 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.493549 1200 tablet_bootstrap.cc:492] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.493721 1200 ts_tablet_manager.cc:1403] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.003s
I20260619 19:53:48.494675 1200 raft_consensus.cc:359] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.494863 1200 raft_consensus.cc:385] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.494966 1200 raft_consensus.cc:740] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.495240 1200 consensus_queue.cc:260] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.501518 1246 ts_tablet_manager.cc:1929] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.501664 1246 log.cc:1199] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9fc6f8eb2a04447c9a3aa1bb7d3e413a
I20260619 19:53:48.502091 1246 ts_tablet_manager.cc:1950] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:53:48.502518 996 leader_election.cc:343] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 08c6a1313bb840908c49d14960be0fc8
I20260619 19:53:48.503098 996 leader_election.cc:304] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:48.503104 1200 ts_tablet_manager.cc:1434] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260619 19:53:48.503686 1205 raft_consensus.cc:2804] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.503666 765 tablet_service.cc:1511] Processing CreateTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 (DEFAULT_TABLE table=default.Table_32f92f5c64464d989015e442afc82c76 [id=bb5f6f3462ca47d1a7cd4507fd093ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.503819 1205 raft_consensus.cc:493] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.503947 1205 raft_consensus.cc:3060] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.504122 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613372f5098b4c4fb69c4b88dd570f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.504925 902 tablet_service.cc:1511] Processing CreateTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f (DEFAULT_TABLE table=default.Table_a2a19e703d7d4d918901e6f436214186 [id=71e32801a3984b37a60e1597394442e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.505367 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.506790 1205 raft_consensus.cc:515] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.444012 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 08c6a1313bb840908c49d14960be0fc8 (table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]) successfully deleted
W20260619 19:53:48.507336 591 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 63320.2us
W20260619 19:53:48.508011 591 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f because the tablet was not found. No further retry: Not found: Tablet not found: f0fc9c0f9ba246f6b650c22a90a5cc1f
I20260619 19:53:48.456750 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a0857208b62b490cae07a3aa02b045c7" } new_table_name: "default.Table_452d096b92664c87ad0cecf5e611eab3" modify_external_catalogs: true
I20260619 19:53:48.508329 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 7400734402ca426aa34a3b7b482e59f1 (DEFAULT_TABLE table=default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.508719 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7400734402ca426aa34a3b7b482e59f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.490013 595 master_service.cc:960] ReplaceTablet: received request to replace tablet a9c566903d9848f0bbe046793922b778 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.510553 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f (DEFAULT_TABLE table=default.Table_a2a19e703d7d4d918901e6f436214186 [id=71e32801a3984b37a60e1597394442e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.511699 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.511639 1040 tablet_service.cc:1511] Processing CreateTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f (DEFAULT_TABLE table=default.Table_b6822e2f028a4ee29e80309e9e006c0a [id=e2f073596be64b4c9e61b9a5f9962ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.512113 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.515005 1205 leader_election.cc:290] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:48.519174 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a (table default.Table_e06b0d031cdd4c02a09e69ce2f27a2de [id=d75cbf2f80d44ee5866d74eefe704686]) successfully deleted
W20260619 19:53:48.519477 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9b11228f4e7747619127ffbb99123e9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b11228f4e7747619127ffbb99123e9f already in progress: creating tablet
W20260619 19:53:48.519723 591 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 613372f5098b4c4fb69c4b88dd570f49 because the tablet was not found. No further retry: Not found: Tablet not found: 613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:48.503654 996 leader_election.cc:304] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
W20260619 19:53:48.519975 996 raft_consensus.cc:2686] T 08c6a1313bb840908c49d14960be0fc8 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:53:48.520685 996 leader_election.cc:304] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:48.523185 1205 raft_consensus.cc:2749] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:48.524367 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a21352877f94e508038c2c44617c4c7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:48.524606 785 raft_consensus.cc:3060] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.527850 785 raft_consensus.cc:2468] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:48.528834 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a21352877f94e508038c2c44617c4c7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:48.529057 921 raft_consensus.cc:3060] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.531883 921 raft_consensus.cc:2468] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:48.532416 1208 tablet_bootstrap.cc:492] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.532593 1208 ts_tablet_manager.cc:1403] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.160s user 0.004s sys 0.001s
I20260619 19:53:48.533612 1208 raft_consensus.cc:359] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.533941 1208 raft_consensus.cc:385] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.534068 1208 raft_consensus.cc:740] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.534382 1208 consensus_queue.cc:260] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.535167 1208 ts_tablet_manager.cc:1434] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:48.535997 1208 tablet_bootstrap.cc:492] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.503865 1200 tablet_bootstrap.cc:492] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.537968 1208 tablet_bootstrap.cc:654] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.544162 599 master_service.cc:960] ReplaceTablet: received request to replace tablet 48a58620df904c09b459d3f7ff72bcf8 from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:48.544906 603 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da8cc8a9266f43be995f7c4dcf2391f6 consensus state has no leader
I20260619 19:53:48.545156 603 master_service.cc:960] ReplaceTablet: received request to replace tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.545601 603 master_service.cc:960] ReplaceTablet: received request to replace tablet 5a21352877f94e508038c2c44617c4c7 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.546123 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a2a19e703d7d4d918901e6f436214186" } modify_external_catalogs: true
I20260619 19:53:48.546335 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a2a19e703d7d4d918901e6f436214186" } modify_external_catalogs: true
I20260619 19:53:48.546948 1174 webserver.cc:533] Webserver started at http://127.0.105.190:45299/ using document root <none> and password file <none>
I20260619 19:53:48.548694 1174 fs_manager.cc:362] Metadata directory not provided
I20260619 19:53:48.548902 1174 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:53:48.550086 602 master_service.cc:960] ReplaceTablet: received request to replace tablet d4460c79a15140d5b643130f4e0329aa from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.556587 902 tablet_service.cc:1511] Processing CreateTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 (DEFAULT_TABLE table=default.Table_32f92f5c64464d989015e442afc82c76 [id=bb5f6f3462ca47d1a7cd4507fd093ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.557418 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613372f5098b4c4fb69c4b88dd570f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.559595 996 leader_election.cc:304] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:48.564308 1201 tablet_bootstrap.cc:492] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:48.564517 1201 ts_tablet_manager.cc:1403] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.400s user 0.068s sys 0.134s
I20260619 19:53:48.564613 1200 tablet_bootstrap.cc:654] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.565946 1208 tablet_bootstrap.cc:492] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.566138 1208 ts_tablet_manager.cc:1403] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260619 19:53:48.566151 1205 raft_consensus.cc:2804] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:48.567310 1201 raft_consensus.cc:359] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.567324 1208 raft_consensus.cc:359] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.567546 1208 raft_consensus.cc:385] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.567541 1201 raft_consensus.cc:385] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.567613 1201 raft_consensus.cc:740] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.567621 1208 raft_consensus.cc:740] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.567888 1201 consensus_queue.cc:260] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.569725 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 (DEFAULT_TABLE table=default.Table_32f92f5c64464d989015e442afc82c76 [id=bb5f6f3462ca47d1a7cd4507fd093ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.570194 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613372f5098b4c4fb69c4b88dd570f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.570652 1205 raft_consensus.cc:697] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:48.571170 1205 consensus_queue.cc:237] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.572592 1201 ts_tablet_manager.cc:1434] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
W20260619 19:53:48.574141 601 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24916ace14294b1ea8f713d3fc876d7a has no consensus state
I20260619 19:53:48.575785 1201 tablet_bootstrap.cc:492] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.577620 1201 tablet_bootstrap.cc:654] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.581453 1248 ts_tablet_manager.cc:1929] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.582319 1208 consensus_queue.cc:260] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:48.582861 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81b5633849d146d388eec16f98375085 has no consensus state
I20260619 19:53:48.582954 1208 ts_tablet_manager.cc:1434] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260619 19:53:48.583328 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_2d591f5910164b6484fa365a3ecc5e8f" } new_table_name: "default.Table_14a85cdb58a44fcc9de119384824ea63" modify_external_catalogs: true
I20260619 19:53:48.584802 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet a9c566903d9848f0bbe046793922b778
I20260619 19:53:48.585438 595 catalog_manager.cc:6784] ReplaceTablet: tablet a9c566903d9848f0bbe046793922b778 deleted and replaced by tablet 732a2e073e3442ff873ca00be6106744
I20260619 19:53:48.585780 595 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b760ff0be4ca4d64812fde6c972e080c" } modify_external_catalogs: true
I20260619 19:53:48.585986 595 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b760ff0be4ca4d64812fde6c972e080c" } modify_external_catalogs: true
I20260619 19:53:48.587199 1174 fs_manager.cc:714] Time spent opening directory manager: real 0.034s user 0.006s sys 0.000s
I20260619 19:53:48.587713 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_125f5c06b70f432981352415671f36a2" } modify_external_catalogs: true
I20260619 19:53:48.587891 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_125f5c06b70f432981352415671f36a2" } modify_external_catalogs: true
I20260619 19:53:48.587942 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f
I20260619 19:53:48.588626 598 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_37b1b87772ac4a31bd31a3fefe92a515" } new_table_name: "default.Table_d3b46da7823a441682cf7c3a4e321eed" modify_external_catalogs: true
I20260619 19:53:48.590565 1248 log.cc:1199] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/5ce3e049ff5646d682ee9f9b37fea756
I20260619 19:53:48.591935 1248 ts_tablet_manager.cc:1950] T 5ce3e049ff5646d682ee9f9b37fea756 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:48.592805 1208 tablet_bootstrap.cc:492] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.593231 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:48.594389 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f already in progress: creating tablet
I20260619 19:53:48.595078 1248 tablet_replica.cc:333] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:48.595327 1248 raft_consensus.cc:2243] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.595510 1248 raft_consensus.cc:2272] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.596483 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 5ce3e049ff5646d682ee9f9b37fea756 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]) successfully deleted
W20260619 19:53:48.596835 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93ce0dc0b034f7fa87f74768a0e5ba4 already in progress: creating tablet
I20260619 19:53:48.597179 601 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_795f746f2c61444fabf717551ba728e7" } modify_external_catalogs: true
I20260619 19:53:48.597350 1208 tablet_bootstrap.cc:654] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.597358 601 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_795f746f2c61444fabf717551ba728e7" } modify_external_catalogs: true
I20260619 19:53:48.598902 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.599027 765 tablet_service.cc:1558] Processing DeleteTablet for tablet a9c566903d9848f0bbe046793922b778 with delete_type TABLET_DATA_DELETED (replaced by tablet 732a2e073e3442ff873ca00be6106744) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.599283 1248 ts_tablet_manager.cc:1916] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.599570 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.599617 1246 tablet_replica.cc:333] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.599836 1246 raft_consensus.cc:2243] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.600034 1246 raft_consensus.cc:2272] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:48.600710 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f already in progress: creating tablet
I20260619 19:53:48.600903 1246 ts_tablet_manager.cc:1916] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.601390 902 tablet_service.cc:1558] Processing DeleteTablet for tablet a9c566903d9848f0bbe046793922b778 with delete_type TABLET_DATA_DELETED (replaced by tablet 732a2e073e3442ff873ca00be6106744) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:48.602448 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet a9c566903d9848f0bbe046793922b778 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9c566903d9848f0bbe046793922b778 already in progress: creating tablet
I20260619 19:53:48.601579 1201 tablet_bootstrap.cc:492] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:48.602862 1201 ts_tablet_manager.cc:1403] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260619 19:53:48.602550 604 catalog_manager.cc:5696] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:48.603087 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.603123 604 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_37b1b87772ac4a31bd31a3fefe92a515 [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 2 got 0
I20260619 19:53:48.603935 1201 raft_consensus.cc:359] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.604483 1201 raft_consensus.cc:385] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.604571 1201 raft_consensus.cc:740] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.604782 1201 consensus_queue.cc:260] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.605302 1201 ts_tablet_manager.cc:1434] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:48.605643 1201 tablet_bootstrap.cc:492] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.607493 1201 tablet_bootstrap.cc:654] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.610142 1246 ts_tablet_manager.cc:1929] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.610350 1246 log.cc:1199] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:48.610780 1246 ts_tablet_manager.cc:1950] T a93ce0dc0b034f7fa87f74768a0e5ba4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.610743 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet a9c566903d9848f0bbe046793922b778 with delete_type TABLET_DATA_DELETED (replaced by tablet 732a2e073e3442ff873ca00be6106744) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.612095 1246 tablet_replica.cc:333] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.612340 1246 raft_consensus.cc:2243] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.612660 1246 raft_consensus.cc:2272] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.613430 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet a93ce0dc0b034f7fa87f74768a0e5ba4 (table default.Table_cc82ca43b5cf464db8144b09e67a1b6a [id=4b2d780b8f1d4d8786bb33f2ec5ca8f4]) successfully deleted
I20260619 19:53:48.613498 1246 ts_tablet_manager.cc:1916] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.624092 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet f738fc8a167245c68181698f4b302176
I20260619 19:53:48.624390 1200 tablet_bootstrap.cc:492] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.624605 1200 ts_tablet_manager.cc:1403] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.121s user 0.006s sys 0.001s
I20260619 19:53:48.625377 595 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 4d261224bc3a410d9eff19ed33e0ff87
I20260619 19:53:48.625458 1200 raft_consensus.cc:359] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.625690 1200 raft_consensus.cc:385] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.625773 1200 raft_consensus.cc:740] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.626071 1200 consensus_queue.cc:260] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.626603 1200 ts_tablet_manager.cc:1434] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:48.627717 1200 tablet_bootstrap.cc:492] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.628443 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_817b3bf9ad474cde85f48e2be297f513"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.629238 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_817b3bf9ad474cde85f48e2be297f513 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.629516 1200 tablet_bootstrap.cc:654] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.630489 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet f738fc8a167245c68181698f4b302176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.631599 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_45d8ea035c104851b606129e67e9457d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.632325 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45d8ea035c104851b606129e67e9457d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.633994 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_0cac1e02d20c4acabf81c8732d374419"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.634701 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cac1e02d20c4acabf81c8732d374419 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.636865 765 tablet_service.cc:1558] Processing DeleteTablet for tablet f738fc8a167245c68181698f4b302176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.637396 902 tablet_service.cc:1558] Processing DeleteTablet for tablet f738fc8a167245c68181698f4b302176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:48.638110 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet f738fc8a167245c68181698f4b302176 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f738fc8a167245c68181698f4b302176 already in progress: creating tablet
I20260619 19:53:48.638298 1208 tablet_bootstrap.cc:492] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:48.638473 1208 ts_tablet_manager.cc:1403] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.001s
W20260619 19:53:48.644780 598 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48a58620df904c09b459d3f7ff72bcf8 consensus state has no leader
I20260619 19:53:48.649935 1200 tablet_bootstrap.cc:492] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.650103 1200 ts_tablet_manager.cc:1403] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.002s
I20260619 19:53:48.650595 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a0b6159b5d0240418352f236109b9a97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.650888 1200 raft_consensus.cc:359] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.651085 1200 raft_consensus.cc:385] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.651209 1200 raft_consensus.cc:740] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:53:48.651659 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0b6159b5d0240418352f236109b9a97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.652346 1246 ts_tablet_manager.cc:1929] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.652472 1246 log.cc:1199] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a9c566903d9848f0bbe046793922b778
I20260619 19:53:48.652547 1229 raft_consensus.cc:493] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.652849 1246 ts_tablet_manager.cc:1950] T a9c566903d9848f0bbe046793922b778 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.652747 1229 raft_consensus.cc:515] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.653518 603 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 5a21352877f94e508038c2c44617c4c7
I20260619 19:53:48.653627 1229 leader_election.cc:290] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.654027 603 catalog_manager.cc:6784] ReplaceTablet: tablet 5a21352877f94e508038c2c44617c4c7 deleted and replaced by tablet 76ffe451545c4af6821971384fce483e
I20260619 19:53:48.654692 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f738fc8a167245c68181698f4b302176" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:48.655210 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a21352877f94e508038c2c44617c4c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 76ffe451545c4af6821971384fce483e) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.655471 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a21352877f94e508038c2c44617c4c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 76ffe451545c4af6821971384fce483e) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.656081 603 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_452d096b92664c87ad0cecf5e611eab3" } modify_external_catalogs: true
I20260619 19:53:48.656150 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f738fc8a167245c68181698f4b302176" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.656292 603 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_452d096b92664c87ad0cecf5e611eab3" } modify_external_catalogs: true
I20260619 19:53:48.656342 1060 raft_consensus.cc:2468] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:48.656424 1200 consensus_queue.cc:260] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.656834 1246 tablet_replica.cc:333] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.657025 1246 raft_consensus.cc:2243] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.657027 720 leader_election.cc:304] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:48.657737 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a21352877f94e508038c2c44617c4c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 76ffe451545c4af6821971384fce483e) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.657796 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet a9c566903d9848f0bbe046793922b778 (table default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
I20260619 19:53:48.658049 1247 tablet_replica.cc:333] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:48.658313 1247 raft_consensus.cc:2243] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.658706 1247 raft_consensus.cc:2272] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.659669 1200 ts_tablet_manager.cc:1434] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260619 19:53:48.660184 1247 ts_tablet_manager.cc:1916] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.661046 1246 raft_consensus.cc:2272] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.662169 1246 ts_tablet_manager.cc:1916] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:48.663419 719 leader_election.cc:343] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:48.666965 1200 tablet_bootstrap.cc:492] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.666985 1229 raft_consensus.cc:2804] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:48.667130 1229 raft_consensus.cc:493] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:48.667296 1229 raft_consensus.cc:3060] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:48.668900 1200 tablet_bootstrap.cc:654] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.670339 1229 raft_consensus.cc:515] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.671870 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f738fc8a167245c68181698f4b302176" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:53:48.672573 719 leader_election.cc:343] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:48.672480 604 catalog_manager.cc:5696] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:48.672973 604 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:53:48.673286 604 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_fabb0cf46d644f83bda6327cea44f709 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 2 got 0
I20260619 19:53:48.674122 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_82746ee331ef4c06bf7f1f322bcf1e1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.674851 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82746ee331ef4c06bf7f1f322bcf1e1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.677987 1200 tablet_bootstrap.cc:492] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.678172 1200 ts_tablet_manager.cc:1403] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260619 19:53:48.679005 1200 raft_consensus.cc:359] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.679250 1200 raft_consensus.cc:385] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.679332 1200 raft_consensus.cc:740] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.679543 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet d4460c79a15140d5b643130f4e0329aa
I20260619 19:53:48.680164 602 catalog_manager.cc:6784] ReplaceTablet: tablet d4460c79a15140d5b643130f4e0329aa deleted and replaced by tablet 33de22a0f1124aeab663ea3b84bf106a
I20260619 19:53:48.682085 765 tablet_service.cc:1558] Processing DeleteTablet for tablet d4460c79a15140d5b643130f4e0329aa with delete_type TABLET_DATA_DELETED (replaced by tablet 33de22a0f1124aeab663ea3b84bf106a) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.682785 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_005692418b8045d0aeaf73e600c6307a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.683923 1270 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:53:48.684126 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_1a7e226979b44545bd46055537aabb9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.684875 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a7e226979b44545bd46055537aabb9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.689190 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet d4460c79a15140d5b643130f4e0329aa with delete_type TABLET_DATA_DELETED (replaced by tablet 33de22a0f1124aeab663ea3b84bf106a) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.689493 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b11228f4e7747619127ffbb99123e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.690167 1174 fs_manager.cc:730] Time spent opening block manager: real 0.101s user 0.011s sys 0.001s
I20260619 19:53:48.690395 900 tablet_service.cc:1558] Processing DeleteTablet for tablet d4460c79a15140d5b643130f4e0329aa with delete_type TABLET_DATA_DELETED (replaced by tablet 33de22a0f1124aeab663ea3b84bf106a) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.690416 1174 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
uuid: "031619d60e724837bd292c5ce23d0aff"
format_stamp: "Formatted at 2026-06-19 19:53:42 on dist-test-slave-wkdj"
I20260619 19:53:48.691573 1174 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260619 19:53:48.696676 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_005692418b8045d0aeaf73e600c6307a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.697855 1246 ts_tablet_manager.cc:1929] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.698020 1246 log.cc:1199] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f738fc8a167245c68181698f4b302176
I20260619 19:53:48.698122 603 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 81b5633849d146d388eec16f98375085
I20260619 19:53:48.698448 1246 ts_tablet_manager.cc:1950] T f738fc8a167245c68181698f4b302176 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.699330 1200 consensus_queue.cc:260] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.702181 1200 ts_tablet_manager.cc:1434] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.024s user 0.003s sys 0.000s
W20260619 19:53:48.702297 720 leader_election.cc:343] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f738fc8a167245c68181698f4b302176
I20260619 19:53:48.702527 1200 tablet_bootstrap.cc:492] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.702492 720 leader_election.cc:304] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:48.702834 1218 raft_consensus.cc:2749] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:53:48.703656 1229 leader_election.cc:290] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:48.705950 1208 raft_consensus.cc:359] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.706187 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.708611 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.709398 1208 raft_consensus.cc:385] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.709549 1208 raft_consensus.cc:740] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.711422 1208 consensus_queue.cc:260] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.715113 1200 tablet_bootstrap.cc:654] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.716432 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:48.716991 599 catalog_manager.cc:6784] ReplaceTablet: tablet 48a58620df904c09b459d3f7ff72bcf8 deleted and replaced by tablet 53ff57208565495480920b6eaaff9295
I20260619 19:53:48.719086 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ff57208565495480920b6eaaff9295) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.721223 1208 ts_tablet_manager.cc:1434] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
I20260619 19:53:48.723495 1246 tablet_replica.cc:333] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.723726 1246 raft_consensus.cc:2243] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:48.724227 1246 pending_rounds.cc:70] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:53:48.724426 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ff57208565495480920b6eaaff9295) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.724436 1246 pending_rounds.cc:77] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657601833181184 op_type: NO_OP noop_request { }
I20260619 19:53:48.724630 1246 raft_consensus.cc:2889] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:48.724764 1246 raft_consensus.cc:2272] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.725688 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f738fc8a167245c68181698f4b302176 (table default.Table_125f5c06b70f432981352415671f36a2 [id=cd3d8106476d40748b5940bfe4e46640]) successfully deleted
I20260619 19:53:48.726131 1208 tablet_bootstrap.cc:492] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:48.728205 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ff57208565495480920b6eaaff9295) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.729130 1200 tablet_bootstrap.cc:492] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.729293 1200 ts_tablet_manager.cc:1403] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260619 19:53:48.730122 1200 raft_consensus.cc:359] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.730337 1200 raft_consensus.cc:385] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.730438 1200 raft_consensus.cc:740] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.731586 1246 ts_tablet_manager.cc:1916] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.735285 1200 consensus_queue.cc:260] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.736881 1247 ts_tablet_manager.cc:1929] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.741725 1200 ts_tablet_manager.cc:1434] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260619 19:53:48.744241 1200 tablet_bootstrap.cc:492] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.735095 1208 tablet_bootstrap.cc:654] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.746275 1200 tablet_bootstrap.cc:654] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.749994 1060 raft_consensus.cc:1275] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:48.753192 1246 ts_tablet_manager.cc:1929] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:48.753365 1246 log.cc:1199] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/5a21352877f94e508038c2c44617c4c7
I20260619 19:53:48.753753 1246 ts_tablet_manager.cc:1950] T 5a21352877f94e508038c2c44617c4c7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.755219 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 5a21352877f94e508038c2c44617c4c7 (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]) successfully deleted
I20260619 19:53:48.756198 598 master_service.cc:960] ReplaceTablet: received request to replace tablet 5a21352877f94e508038c2c44617c4c7 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.757102 595 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet da8cc8a9266f43be995f7c4dcf2391f6 (table default.Table_4926348283cd417fb921ee6e4b4b58ea [id=a913d888b0ea4839847ecb8b6dafc17a]). Expected version 1 got 0
I20260619 19:53:48.758632 1038 tablet_service.cc:1511] Processing CreateTablet for tablet fce3bcb89e664d9f867eb53e144e3304 (DEFAULT_TABLE table=default.Table_672e6fc5aebe40efbc58e5631f43b344 [id=1f81b05e18de4ce08b8880942569bafa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.759071 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce3bcb89e664d9f867eb53e144e3304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.756160 900 tablet_service.cc:1511] Processing CreateTablet for tablet fce3bcb89e664d9f867eb53e144e3304 (DEFAULT_TABLE table=default.Table_672e6fc5aebe40efbc58e5631f43b344 [id=1f81b05e18de4ce08b8880942569bafa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.763556 899 tablet_service.cc:1511] Processing CreateTablet for tablet 79f909c3a4f24827867f9b2d0ded907e (DEFAULT_TABLE table=default.Table_879260ad54894aa5839b8cb3df8f3e56 [id=a8af5f54c3914c7a8ec2dbcd606c75c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.758836 903 tablet_service.cc:1511] Processing CreateTablet for tablet b6a468ca001340e98addf91dd3829efa (DEFAULT_TABLE table=default.Table_50bd6a1e0f134316821a2d86cf553679 [id=394d8c70bca54b0eb32990278e06cd91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.761238 901 tablet_service.cc:1511] Processing CreateTablet for tablet ac0d317731824eb7862630a08f9328b5 (DEFAULT_TABLE table=default.Table_b7a2a555121041ac8ae5440181d205da [id=47d4780785af4193b4ef32aa4b9c45f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.764040 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f909c3a4f24827867f9b2d0ded907e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.764375 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0d317731824eb7862630a08f9328b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.764585 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce3bcb89e664d9f867eb53e144e3304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.764825 1040 tablet_service.cc:1511] Processing CreateTablet for tablet b6a468ca001340e98addf91dd3829efa (DEFAULT_TABLE table=default.Table_50bd6a1e0f134316821a2d86cf553679 [id=394d8c70bca54b0eb32990278e06cd91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.765182 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a468ca001340e98addf91dd3829efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.767500 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a468ca001340e98addf91dd3829efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.767493 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ac0d317731824eb7862630a08f9328b5 (DEFAULT_TABLE table=default.Table_b7a2a555121041ac8ae5440181d205da [id=47d4780785af4193b4ef32aa4b9c45f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.767864 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0d317731824eb7862630a08f9328b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.771291 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.783947 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 79f909c3a4f24827867f9b2d0ded907e (DEFAULT_TABLE table=default.Table_879260ad54894aa5839b8cb3df8f3e56 [id=a8af5f54c3914c7a8ec2dbcd606c75c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.784503 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f909c3a4f24827867f9b2d0ded907e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.785270 899 tablet_service.cc:1511] Processing CreateTablet for tablet 24916ace14294b1ea8f713d3fc876d7a (DEFAULT_TABLE table=default.Table_795f746f2c61444fabf717551ba728e7 [id=49fc155330a542be88195064f2a6799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.785765 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24916ace14294b1ea8f713d3fc876d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.787858 1205 raft_consensus.cc:493] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.788015 1205 raft_consensus.cc:515] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.788697 1205 leader_election.cc:290] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:48.789403 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_c7454e0f284d4da3b90876e9c49da830"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.790047 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8cc8a9266f43be995f7c4dcf2391f6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:48.790625 996 leader_election.cc:343] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:48.792098 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_005692418b8045d0aeaf73e600c6307a" } new_table_name: "default.Table_43d3c7b37e664f8488c724a35db9191f" modify_external_catalogs: true
I20260619 19:53:48.792663 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a376ec2772bc4c7a8df567d4d24336d0" } new_table_name: "default.Table_625833f4158e43439f15da6d59ba1797" modify_external_catalogs: true
W20260619 19:53:48.796324 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7454e0f284d4da3b90876e9c49da830 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.796665 1246 tablet_replica.cc:333] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.797827 1246 raft_consensus.cc:2243] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.798054 1246 raft_consensus.cc:2272] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.798774 1246 ts_tablet_manager.cc:1916] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.800704 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_ecfc3772c4c647cebd6135fa76d00708"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.801795 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecfc3772c4c647cebd6135fa76d00708 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.802033 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_14a85cdb58a44fcc9de119384824ea63" } modify_external_catalogs: true
I20260619 19:53:48.804008 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_14a85cdb58a44fcc9de119384824ea63" } modify_external_catalogs: true
I20260619 19:53:48.802505 603 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_0cac1e02d20c4acabf81c8732d374419" } new_table_name: "default.Table_930b8d8f3db24be59f3041e10b229dab" modify_external_catalogs: true
I20260619 19:53:48.806236 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 24916ace14294b1ea8f713d3fc876d7a (DEFAULT_TABLE table=default.Table_795f746f2c61444fabf717551ba728e7 [id=49fc155330a542be88195064f2a6799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.806732 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24916ace14294b1ea8f713d3fc876d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.807492 595 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet da8cc8a9266f43be995f7c4dcf2391f6 (table default.Table_4926348283cd417fb921ee6e4b4b58ea [id=a913d888b0ea4839847ecb8b6dafc17a]). Expected version 1 got 0
I20260619 19:53:48.809482 595 master_service.cc:960] ReplaceTablet: received request to replace tablet 613372f5098b4c4fb69c4b88dd570f49 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:48.809609 601 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 24916ace14294b1ea8f713d3fc876d7a
I20260619 19:53:48.811921 921 raft_consensus.cc:1275] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:48.813697 1060 raft_consensus.cc:1275] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:48.815275 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 24916ace14294b1ea8f713d3fc876d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:48.815312 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 24916ace14294b1ea8f713d3fc876d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:48.815765 1247 log.cc:1199] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/5a21352877f94e508038c2c44617c4c7
I20260619 19:53:48.823526 1060 raft_consensus.cc:1275] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:48.823849 1247 ts_tablet_manager.cc:1950] T 5a21352877f94e508038c2c44617c4c7 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:48.824292 1235 consensus_queue.cc:1048] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:48.826722 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 5a21352877f94e508038c2c44617c4c7 (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]) successfully deleted
I20260619 19:53:48.827033 1247 tablet_replica.cc:333] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:48.827399 1247 raft_consensus.cc:2243] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.827696 1247 raft_consensus.cc:2272] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.829561 1247 ts_tablet_manager.cc:1916] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.830129 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_cb00e62460f64b88a7c695fbeb3b4164"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.830405 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 2d37d6f54a96471fad26a342cab984ef (DEFAULT_TABLE table=default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.830830 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d37d6f54a96471fad26a342cab984ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:48.830890 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb00e62460f64b88a7c695fbeb3b4164 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.832486 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2d37d6f54a96471fad26a342cab984ef (DEFAULT_TABLE table=default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.835811 1039 tablet_service.cc:1511] Processing CreateTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (DEFAULT_TABLE table=default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.836251 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c889f13fbe49c3aab1e7f0d0d08e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.836138 601 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_50bd6a1e0f134316821a2d86cf553679" } new_table_name: "default.Table_313c53f0872044b4a83cffd864500c94" modify_external_catalogs: true
I20260619 19:53:48.841320 1061 raft_consensus.cc:1275] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:48.834499 902 tablet_service.cc:1511] Processing CreateTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (DEFAULT_TABLE table=default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.835647 901 tablet_service.cc:1511] Processing CreateTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 (DEFAULT_TABLE table=default.Table_a376ec2772bc4c7a8df567d4d24336d0 [id=b0b1af506cad4219965fd83f04e7e5b5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:48.850312 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aca73f9ae5e94a29bdef0659082a2524 has no consensus state
I20260619 19:53:48.860713 598 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 33de22a0f1124aeab663ea3b84bf106a
I20260619 19:53:48.862250 1246 ts_tablet_manager.cc:1929] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:53:48.862483 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fbe3d9d2c43e4217b0429169ebfc3f43 consensus state has no leader
I20260619 19:53:48.863602 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_672e6fc5aebe40efbc58e5631f43b344" } modify_external_catalogs: true
I20260619 19:53:48.864005 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_672e6fc5aebe40efbc58e5631f43b344" } modify_external_catalogs: true
I20260619 19:53:48.870784 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a0b6159b5d0240418352f236109b9a97" } new_table_name: "default.Table_8d9081fd9aab4f63a536910bb1e71854" modify_external_catalogs: true
I20260619 19:53:48.870004 1039 tablet_service.cc:1511] Processing CreateTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 (DEFAULT_TABLE table=default.Table_625833f4158e43439f15da6d59ba1797 [id=b0b1af506cad4219965fd83f04e7e5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.872931 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe3d9d2c43e4217b0429169ebfc3f43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:48.875303 603 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33ee0b30259741cdb2fb0e3c815e6b17 has no consensus state
I20260619 19:53:48.878541 595 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7ffb8cd585bc42818dbf37ecbb2fd2c1" } modify_external_catalogs: true
I20260619 19:53:48.879638 1246 log.cc:1199] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d4460c79a15140d5b643130f4e0329aa
I20260619 19:53:48.880159 595 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7ffb8cd585bc42818dbf37ecbb2fd2c1" } modify_external_catalogs: true
I20260619 19:53:48.880266 1246 ts_tablet_manager.cc:1950] T d4460c79a15140d5b643130f4e0329aa P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:53:48.880247 590 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet fbe3d9d2c43e4217b0429169ebfc3f43 (table default.Table_625833f4158e43439f15da6d59ba1797 [id=b0b1af506cad4219965fd83f04e7e5b5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fbe3d9d2c43e4217b0429169ebfc3f43 consensus state has no leader
I20260619 19:53:48.881508 1246 tablet_replica.cc:333] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:48.881811 1246 raft_consensus.cc:2243] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.881855 900 tablet_service.cc:1511] Processing CreateTablet for tablet b0991def17b44b0d8e707d4deb64ecff (DEFAULT_TABLE table=default.Table_3ed147ad3dd54cac8d31e443a31ae944 [id=d08fd6bb08ae4025a6e554581238c7ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.882570 1246 raft_consensus.cc:2272] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.884120 1246 ts_tablet_manager.cc:1916] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:48.751919 1218 consensus_queue.cc:1048] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.133s
I20260619 19:53:48.759903 765 tablet_service.cc:1511] Processing CreateTablet for tablet b6a468ca001340e98addf91dd3829efa (DEFAULT_TABLE table=default.Table_50bd6a1e0f134316821a2d86cf553679 [id=394d8c70bca54b0eb32990278e06cd91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.885641 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a468ca001340e98addf91dd3829efa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:48.886404 720 consensus_peers.cc:597] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4460c79a15140d5b643130f4e0329aa. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:48.888396 756 tablet_service.cc:1511] Processing CreateTablet for tablet b0991def17b44b0d8e707d4deb64ecff (DEFAULT_TABLE table=default.Table_3ed147ad3dd54cac8d31e443a31ae944 [id=d08fd6bb08ae4025a6e554581238c7ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.889020 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0991def17b44b0d8e707d4deb64ecff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.762542 762 tablet_service.cc:1511] Processing CreateTablet for tablet ac0d317731824eb7862630a08f9328b5 (DEFAULT_TABLE table=default.Table_b7a2a555121041ac8ae5440181d205da [id=47d4780785af4193b4ef32aa4b9c45f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.891765 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0d317731824eb7862630a08f9328b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.895000 1287 tablet.cc:1724] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:53:48.781293 761 tablet_service.cc:1511] Processing CreateTablet for tablet 79f909c3a4f24827867f9b2d0ded907e (DEFAULT_TABLE table=default.Table_879260ad54894aa5839b8cb3df8f3e56 [id=a8af5f54c3914c7a8ec2dbcd606c75c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.791663 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8cc8a9266f43be995f7c4dcf2391f6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:48.811187 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 24916ace14294b1ea8f713d3fc876d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:48.895969 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f909c3a4f24827867f9b2d0ded907e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.814618 1245 consensus_queue.cc:1048] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.082s
I20260619 19:53:48.822481 784 raft_consensus.cc:1275] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:48.856462 1281 raft_consensus.cc:493] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:48.900739 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7445cb5764ce47bea7daf71732b440b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.901449 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7445cb5764ce47bea7daf71732b440b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.864503 757 tablet_service.cc:1511] Processing CreateTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 (DEFAULT_TABLE table=default.Table_a376ec2772bc4c7a8df567d4d24336d0 [id=b0b1af506cad4219965fd83f04e7e5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.904172 599 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_625833f4158e43439f15da6d59ba1797" } modify_external_catalogs: true
I20260619 19:53:48.904412 599 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_625833f4158e43439f15da6d59ba1797" } modify_external_catalogs: true
I20260619 19:53:48.904812 1206 consensus_queue.cc:1048] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:48.789526 760 tablet_service.cc:1511] Processing CreateTablet for tablet 24916ace14294b1ea8f713d3fc876d7a (DEFAULT_TABLE table=default.Table_795f746f2c61444fabf717551ba728e7 [id=49fc155330a542be88195064f2a6799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.757673 763 tablet_service.cc:1511] Processing CreateTablet for tablet fce3bcb89e664d9f867eb53e144e3304 (DEFAULT_TABLE table=default.Table_672e6fc5aebe40efbc58e5631f43b344 [id=1f81b05e18de4ce08b8880942569bafa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.747337 1248 ts_tablet_manager.cc:1929] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.910302 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f2f364500517462684d2b7900dd2a7f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.911469 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2f364500517462684d2b7900dd2a7f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.914986 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe3d9d2c43e4217b0429169ebfc3f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.812966 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2d37d6f54a96471fad26a342cab984ef (DEFAULT_TABLE table=default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.896775 1279 consensus_queue.cc:1048] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260619 19:53:48.931442 1039 tablet_service.cc:1511] Processing CreateTablet for tablet b0991def17b44b0d8e707d4deb64ecff (DEFAULT_TABLE table=default.Table_3ed147ad3dd54cac8d31e443a31ae944 [id=d08fd6bb08ae4025a6e554581238c7ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.932070 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0991def17b44b0d8e707d4deb64ecff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:48.828742 758 tablet_service.cc:1511] Processing CreateTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (DEFAULT_TABLE table=default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:48.855036 1285 consensus_queue.cc:1048] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.078s
I20260619 19:53:48.933750 1201 tablet_bootstrap.cc:492] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:48.933945 1201 ts_tablet_manager.cc:1403] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.328s user 0.063s sys 0.094s
I20260619 19:53:48.934808 1201 raft_consensus.cc:359] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.935052 1201 raft_consensus.cc:385] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.935170 1201 raft_consensus.cc:740] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.937991 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_863c40d4ebd846388b0f04695c7e577c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.938599 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_863c40d4ebd846388b0f04695c7e577c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.942080 1288 mvcc.cc:204] Tried to move back new op lower bound from 7298657602847170560 to 7298657601227644928. Current Snapshot: MvccSnapshot[applied={T|T < 7298657602847170560}]
I20260619 19:53:48.942966 1201 consensus_queue.cc:260] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.946419 1201 ts_tablet_manager.cc:1434] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20260619 19:53:48.952432 1200 tablet_bootstrap.cc:492] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.952986 1200 ts_tablet_manager.cc:1403] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.209s user 0.007s sys 0.022s
I20260619 19:53:48.954406 1200 raft_consensus.cc:359] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.954798 600 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_fabb0cf46d644f83bda6327cea44f709 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 2 got 0
I20260619 19:53:48.955766 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_dce4496fb23744cf8a0905a82523b5ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:48.956696 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dce4496fb23744cf8a0905a82523b5ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.956815 1200 raft_consensus.cc:385] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.956941 1200 raft_consensus.cc:740] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.957955 1200 consensus_queue.cc:260] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.958189 1201 tablet_bootstrap.cc:492] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.961061 1200 ts_tablet_manager.cc:1434] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
W20260619 19:53:48.962370 601 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6a468ca001340e98addf91dd3829efa consensus state has no leader
I20260619 19:53:48.963392 601 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet da8cc8a9266f43be995f7c4dcf2391f6 (table default.Table_4926348283cd417fb921ee6e4b4b58ea [id=a913d888b0ea4839847ecb8b6dafc17a]). Expected version 1 got 0
I20260619 19:53:48.968410 1201 tablet_bootstrap.cc:654] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.901620 1281 raft_consensus.cc:515] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.973491 1246 ts_tablet_manager.cc:1929] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:48.975078 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8cc8a9266f43be995f7c4dcf2391f6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:48.975689 1059 raft_consensus.cc:2468] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:48.977373 1200 tablet_bootstrap.cc:492] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:48.979534 1200 tablet_bootstrap.cc:654] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:48.980006 785 raft_consensus.cc:2468] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:48.978186 1246 log.cc:1199] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9b11228f4e7747619127ffbb99123e9f
I20260619 19:53:48.983888 1246 ts_tablet_manager.cc:1950] T 9b11228f4e7747619127ffbb99123e9f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:48.992197 1201 tablet_bootstrap.cc:492] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:48.992381 1201 ts_tablet_manager.cc:1403] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.000s
W20260619 19:53:48.992389 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 438ce37bb8ca4088b308a457b7f17041 has no consensus state
I20260619 19:53:48.992861 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_36823837347942e5b5cbe3975e6b0ce6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.993291 1201 raft_consensus.cc:359] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.993211 1246 tablet_replica.cc:333] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:53:48.993453 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36823837347942e5b5cbe3975e6b0ce6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:48.993495 1201 raft_consensus.cc:385] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:48.993587 1201 raft_consensus.cc:740] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:48.993968 1201 consensus_queue.cc:260] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:48.994534 1201 ts_tablet_manager.cc:1434] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:48.994875 1201 tablet_bootstrap.cc:492] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:48.994516 1246 raft_consensus.cc:2243] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:48.997396 1246 raft_consensus.cc:2272] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:48.997996 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_11047c3815d245e7aacd13536d8c6c26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:48.999380 1200 tablet_bootstrap.cc:492] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:48.999533 1200 ts_tablet_manager.cc:1403] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260619 19:53:49.000366 1200 raft_consensus.cc:359] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.000581 1200 raft_consensus.cc:385] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.000689 1200 raft_consensus.cc:740] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:53:49.001283 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11047c3815d245e7aacd13536d8c6c26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.001806 1246 ts_tablet_manager.cc:1916] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.005250 1200 consensus_queue.cc:260] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.007918 1200 ts_tablet_manager.cc:1434] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:53:49.008623 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:49.009990 1200 tablet_bootstrap.cc:492] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:49.011950 1200 tablet_bootstrap.cc:654] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.011929 899 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.016882 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet fce3bcb89e664d9f867eb53e144e3304
I20260619 19:53:49.018177 899 tablet_service.cc:1558] Processing DeleteTablet for tablet fce3bcb89e664d9f867eb53e144e3304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.018989 1206 raft_consensus.cc:493] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.019220 1206 raft_consensus.cc:515] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.020172 1206 leader_election.cc:290] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:49.020617 1246 ts_tablet_manager.cc:1929] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.020749 1246 log.cc:1199] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f0fc9c0f9ba246f6b650c22a90a5cc1f
W20260619 19:53:49.021504 859 leader_election.cc:343] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:49.021694 1246 ts_tablet_manager.cc:1950] T f0fc9c0f9ba246f6b650c22a90a5cc1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:49.022980 1246 tablet_replica.cc:333] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:49.023284 1246 raft_consensus.cc:2243] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.023613 1246 raft_consensus.cc:2272] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.024539 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.024801 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet fce3bcb89e664d9f867eb53e144e3304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.025202 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9b11228f4e7747619127ffbb99123e9f (table default.Table_b716080450d7415ebf6dfdc29033f87e [id=8ac1c025b7224f29a7967cd91efb3a95]) successfully deleted
I20260619 19:53:49.025528 1246 ts_tablet_manager.cc:1916] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.025853 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f0fc9c0f9ba246f6b650c22a90a5cc1f (table default.Table_b6822e2f028a4ee29e80309e9e006c0a [id=e2f073596be64b4c9e61b9a5f9962ef6]) successfully deleted
I20260619 19:53:49.031068 1174 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:53:49.032249 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_721d0ea740aa432590e6d491422cd791"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.033588 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_721d0ea740aa432590e6d491422cd791 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.033799 1174 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:53:49.037443 1174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:53:49.038290 899 tablet_service.cc:1558] Processing DeleteTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.045643 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_3ed147ad3dd54cac8d31e443a31ae944" } modify_external_catalogs: true
I20260619 19:53:49.045888 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_3ed147ad3dd54cac8d31e443a31ae944" } modify_external_catalogs: true
I20260619 19:53:49.056564 1246 ts_tablet_manager.cc:1929] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:53:49.056788 1246 log.cc:1199] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:49.057288 1246 ts_tablet_manager.cc:1950] T 48a58620df904c09b459d3f7ff72bcf8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:49.058703 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]) successfully deleted
I20260619 19:53:49.063195 1246 tablet_replica.cc:333] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:49.064606 1246 raft_consensus.cc:2243] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.065075 1246 raft_consensus.cc:2272] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.065868 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cb00e62460f64b88a7c695fbeb3b4164" } new_table_name: "default.Table_31acb6e850e140b09225f0905b1a5d8c" modify_external_catalogs: true
I20260619 19:53:49.066586 1246 ts_tablet_manager.cc:1916] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.068481 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_cec4cbfa30e74f7d99afd2b4683b3405"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:49.086628 1246 ts_tablet_manager.cc:1929] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.087555 1246 log.cc:1199] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/397b0ded7d5c4b5a98bb07dd6bfdc52f
I20260619 19:53:49.089625 1246 ts_tablet_manager.cc:1950] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:49.092190 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f (table default.Table_a2a19e703d7d4d918901e6f436214186 [id=71e32801a3984b37a60e1597394442e3]) successfully deleted
W20260619 19:53:49.093477 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 24916ace14294b1ea8f713d3fc876d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24916ace14294b1ea8f713d3fc876d7a already in progress: creating tablet
W20260619 19:53:49.094527 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fbe3d9d2c43e4217b0429169ebfc3f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbe3d9d2c43e4217b0429169ebfc3f43 already in progress: creating tablet
W20260619 19:53:49.095511 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fce3bcb89e664d9f867eb53e144e3304 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fce3bcb89e664d9f867eb53e144e3304 already in progress: creating tablet
I20260619 19:53:49.096702 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet b0991def17b44b0d8e707d4deb64ecff
I20260619 19:53:49.097782 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.098591 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.099427 765 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
W20260619 19:53:49.100775 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b0991def17b44b0d8e707d4deb64ecff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0991def17b44b0d8e707d4deb64ecff already in progress: creating tablet
W20260619 19:53:49.102674 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cec4cbfa30e74f7d99afd2b4683b3405 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.105871 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f2f364500517462684d2b7900dd2a7f1" } new_table_name: "default.Table_2e44172c64aa41b6aabeefb64c938a21" modify_external_catalogs: true
I20260619 19:53:49.107714 603 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_4926348283cd417fb921ee6e4b4b58ea" } modify_external_catalogs: true
I20260619 19:53:49.107997 603 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_4926348283cd417fb921ee6e4b4b58ea" } modify_external_catalogs: true
W20260619 19:53:49.112818 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d97025f1e0634720bc68d0a6196bd20b has no consensus state
W20260619 19:53:49.115345 719 consensus_peers.cc:597] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:53:49.115581 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 208878us
I20260619 19:53:49.117482 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93ce0dc0b034f7fa87f74768a0e5ba4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:49.117515 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8cc8a9266f43be995f7c4dcf2391f6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:49.117803 922 raft_consensus.cc:2468] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:49.118839 921 raft_consensus.cc:1275] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:49.119323 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce3bcb89e664d9f867eb53e144e3304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.119374 1281 leader_election.cc:290] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:49.119652 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24916ace14294b1ea8f713d3fc876d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.123507 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d37d6f54a96471fad26a342cab984ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:49.123479 858 leader_election.cc:343] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.123653 858 leader_election.cc:304] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:49.124570 1234 raft_consensus.cc:2749] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:49.129117 756 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:49.129490 720 leader_election.cc:304] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:49.129741 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 153417us
I20260619 19:53:49.130496 1281 raft_consensus.cc:2804] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:49.130625 1281 raft_consensus.cc:493] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:49.130715 1281 raft_consensus.cc:3060] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:49.132495 1287 tablet.cc:1724] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:49.132615 1280 mvcc.cc:204] Tried to move back new op lower bound from 7298657602764935168 to 7298657600686583808. Current Snapshot: MvccSnapshot[applied={T|T < 7298657602764935168}]
I20260619 19:53:49.133291 757 tablet_service.cc:1558] Processing DeleteTablet for tablet fce3bcb89e664d9f867eb53e144e3304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:49.143503 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c889f13fbe49c3aab1e7f0d0d08e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.165489 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d37d6f54a96471fad26a342cab984ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.171326 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0991def17b44b0d8e707d4deb64ecff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:49.174671 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a868706c23e948e5ba3320ceb4a19cf8 has no consensus state
I20260619 19:53:49.175345 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbe3d9d2c43e4217b0429169ebfc3f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.175472 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_817b3bf9ad474cde85f48e2be297f513" } new_table_name: "default.Table_8526777c611949f8bebf5e9bc5b28b6f" modify_external_catalogs: true
I20260619 19:53:49.179363 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c889f13fbe49c3aab1e7f0d0d08e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.189661 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_8103445a5e2e424a92b928a93c4b24df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.190915 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8103445a5e2e424a92b928a93c4b24df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.197747 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_556f20716eeb4ddb9f4f1adb0f0ef6c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.198590 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_556f20716eeb4ddb9f4f1adb0f0ef6c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:49.201155 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 73498.5us
I20260619 19:53:49.201725 1285 consensus_queue.cc:1048] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:49.209491 1201 tablet_bootstrap.cc:654] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.217625 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a58620df904c09b459d3f7ff72bcf8 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ff57208565495480920b6eaaff9295) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:49.218999 591 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 48a58620df904c09b459d3f7ff72bcf8 because the tablet was not found. No further retry: Not found: Tablet not found: 48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:49.209342 1286 tablet.cc:1724] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:53:49.219878 603 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet da8cc8a9266f43be995f7c4dcf2391f6
I20260619 19:53:49.221365 1205 raft_consensus.cc:493] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.221613 1205 raft_consensus.cc:515] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.222570 1205 leader_election.cc:290] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:49.223511 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet da8cc8a9266f43be995f7c4dcf2391f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.223858 1246 tablet_replica.cc:333] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:49.224130 1246 raft_consensus.cc:2243] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.224334 1246 raft_consensus.cc:2272] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.225128 1246 ts_tablet_manager.cc:1916] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.228595 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0d317731824eb7862630a08f9328b5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:49.229161 996 leader_election.cc:343] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.230320 569 master_runner.cc:187] Error getting master registration for 127.0.105.190:46791: Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111),
I20260619 19:53:49.230569 569 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 19:53:49.237743 1246 ts_tablet_manager.cc:1929] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.239681 1205 raft_consensus.cc:493] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.240010 1205 raft_consensus.cc:515] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.240682 1205 leader_election.cc:290] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:49.241636 1246 log.cc:1199] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/da8cc8a9266f43be995f7c4dcf2391f6
I20260619 19:53:49.242121 1246 ts_tablet_manager.cc:1950] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:49.242175 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613372f5098b4c4fb69c4b88dd570f49" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:49.242955 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet da8cc8a9266f43be995f7c4dcf2391f6 (table default.Table_4926348283cd417fb921ee6e4b4b58ea [id=a913d888b0ea4839847ecb8b6dafc17a]) successfully deleted
W20260619 19:53:49.244830 996 leader_election.cc:343] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.245384 1201 tablet_bootstrap.cc:492] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:49.245594 1201 ts_tablet_manager.cc:1403] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.251s user 0.004s sys 0.008s
I20260619 19:53:49.245831 1305 tablet.cc:1724] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:49.246470 1201 raft_consensus.cc:359] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.246688 1201 raft_consensus.cc:385] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.246785 1201 raft_consensus.cc:740] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.247052 1201 consensus_queue.cc:260] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.264420 1248 log.cc:1199] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/08c6a1313bb840908c49d14960be0fc8
I20260619 19:53:49.264957 1281 raft_consensus.cc:515] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.265873 1281 leader_election.cc:290] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:49.266477 1287 tablet.cc:1724] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:49.266719 1208 tablet_bootstrap.cc:492] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:49.266753 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8cc8a9266f43be995f7c4dcf2391f6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:49.267197 921 raft_consensus.cc:3060] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:49.279605 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7445cb5764ce47bea7daf71732b440b7" } modify_external_catalogs: true
I20260619 19:53:49.280040 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7445cb5764ce47bea7daf71732b440b7" } modify_external_catalogs: true
I20260619 19:53:49.279639 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_45d8ea035c104851b606129e67e9457d" } new_table_name: "default.Table_5a7d4266ae434f74a819ed18281e9d27" modify_external_catalogs: true
I20260619 19:53:49.279198 1201 ts_tablet_manager.cc:1434] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.033s user 0.004s sys 0.000s
I20260619 19:53:49.292126 595 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 090870b4159b4ee4bf8d93263bce244a
I20260619 19:53:49.302291 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_879260ad54894aa5839b8cb3df8f3e56" } modify_external_catalogs: true
I20260619 19:53:49.302533 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_879260ad54894aa5839b8cb3df8f3e56" } modify_external_catalogs: true
I20260619 19:53:49.302901 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_9b854aa69df5459692f816d4bdebc8cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:49.303676 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8d9081fd9aab4f63a536910bb1e71854" } new_table_name: "default.Table_cf444a19b16a4d57a7aba0f06a100642" modify_external_catalogs: true
W20260619 19:53:49.303951 859 consensus_peers.cc:597] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48a58620df904c09b459d3f7ff72bcf8. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:49.304306 1201 tablet_bootstrap.cc:492] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:49.304412 921 raft_consensus.cc:2468] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:49.311487 1247 ts_tablet_manager.cc:1929] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.311637 1247 log.cc:1199] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d4460c79a15140d5b643130f4e0329aa
I20260619 19:53:49.312048 1247 ts_tablet_manager.cc:1950] T d4460c79a15140d5b643130f4e0329aa P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:49.312723 601 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_fabb0cf46d644f83bda6327cea44f709 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 2 got 0
I20260619 19:53:49.314739 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_8e4651a9d7e04d9d8d1772515904d577"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.320506 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e4651a9d7e04d9d8d1772515904d577 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.322067 1201 tablet_bootstrap.cc:654] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.326788 1247 tablet_replica.cc:333] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
W20260619 19:53:49.328140 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70716f209500400cae29b20ee1cb4882 has no consensus state
I20260619 19:53:49.328140 598 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet b7845967337044e29219d12257d1abd0
I20260619 19:53:49.329157 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5fbfc5adf799430e85b4aa1130d23699"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:49.329761 602 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
W20260619 19:53:49.330201 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fbfc5adf799430e85b4aa1130d23699 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.337019 903 tablet_service.cc:1558] Processing DeleteTablet for tablet f738fc8a167245c68181698f4b302176 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.337852 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_b8b3924f19d84788a481e2980b4c7a24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.338475 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8b3924f19d84788a481e2980b4c7a24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:49.339905 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b854aa69df5459692f816d4bdebc8cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.346730 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6f48937efc8f41559b9dc1c81380c1cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.347754 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f48937efc8f41559b9dc1c81380c1cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.347836 1247 raft_consensus.cc:2243] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.350026 1247 raft_consensus.cc:2272] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:49.354013 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60324f7edaac45ed919be7e2368a4fd5 has no consensus state
I20260619 19:53:49.355636 1201 tablet_bootstrap.cc:492] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:49.356835 902 tablet_service.cc:1558] Processing DeleteTablet for tablet da8cc8a9266f43be995f7c4dcf2391f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.357515 1201 ts_tablet_manager.cc:1403] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.004s
I20260619 19:53:49.361239 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_46d92f291f484d6eb807a09bd023a3d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.362296 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46d92f291f484d6eb807a09bd023a3d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.366254 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.367286 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.375430 1200 tablet_bootstrap.cc:492] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:49.358501 1247 ts_tablet_manager.cc:1916] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.375814 1200 ts_tablet_manager.cc:1403] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.366s user 0.096s sys 0.131s
I20260619 19:53:49.377048 1200 raft_consensus.cc:359] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.377403 1200 raft_consensus.cc:385] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.377552 1200 raft_consensus.cc:740] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.380373 1200 consensus_queue.cc:260] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.381156 1200 ts_tablet_manager.cc:1434] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:49.381428 601 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cec4cbfa30e74f7d99afd2b4683b3405" } modify_external_catalogs: true
I20260619 19:53:49.381659 601 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cec4cbfa30e74f7d99afd2b4683b3405" } modify_external_catalogs: true
I20260619 19:53:49.381853 1200 tablet_bootstrap.cc:492] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:49.376679 498 master_runner.cc:187] Error getting master registration for 127.0.105.190:46791: Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111),
I20260619 19:53:49.382113 498 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 19:53:49.384171 1200 tablet_bootstrap.cc:654] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:49.385907 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 438ce37bb8ca4088b308a457b7f17041 has no consensus state
I20260619 19:53:49.386418 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_fabb0cf46d644f83bda6327cea44f709" } new_table_name: "default.Table_5023fdbc94ad42d1b931c6efb4e78679" modify_external_catalogs: true
I20260619 19:53:49.387544 1201 raft_consensus.cc:359] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.389307 1201 raft_consensus.cc:385] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.390167 1201 raft_consensus.cc:740] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.392060 1201 consensus_queue.cc:260] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.399406 1201 ts_tablet_manager.cc:1434] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.040s user 0.002s sys 0.001s
I20260619 19:53:49.403590 1201 tablet_bootstrap.cc:492] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:53:49.407934 720 leader_election.cc:343] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: da8cc8a9266f43be995f7c4dcf2391f6
W20260619 19:53:49.408205 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 137137us
I20260619 19:53:49.409000 719 leader_election.cc:304] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:49.409821 1281 raft_consensus.cc:2804] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:49.410006 1281 raft_consensus.cc:697] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:49.410398 1281 consensus_queue.cc:237] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.418859 1286 tablet.cc:1724] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:49.423741 1200 tablet_bootstrap.cc:492] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:49.424572 757 tablet_service.cc:1558] Processing DeleteTablet for tablet da8cc8a9266f43be995f7c4dcf2391f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:49.425647 1200 ts_tablet_manager.cc:1403] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.005s
I20260619 19:53:49.437165 1040 tablet_service.cc:1511] Processing CreateTablet for tablet aca73f9ae5e94a29bdef0659082a2524 (DEFAULT_TABLE table=default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.437721 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca73f9ae5e94a29bdef0659082a2524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.438482 603 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:53:49.439453 902 tablet_service.cc:1511] Processing CreateTablet for tablet aca73f9ae5e94a29bdef0659082a2524 (DEFAULT_TABLE table=default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.439949 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca73f9ae5e94a29bdef0659082a2524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.440224 903 tablet_service.cc:1511] Processing CreateTablet for tablet 438ce37bb8ca4088b308a457b7f17041 (DEFAULT_TABLE table=default.Table_cf444a19b16a4d57a7aba0f06a100642 [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.440595 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ce37bb8ca4088b308a457b7f17041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.441104 899 tablet_service.cc:1511] Processing CreateTablet for tablet 53ff57208565495480920b6eaaff9295 (DEFAULT_TABLE table=default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.441458 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ff57208565495480920b6eaaff9295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.442482 898 tablet_service.cc:1511] Processing CreateTablet for tablet 70716f209500400cae29b20ee1cb4882 (DEFAULT_TABLE table=default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.443176 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70716f209500400cae29b20ee1cb4882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.443463 900 tablet_service.cc:1511] Processing CreateTablet for tablet 131ccb73ea1f4a7b8781c093ea2995d1 (DEFAULT_TABLE table=default.Table_c7454e0f284d4da3b90876e9c49da830 [id=57752c885d2042b78c6e0645d119fadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.443826 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131ccb73ea1f4a7b8781c093ea2995d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.445679 896 tablet_service.cc:1511] Processing CreateTablet for tablet 732a2e073e3442ff873ca00be6106744 (DEFAULT_TABLE table=default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.446329 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732a2e073e3442ff873ca00be6106744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.446667 895 tablet_service.cc:1511] Processing CreateTablet for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (DEFAULT_TABLE table=default.Table_930b8d8f3db24be59f3041e10b229dab [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.447595 897 tablet_service.cc:1511] Processing CreateTablet for tablet da983715197847f18466d61f1eade0f5 (DEFAULT_TABLE table=default.Table_1a7e226979b44545bd46055537aabb9e [id=1ae529940a7b42fdbcdf75f668b99057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.448128 894 tablet_service.cc:1511] Processing CreateTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 (DEFAULT_TABLE table=default.Table_8526777c611949f8bebf5e9bc5b28b6f [id=de3457c27b2b4bdb8e37ac998bdcaeeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.450023 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 438ce37bb8ca4088b308a457b7f17041 (DEFAULT_TABLE table=default.Table_cf444a19b16a4d57a7aba0f06a100642 [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.450085 598 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7b0feea3bf1f421da67989a58048ae25" } new_table_name: "default.Table_f91630ed9b14431d9b472c3362f8cecf" modify_external_catalogs: true
I20260619 19:53:49.450467 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ce37bb8ca4088b308a457b7f17041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.451467 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 131ccb73ea1f4a7b8781c093ea2995d1 (DEFAULT_TABLE table=default.Table_c7454e0f284d4da3b90876e9c49da830 [id=57752c885d2042b78c6e0645d119fadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.451865 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131ccb73ea1f4a7b8781c093ea2995d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.455529 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 76ffe451545c4af6821971384fce483e (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.456030 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ffe451545c4af6821971384fce483e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.457629 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60324f7edaac45ed919be7e2368a4fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.457697 901 tablet_service.cc:1511] Processing CreateTablet for tablet 76ffe451545c4af6821971384fce483e (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.459770 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 53ff57208565495480920b6eaaff9295 (DEFAULT_TABLE table=default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.460433 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ff57208565495480920b6eaaff9295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.463722 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 70716f209500400cae29b20ee1cb4882 (DEFAULT_TABLE table=default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.464356 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70716f209500400cae29b20ee1cb4882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.465338 1208 ts_tablet_manager.cc:1403] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.541s user 0.005s sys 0.000s
I20260619 19:53:49.467600 1035 tablet_service.cc:1511] Processing CreateTablet for tablet da983715197847f18466d61f1eade0f5 (DEFAULT_TABLE table=default.Table_1a7e226979b44545bd46055537aabb9e [id=1ae529940a7b42fdbcdf75f668b99057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.468214 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da983715197847f18466d61f1eade0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.468506 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b11228f4e7747619127ffbb99123e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.471608 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 732a2e073e3442ff873ca00be6106744 (DEFAULT_TABLE table=default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.472544 1248 ts_tablet_manager.cc:1950] T 08c6a1313bb840908c49d14960be0fc8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:49.472666 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732a2e073e3442ff873ca00be6106744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.471853 893 tablet_service.cc:1511] Processing CreateTablet for tablet ea818ec12a3744f5b377a55f2693caed (DEFAULT_TABLE table=default.Table_82746ee331ef4c06bf7f1f322bcf1e1c [id=70e8c4fcd9c24e11af67b51e95c8434b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.473052 757 tablet_service.cc:1511] Processing CreateTablet for tablet aca73f9ae5e94a29bdef0659082a2524 (DEFAULT_TABLE table=default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.473490 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca73f9ae5e94a29bdef0659082a2524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.474745 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee0b30259741cdb2fb0e3c815e6b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.475529 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (DEFAULT_TABLE table=default.Table_930b8d8f3db24be59f3041e10b229dab [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.476038 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee0b30259741cdb2fb0e3c815e6b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.476536 756 tablet_service.cc:1511] Processing CreateTablet for tablet 438ce37bb8ca4088b308a457b7f17041 (DEFAULT_TABLE table=default.Table_cf444a19b16a4d57a7aba0f06a100642 [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.478052 764 tablet_service.cc:1511] Processing CreateTablet for tablet da983715197847f18466d61f1eade0f5 (DEFAULT_TABLE table=default.Table_1a7e226979b44545bd46055537aabb9e [id=1ae529940a7b42fdbcdf75f668b99057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.478200 762 tablet_service.cc:1511] Processing CreateTablet for tablet 76ffe451545c4af6821971384fce483e (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.481105 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da983715197847f18466d61f1eade0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.481702 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ea818ec12a3744f5b377a55f2693caed (DEFAULT_TABLE table=default.Table_82746ee331ef4c06bf7f1f322bcf1e1c [id=70e8c4fcd9c24e11af67b51e95c8434b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.482327 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea818ec12a3744f5b377a55f2693caed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.482353 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea818ec12a3744f5b377a55f2693caed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.484176 1201 tablet_bootstrap.cc:654] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.495088 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ffe451545c4af6821971384fce483e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.507958 1247 ts_tablet_manager.cc:1929] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.510558 1247 log.cc:1199] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9fc6f8eb2a04447c9a3aa1bb7d3e413a
I20260619 19:53:49.512575 1247 ts_tablet_manager.cc:1950] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:49.518525 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a (table default.Table_e06b0d031cdd4c02a09e69ce2f27a2de [id=d75cbf2f80d44ee5866d74eefe704686]) successfully deleted
I20260619 19:53:49.521423 1247 tablet_replica.cc:333] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:49.524920 1247 raft_consensus.cc:2243] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:49.528151 759 tablet_service.cc:1511] Processing CreateTablet for tablet 131ccb73ea1f4a7b8781c093ea2995d1 (DEFAULT_TABLE table=default.Table_c7454e0f284d4da3b90876e9c49da830 [id=57752c885d2042b78c6e0645d119fadb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.529213 1247 pending_rounds.cc:70] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:49.531658 1235 raft_consensus.cc:493] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.530164 1247 pending_rounds.cc:77] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7298657604796354560 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "48a58620df904c09b459d3f7ff72bcf8" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_d3b46da7823a441682cf7c3a4e321eed" dest_uuid: "95181cc281b946c8b81aa825232d9498" new_extra_config { } }
I20260619 19:53:49.534955 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 (DEFAULT_TABLE table=default.Table_8526777c611949f8bebf5e9bc5b28b6f [id=de3457c27b2b4bdb8e37ac998bdcaeeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.535576 1235 raft_consensus.cc:515] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.536856 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60324f7edaac45ed919be7e2368a4fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.537912 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 12) took 1165 ms. Trace:
W20260619 19:53:49.538374 1247 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32994: Aborted: Op aborted
W20260619 19:53:49.541080 590 catalog_manager.cc:5106] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): alter failed for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]): Aborted: Op aborted
I20260619 19:53:49.543643 1247 raft_consensus.cc:2272] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.550594 1235 leader_election.cc:290] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:49.551293 1288 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32994: Illegal state: RaftConsensus is not running: State = Stopped
W20260619 19:53:49.554126 859 leader_election.cc:343] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f738fc8a167245c68181698f4b302176
I20260619 19:53:49.555068 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_ed51a352570c4c8bbd0801643773aca8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.555755 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed51a352570c4c8bbd0801643773aca8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.565258 1247 ts_tablet_manager.cc:1916] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.569196 1208 raft_consensus.cc:359] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:49.569545 1282 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.549s user 0.003s sys 0.020s
W20260619 19:53:49.569670 1282 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.591s user 0.004s sys 0.021s
I20260619 19:53:49.570945 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_82746ee331ef4c06bf7f1f322bcf1e1c" } modify_external_catalogs: true
I20260619 19:53:49.571202 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_82746ee331ef4c06bf7f1f322bcf1e1c" } modify_external_catalogs: true
I20260619 19:53:49.577121 763 tablet_service.cc:1511] Processing CreateTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 (DEFAULT_TABLE table=default.Table_8526777c611949f8bebf5e9bc5b28b6f [id=de3457c27b2b4bdb8e37ac998bdcaeeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.587556 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f738fc8a167245c68181698f4b302176" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:49.590386 761 tablet_service.cc:1511] Processing CreateTablet for tablet 70716f209500400cae29b20ee1cb4882 (DEFAULT_TABLE table=default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.584103 1248 rpcz_store.cc:276] 0619 19:53:48.309236 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.309307 (+ 71us) service_pool.cc:224] Handling call
0619 19:53:48.595006 (+285699us) ts_tablet_manager.cc:1151] Deleting tablet 08c6a1313bb840908c49d14960be0fc8
0619 19:53:48.595016 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:48.637763 (+ 42747us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:48.747224 (+109461us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:49.474611 (+727387us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":285415}
I20260619 19:53:49.594722 1205 raft_consensus.cc:493] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.594794 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 08c6a1313bb840908c49d14960be0fc8 (table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]) successfully deleted
I20260619 19:53:49.594955 1205 raft_consensus.cc:515] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.595768 1205 leader_election.cc:290] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:49.596060 754 tablet_service.cc:1511] Processing CreateTablet for tablet 732a2e073e3442ff873ca00be6106744 (DEFAULT_TABLE table=default.Table_7b0feea3bf1f421da67989a58048ae25 [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.596444 765 tablet_service.cc:1511] Processing CreateTablet for tablet 53ff57208565495480920b6eaaff9295 (DEFAULT_TABLE table=default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.596989 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce3bcb89e664d9f867eb53e144e3304" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:49.597920 996 leader_election.cc:343] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.599584 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ce37bb8ca4088b308a457b7f17041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.601897 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 131ccb73ea1f4a7b8781c093ea2995d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.602855 1285 raft_consensus.cc:493] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.603091 1285 raft_consensus.cc:515] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.613472 1205 raft_consensus.cc:493] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.613704 1205 raft_consensus.cc:515] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.614614 1205 leader_election.cc:290] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:49.616041 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7400734402ca426aa34a3b7b482e59f1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:49.616442 1201 tablet_bootstrap.cc:492] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:53:49.617092 996 leader_election.cc:343] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.618758 1201 ts_tablet_manager.cc:1403] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.216s user 0.010s sys 0.010s
I20260619 19:53:49.597710 753 tablet_service.cc:1511] Processing CreateTablet for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (DEFAULT_TABLE table=default.Table_930b8d8f3db24be59f3041e10b229dab [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.622756 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ff57208565495480920b6eaaff9295. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:49.623440 755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s user 0.005s sys 0.021s
I20260619 19:53:49.623440 1285 leader_election.cc:290] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:49.624740 752 tablet_service.cc:1511] Processing CreateTablet for tablet ea818ec12a3744f5b377a55f2693caed (DEFAULT_TABLE table=default.Table_82746ee331ef4c06bf7f1f322bcf1e1c [id=70e8c4fcd9c24e11af67b51e95c8434b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.625208 784 raft_consensus.cc:2393] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:49.625327 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 13) took 1276 ms. Trace:
I20260619 19:53:49.625958 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70716f209500400cae29b20ee1cb4882. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:49.626669 755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s user 0.005s sys 0.022s
I20260619 19:53:49.628614 1248 rpcz_store.cc:276] 0619 19:53:48.318938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.320247 (+ 1309us) service_pool.cc:224] Handling call
0619 19:53:49.593832 (+1273585us) ts_tablet_manager.cc:1151] Deleting tablet f0fc9c0f9ba246f6b650c22a90a5cc1f
0619 19:53:49.593850 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:49.595557 (+ 1707us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273240}
W20260619 19:53:49.630306 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0fc9c0f9ba246f6b650c22a90a5cc1f already in progress: creating tablet
I20260619 19:53:49.632129 1201 raft_consensus.cc:359] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.633580 1201 raft_consensus.cc:385] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.634199 1201 raft_consensus.cc:740] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:53:49.634634 588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:46791, user_credentials={real_user=slave}} blocked reactor thread for 195773us
I20260619 19:53:49.636475 1201 consensus_queue.cc:260] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.641697 1201 ts_tablet_manager.cc:1434] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s
I20260619 19:53:49.644352 1201 tablet_bootstrap.cc:492] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:49.661633 1201 tablet_bootstrap.cc:654] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.565465 1200 raft_consensus.cc:359] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.664412 1200 raft_consensus.cc:385] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.664834 1200 raft_consensus.cc:740] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.665750 1200 consensus_queue.cc:260] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.666464 1247 ts_tablet_manager.cc:1929] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:53:49.667601 1247 log.cc:1199] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:49.670532 1247 ts_tablet_manager.cc:1950] T 48a58620df904c09b459d3f7ff72bcf8 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:49.675400 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]) successfully deleted
I20260619 19:53:49.675511 1208 raft_consensus.cc:385] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.675638 1208 raft_consensus.cc:740] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:53:49.677268 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 24916ace14294b1ea8f713d3fc876d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24916ace14294b1ea8f713d3fc876d7a already in progress: creating tablet
W20260619 19:53:49.678565 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet fbe3d9d2c43e4217b0429169ebfc3f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbe3d9d2c43e4217b0429169ebfc3f43 already in progress: creating tablet
W20260619 19:53:49.680368 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet fce3bcb89e664d9f867eb53e144e3304 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fce3bcb89e664d9f867eb53e144e3304 already in progress: creating tablet
I20260619 19:53:49.681859 1247 tablet_replica.cc:333] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:49.683529 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732a2e073e3442ff873ca00be6106744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.683804 1247 raft_consensus.cc:2243] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.685601 1247 raft_consensus.cc:2272] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.687264 1200 ts_tablet_manager.cc:1434] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.257s user 0.001s sys 0.004s
I20260619 19:53:49.690487 1247 ts_tablet_manager.cc:1916] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.691455 1208 consensus_queue.cc:260] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.676788 1296 tablet.cc:1724] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:53:49.697225 720 leader_election.cc:343] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9fc6f8eb2a04447c9a3aa1bb7d3e413a
W20260619 19:53:49.697573 717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s user 0.008s sys 0.039s
I20260619 19:53:49.698288 1208 ts_tablet_manager.cc:1434] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.229s user 0.001s sys 0.002s
W20260619 19:53:49.702179 717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s user 0.008s sys 0.039s
W20260619 19:53:49.702412 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 92154.3us
I20260619 19:53:49.702713 1248 tablet_replica.cc:333] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:49.702688 996 leader_election.cc:304] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
W20260619 19:53:49.702966 996 raft_consensus.cc:2686] T da8cc8a9266f43be995f7c4dcf2391f6 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:53:49.708948 1201 tablet_bootstrap.cc:492] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:49.709699 1201 ts_tablet_manager.cc:1403] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.066s user 0.011s sys 0.002s
W20260619 19:53:49.714685 719 leader_election.cc:343] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 9fc6f8eb2a04447c9a3aa1bb7d3e413a
I20260619 19:53:49.715189 719 leader_election.cc:304] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:49.721364 1247 ts_tablet_manager.cc:1929] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.722066 1247 log.cc:1199] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:49.720104 1201 raft_consensus.cc:359] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.724130 1247 ts_tablet_manager.cc:1950] T a93ce0dc0b034f7fa87f74768a0e5ba4 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:49.723580 1201 raft_consensus.cc:385] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.726985 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60324f7edaac45ed919be7e2368a4fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.725492 1201 raft_consensus.cc:740] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.729578 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet a93ce0dc0b034f7fa87f74768a0e5ba4 (table default.Table_cc82ca43b5cf464db8144b09e67a1b6a [id=4b2d780b8f1d4d8786bb33f2ec5ca8f4]) successfully deleted
W20260619 19:53:49.730767 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b0991def17b44b0d8e707d4deb64ecff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0991def17b44b0d8e707d4deb64ecff already in progress: creating tablet
I20260619 19:53:49.730820 1281 raft_consensus.cc:2749] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:49.731083 1247 tablet_replica.cc:333] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:49.731200 1208 tablet_bootstrap.cc:492] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:49.731285 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea818ec12a3744f5b377a55f2693caed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.732039 1247 raft_consensus.cc:2243] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.732868 1247 raft_consensus.cc:2272] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.735786 1247 ts_tablet_manager.cc:1916] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:49.737819 1160 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260619 19:53:49.738792 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8526777c611949f8bebf5e9bc5b28b6f" } modify_external_catalogs: true
I20260619 19:53:49.739077 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8526777c611949f8bebf5e9bc5b28b6f" } modify_external_catalogs: true
I20260619 19:53:49.732499 1201 consensus_queue.cc:260] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.734584 1310 tablet.cc:1724] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:49.744210 1248 raft_consensus.cc:2243] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:49.744977 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 109686us
I20260619 19:53:49.745656 858 leader_election.cc:304] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:49.745955 858 raft_consensus.cc:2686] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:53:49.752729 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da983715197847f18466d61f1eade0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.756127 1248 raft_consensus.cc:2272] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.757112 1201 ts_tablet_manager.cc:1434] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.044s user 0.005s sys 0.001s
I20260619 19:53:49.760965 1201 tablet_bootstrap.cc:492] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:49.764299 1248 ts_tablet_manager.cc:1916] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.766829 1208 tablet_bootstrap.cc:654] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.768968 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ee0b30259741cdb2fb0e3c815e6b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.769840 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ffe451545c4af6821971384fce483e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.769804 1247 ts_tablet_manager.cc:1929] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.770123 1247 log.cc:1199] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/f738fc8a167245c68181698f4b302176
I20260619 19:53:49.770800 1247 ts_tablet_manager.cc:1950] T f738fc8a167245c68181698f4b302176 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:49.774580 1247 tablet_replica.cc:333] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:49.774973 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet f738fc8a167245c68181698f4b302176 (table default.Table_125f5c06b70f432981352415671f36a2 [id=cd3d8106476d40748b5940bfe4e46640]) successfully deleted
I20260619 19:53:49.775677 1201 tablet_bootstrap.cc:654] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.774653 1200 tablet_bootstrap.cc:492] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:49.781613 1320 tablet.cc:1724] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:53:49.783658 1247 raft_consensus.cc:2243] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.784795 1247 raft_consensus.cc:2272] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.791644 1247 ts_tablet_manager.cc:1916] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.800176 1201 tablet_bootstrap.cc:492] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:49.800658 1201 ts_tablet_manager.cc:1403] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.000s
I20260619 19:53:49.803037 1201 raft_consensus.cc:359] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.803599 1201 raft_consensus.cc:385] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.803761 1201 raft_consensus.cc:740] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.804497 1201 consensus_queue.cc:260] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.805691 1201 ts_tablet_manager.cc:1434] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:49.806375 1201 tablet_bootstrap.cc:492] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:49.810498 1201 tablet_bootstrap.cc:654] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.810586 1235 raft_consensus.cc:493] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:49.810750 1235 raft_consensus.cc:515] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.811925 1235 leader_election.cc:290] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:49.812841 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7400734402ca426aa34a3b7b482e59f1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:49.813066 1061 raft_consensus.cc:2468] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:49.815232 859 leader_election.cc:304] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:49.815622 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7400734402ca426aa34a3b7b482e59f1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:49.816166 1235 raft_consensus.cc:2804] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:49.816299 1235 raft_consensus.cc:493] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:49.816450 1235 raft_consensus.cc:3060] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:49.816707 858 leader_election.cc:343] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.822129 1235 raft_consensus.cc:515] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.822577 1208 tablet_bootstrap.cc:492] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:49.822829 1208 ts_tablet_manager.cc:1403] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.124s user 0.003s sys 0.007s
I20260619 19:53:49.823685 1201 tablet_bootstrap.cc:492] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:49.823961 1235 leader_election.cc:290] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:49.824083 1201 ts_tablet_manager.cc:1403] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.000s
I20260619 19:53:49.824252 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7400734402ca426aa34a3b7b482e59f1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:49.824467 1061 raft_consensus.cc:3060] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:49.824369 1208 raft_consensus.cc:359] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.824571 1208 raft_consensus.cc:385] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.824877 1208 raft_consensus.cc:740] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.825683 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7400734402ca426aa34a3b7b482e59f1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:49.825976 1208 consensus_queue.cc:260] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.826337 1201 raft_consensus.cc:359] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.826824 1201 raft_consensus.cc:385] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.827044 1201 raft_consensus.cc:740] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.827205 1061 raft_consensus.cc:2468] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:49.827641 859 leader_election.cc:304] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:49.828048 1208 ts_tablet_manager.cc:1434] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:53:49.827687 1201 consensus_queue.cc:260] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.828402 1208 tablet_bootstrap.cc:492] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:49.829723 1235 raft_consensus.cc:2804] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:49.830878 1247 ts_tablet_manager.cc:1929] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.831028 1247 log.cc:1199] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/da8cc8a9266f43be995f7c4dcf2391f6
I20260619 19:53:49.835531 1235 raft_consensus.cc:697] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:49.835961 1235 consensus_queue.cc:237] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.836336 1200 tablet_bootstrap.cc:654] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.837080 1247 ts_tablet_manager.cc:1950] T da8cc8a9266f43be995f7c4dcf2391f6 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:49.840077 1247 tablet_replica.cc:333] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:49.840286 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet da8cc8a9266f43be995f7c4dcf2391f6 (table default.Table_4926348283cd417fb921ee6e4b4b58ea [id=a913d888b0ea4839847ecb8b6dafc17a]) successfully deleted
I20260619 19:53:49.840340 1247 raft_consensus.cc:2243] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.840510 1247 raft_consensus.cc:2272] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.841361 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0d317731824eb7862630a08f9328b5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:49.842695 996 leader_election.cc:343] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.842859 996 leader_election.cc:304] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:49.844849 785 raft_consensus.cc:3060] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:49.847232 1205 raft_consensus.cc:2749] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:49.848448 1201 ts_tablet_manager.cc:1434] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.024s user 0.009s sys 0.001s
I20260619 19:53:49.850142 1201 tablet_bootstrap.cc:492] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:49.853967 601 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet aad05fe62eae48439e6b8cc2460ebf53
I20260619 19:53:49.854460 1305 tablet.cc:1719] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:53:49.855967 601 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_930b8d8f3db24be59f3041e10b229dab" } new_table_name: "default.Table_a7d233d06c2e46f2b80d0fae2bd10906" modify_external_catalogs: true
I20260619 19:53:49.857148 599 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_11047c3815d245e7aacd13536d8c6c26" } modify_external_catalogs: true
I20260619 19:53:49.857461 599 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_11047c3815d245e7aacd13536d8c6c26" } modify_external_catalogs: true
I20260619 19:53:49.857048 1201 tablet_bootstrap.cc:654] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:49.858194 598 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 732a2e073e3442ff873ca00be6106744 consensus state has no leader
I20260619 19:53:49.858783 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 79f909c3a4f24827867f9b2d0ded907e
I20260619 19:53:49.858690 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a40ad9bc744448b78938f33623ed8d56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:49.859652 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_dce4496fb23744cf8a0905a82523b5ce" } new_table_name: "default.Table_3c367a8e42c347f890d88beca48e6c25" modify_external_catalogs: true
W20260619 19:53:49.859903 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a40ad9bc744448b78938f33623ed8d56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.862516 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f909c3a4f24827867f9b2d0ded907e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.862685 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f909c3a4f24827867f9b2d0ded907e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.863965 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a146cb8bcd694f8482d04dcd9b0ac13c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.864681 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a146cb8bcd694f8482d04dcd9b0ac13c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.867002 595 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60] alter complete (version 2)
I20260619 19:53:49.867724 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_9c718229c76b4c2794a9bd5d5a26fc86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:49.868147 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_1a7e226979b44545bd46055537aabb9e" } new_table_name: "default.Table_8ff8a1a8004546dfbfc8cc11e97729cc" modify_external_catalogs: true
W20260619 19:53:49.868346 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c718229c76b4c2794a9bd5d5a26fc86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.868505 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet ea818ec12a3744f5b377a55f2693caed
I20260619 19:53:49.869171 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 08c6a1313bb840908c49d14960be0fc8 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:49.869797 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 48a58620df904c09b459d3f7ff72bcf8 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:49.869832 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:49.872818 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.873072 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.875859 597 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:49.877453 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet fce3bcb89e664d9f867eb53e144e3304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:49.877635 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 48a58620df904c09b459d3f7ff72bcf8 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:49.878407 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 5a21352877f94e508038c2c44617c4c7 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:49.878944 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 48a58620df904c09b459d3f7ff72bcf8 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:49.878939 1201 tablet_bootstrap.cc:492] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:49.879388 1201 ts_tablet_manager.cc:1403] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.008s
I20260619 19:53:49.879788 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce3bcb89e664d9f867eb53e144e3304" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:49.881402 1247 ts_tablet_manager.cc:1916] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.881305 1201 raft_consensus.cc:359] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.881743 1201 raft_consensus.cc:385] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:49.881939 1201 raft_consensus.cc:740] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:49.882555 1201 consensus_queue.cc:260] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:49.883314 1296 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49744 (request call id 35) took 1065 ms. Trace:
W20260619 19:53:49.884251 996 leader_election.cc:343] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.884388 1201 ts_tablet_manager.cc:1434] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260619 19:53:49.884409 996 leader_election.cc:304] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:49.884824 1205 raft_consensus.cc:2749] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:49.886866 1201 tablet_bootstrap.cc:492] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:49.887768 1278 mvcc.cc:204] Tried to move back new op lower bound from 7298657602764935168 to 7298657600686583808. Current Snapshot: MvccSnapshot[applied={T|T < 7298657602764935168}]
W20260619 19:53:49.890539 588 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 438ce37bb8ca4088b308a457b7f17041 (table default.Table_cf444a19b16a4d57a7aba0f06a100642 [id=af4d9d7b334042f6be3ea00656ff2e3f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 438ce37bb8ca4088b308a457b7f17041 consensus state has no leader
I20260619 19:53:49.891259 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_d11dd25ca82141b79681a23f91d8fcb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.892102 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d11dd25ca82141b79681a23f91d8fcb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:49.895920 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 79f909c3a4f24827867f9b2d0ded907e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f909c3a4f24827867f9b2d0ded907e already in progress: creating tablet
W20260619 19:53:49.896200 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ea818ec12a3744f5b377a55f2693caed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea818ec12a3744f5b377a55f2693caed already in progress: creating tablet
I20260619 19:53:49.896261 1331 tablet_replica.cc:333] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:49.896459 1331 raft_consensus.cc:2243] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.896682 1331 raft_consensus.cc:2272] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.897529 1331 ts_tablet_manager.cc:1916] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.851330 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613372f5098b4c4fb69c4b88dd570f49" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:49.902194 1247 ts_tablet_manager.cc:1929] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.902634 1247 log.cc:1199] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9b11228f4e7747619127ffbb99123e9f
I20260619 19:53:49.889649 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7400734402ca426aa34a3b7b482e59f1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:49.904018 765 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:49.904230 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f909c3a4f24827867f9b2d0ded907e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:49.894431 1296 rpcz_store.cc:276] 0619 19:53:48.780304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.780391 (+ 87us) service_pool.cc:224] Handling call
0619 19:53:49.845785 (+1065394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:48.799886 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:48.800043 (+ 157us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:48.800053 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:48.800062 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:48.800118 (+ 56us) alter_schema_op.cc:128] START. Timestamp: 1781898828800033
0619 19:53:48.800122 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:53:48.800459 (+ 337us) log.cc:844] Serialized 173 byte log entry
0619 19:53:48.979022 (+178563us) op_driver.cc:464] REPLICATION: finished
0619 19:53:49.595256 (+616234us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:53:49.734762 (+139506us) log.cc:844] Serialized 5 byte log entry
0619 19:53:49.824703 (+ 89941us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:49.845540 (+ 20837us) log.cc:844] Serialized 14 byte log entry
0619 19:53:49.845623 (+ 83us) alter_schema_op.cc:73] Released schema lock
0619 19:53:49.845640 (+ 17us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":611027,"mutex_wait_us":9134,"prepare.queue_time_us":19044,"prepare.run_cpu_time_us":9898,"prepare.run_wall_time_us":26874,"raft.queue_time_us":9790,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":425,"replication_time_us":178747,"thread_start_us":627226,"threads_started":3}]]}
I20260619 19:53:49.907321 1296 tablet.cc:1719] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:53:49.909895 1247 ts_tablet_manager.cc:1950] T 9b11228f4e7747619127ffbb99123e9f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:53:49.911952 601 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33ee0b30259741cdb2fb0e3c815e6b17 consensus state has no leader
I20260619 19:53:49.912865 599 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 8728057968724d1a8caceab5225b0f7a
I20260619 19:53:49.913762 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9b11228f4e7747619127ffbb99123e9f (table default.Table_b716080450d7415ebf6dfdc29033f87e [id=8ac1c025b7224f29a7967cd91efb3a95]) successfully deleted
W20260619 19:53:49.914103 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 79f909c3a4f24827867f9b2d0ded907e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f909c3a4f24827867f9b2d0ded907e already in progress: creating tablet
W20260619 19:53:49.915377 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ea818ec12a3744f5b377a55f2693caed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea818ec12a3744f5b377a55f2693caed already in progress: creating tablet
W20260619 19:53:49.915782 996 leader_election.cc:343] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:49.915989 996 leader_election.cc:304] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:53:49.916260 996 raft_consensus.cc:2686] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:53:49.916618 996 leader_election.cc:304] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:49.917060 1205 raft_consensus.cc:2749] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:49.919764 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_bd91ffa78d684545901aef8dfba81532"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:49.920017 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_573c9bb6dffe4624b4281ba8299a28c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.920460 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd91ffa78d684545901aef8dfba81532 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:49.920677 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_573c9bb6dffe4624b4281ba8299a28c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.925691 1331 ts_tablet_manager.cc:1929] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.925698 1201 tablet_bootstrap.cc:654] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.929821 1310 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49744 (request call id 41) took 1102 ms. Trace:
I20260619 19:53:49.929772 1336 tablet.cc:1719] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:53:49.933571 1331 log.cc:1199] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:49.934208 1331 ts_tablet_manager.cc:1950] T 613372f5098b4c4fb69c4b88dd570f49 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:53:49.935189 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58e9d98ec1084b2ea9c087238686ed38 has no consensus state
W20260619 19:53:49.936506 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da983715197847f18466d61f1eade0f5 consensus state has no leader
I20260619 19:53:49.938112 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 613372f5098b4c4fb69c4b88dd570f49 (table default.Table_32f92f5c64464d989015e442afc82c76 [id=bb5f6f3462ca47d1a7cd4507fd093ac9]) successfully deleted
I20260619 19:53:49.939441 1331 tablet_replica.cc:333] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:49.940459 1331 raft_consensus.cc:2243] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:49.941109 1331 raft_consensus.cc:2272] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:49.942193 1331 ts_tablet_manager.cc:1916] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:49.951756 785 raft_consensus.cc:2468] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:49.930434 1310 rpcz_store.cc:276] 0619 19:53:48.827765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.827856 (+ 91us) service_pool.cc:224] Handling call
0619 19:53:49.929766 (+1101910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:48.828562 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:48.828643 (+ 81us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:48.828652 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:48.828660 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:48.828701 (+ 41us) alter_schema_op.cc:128] START. Timestamp: 1781898828828620
0619 19:53:48.828706 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 19:53:48.828904 (+ 198us) log.cc:844] Serialized 173 byte log entry
0619 19:53:48.935950 (+107046us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x6160001063b8. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d0eaf2f 00007eff4d0b8c3b 00007eff4d0c3bd1 00007eff4d0c38bd 0000000000aa681c 00007eff411809ff 00007eff41183d1b 00007eff41183b98 0000000000aa681c 00007eff4115ff48
0619 19:53:49.268198 (+332248us) op_driver.cc:464] REPLICATION: finished
0619 19:53:49.679663 (+411465us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:53:49.764659 (+ 84996us) log.cc:844] Serialized 5 byte log entry
0619 19:53:49.912655 (+147996us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:49.929651 (+ 16996us) log.cc:844] Serialized 14 byte log entry
0619 19:53:49.929702 (+ 51us) alter_schema_op.cc:73] Released schema lock
0619 19:53:49.929708 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":408656,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":8574,"prepare.run_wall_time_us":26543,"raft.queue_time_us":19674,"raft.run_cpu_time_us":2064,"raft.run_wall_time_us":95692,"replication_time_us":439453,"spinlock_wait_cycles":180748672,"thread_start_us":381338,"threads_started":3}]]}
I20260619 19:53:49.952888 1248 ts_tablet_manager.cc:1929] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.953056 1248 log.cc:1199] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9fc6f8eb2a04447c9a3aa1bb7d3e413a
I20260619 19:53:49.953132 1208 tablet_bootstrap.cc:654] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:49.955525 1248 ts_tablet_manager.cc:1950] T 9fc6f8eb2a04447c9a3aa1bb7d3e413a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:49.956391 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 14) took 1621 ms. Trace:
I20260619 19:53:49.961637 1305 tablet.cc:1719] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:53:49.965070 1248 rpcz_store.cc:276] 0619 19:53:48.334951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.335026 (+ 75us) service_pool.cc:224] Handling call
0619 19:53:49.630711 (+1295685us) ts_tablet_manager.cc:1151] Deleting tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a
0619 19:53:49.630727 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:49.883694 (+252967us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:49.948682 (+ 64988us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:49.956353 (+ 7671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38223,"tablet-delete.queue_time_us":1295330}
I20260619 19:53:49.965209 1310 tablet.cc:1724] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:53:49.965993 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9fc6f8eb2a04447c9a3aa1bb7d3e413a (table default.Table_e06b0d031cdd4c02a09e69ce2f27a2de [id=d75cbf2f80d44ee5866d74eefe704686]) successfully deleted
I20260619 19:53:49.969194 1336 tablet.cc:1724] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:53:49.972446 1200 tablet_bootstrap.cc:492] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:49.972723 1200 ts_tablet_manager.cc:1403] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.222s user 0.008s sys 0.000s
I20260619 19:53:49.973313 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_8874e3261467434cb5316f5024d06ce7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.974059 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8874e3261467434cb5316f5024d06ce7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.974104 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_42cd900805d040b9b7e27c6627dcc8d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:49.974603 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42cd900805d040b9b7e27c6627dcc8d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:49.976562 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 18) took 1582 ms. Trace:
I20260619 19:53:49.977571 1305 tablet.cc:1724] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:53:49.985422 603 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_5023fdbc94ad42d1b931c6efb4e78679 [id=48b2e4a0c57a49ba85be21c915aa9502]). Expected version 3 got 2
I20260619 19:53:49.985796 603 catalog_manager.cc:5696] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:49.987449 1248 rpcz_store.cc:276] 0619 19:53:48.393730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.393796 (+ 66us) service_pool.cc:224] Handling call
0619 19:53:49.965533 (+1571737us) ts_tablet_manager.cc:1151] Deleting tablet 9b11228f4e7747619127ffbb99123e9f
0619 19:53:49.965544 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:49.976509 (+ 10965us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1571406}
I20260619 19:53:49.988139 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 20) took 1563 ms. Trace:
I20260619 19:53:49.981276 1336 tablet.cc:1719] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:53:49.986616 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6baa466f30c2460697217f526fc4617f (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.989655 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baa466f30c2460697217f526fc4617f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:49.989842 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9b11228f4e7747619127ffbb99123e9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b11228f4e7747619127ffbb99123e9f already in progress: creating tablet
I20260619 19:53:49.990348 901 tablet_service.cc:1511] Processing CreateTablet for tablet 6baa466f30c2460697217f526fc4617f (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.990777 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baa466f30c2460697217f526fc4617f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.994761 898 tablet_service.cc:1511] Processing CreateTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 (DEFAULT_TABLE table=default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.995286 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e9d98ec1084b2ea9c087238686ed38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.995460 897 tablet_service.cc:1511] Processing CreateTablet for tablet a6b5f1da20614838aac1a0175ad4a67d (DEFAULT_TABLE table=default.Table_8e4651a9d7e04d9d8d1772515904d577 [id=ae897279d45c4caa8d2b55342f3f79f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.995877 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b5f1da20614838aac1a0175ad4a67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.987207 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 707af50da2ef469fb671df04cb72bb81 (DEFAULT_TABLE table=default.Table_556f20716eeb4ddb9f4f1adb0f0ef6c4 [id=288182d375434231a16e70f31f17f326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.996786 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707af50da2ef469fb671df04cb72bb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.998878 1331 ts_tablet_manager.cc:1929] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:49.999056 1331 log.cc:1199] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fce3bcb89e664d9f867eb53e144e3304
I20260619 19:53:49.999603 894 tablet_service.cc:1511] Processing CreateTablet for tablet 707af50da2ef469fb671df04cb72bb81 (DEFAULT_TABLE table=default.Table_556f20716eeb4ddb9f4f1adb0f0ef6c4 [id=288182d375434231a16e70f31f17f326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:49.999895 1331 ts_tablet_manager.cc:1950] T fce3bcb89e664d9f867eb53e144e3304 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:50.000134 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707af50da2ef469fb671df04cb72bb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.003504 896 tablet_service.cc:1511] Processing CreateTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a (DEFAULT_TABLE table=default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.003945 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd2fca96ee44cf297eb248b1f3ed00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:49.987264 1038 tablet_service.cc:1511] Processing CreateTablet for tablet a6b5f1da20614838aac1a0175ad4a67d (DEFAULT_TABLE table=default.Table_8e4651a9d7e04d9d8d1772515904d577 [id=ae897279d45c4caa8d2b55342f3f79f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.004535 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b5f1da20614838aac1a0175ad4a67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.005306 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fce3bcb89e664d9f867eb53e144e3304 (table default.Table_672e6fc5aebe40efbc58e5631f43b344 [id=1f81b05e18de4ce08b8880942569bafa]) successfully deleted
I20260619 19:53:50.005757 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a (DEFAULT_TABLE table=default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.005811 895 tablet_service.cc:1511] Processing CreateTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a (DEFAULT_TABLE table=default.Table_863c40d4ebd846388b0f04695c7e577c [id=c2b19d2a6fe34187866a4ad49b0533d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.006172 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd2fca96ee44cf297eb248b1f3ed00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.006223 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c0afdcf96247b0a16c8f9ac71cc24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.005774 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 (DEFAULT_TABLE table=default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.011694 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e9d98ec1084b2ea9c087238686ed38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.014674 902 tablet_service.cc:1511] Processing CreateTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 (DEFAULT_TABLE table=default.Table_2e44172c64aa41b6aabeefb64c938a21 [id=f0136eccfb674a15bb48064b19eef96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.014981 1333 tablet.cc:1719] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:53:50.015147 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a868706c23e948e5ba3320ceb4a19cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.015552 1041 tablet_service.cc:1511] Processing CreateTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a (DEFAULT_TABLE table=default.Table_863c40d4ebd846388b0f04695c7e577c [id=c2b19d2a6fe34187866a4ad49b0533d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.016039 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c0afdcf96247b0a16c8f9ac71cc24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.016129 1248 rpcz_store.cc:276] 0619 19:53:48.424808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.431219 (+ 6411us) service_pool.cc:224] Handling call
0619 19:53:49.987938 (+1556719us) ts_tablet_manager.cc:1151] Deleting tablet 613372f5098b4c4fb69c4b88dd570f49
0619 19:53:49.987951 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:49.988090 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1556372}
I20260619 19:53:50.018123 903 tablet_service.cc:1511] Processing CreateTablet for tablet d97025f1e0634720bc68d0a6196bd20b (DEFAULT_TABLE table=default.Table_31acb6e850e140b09225f0905b1a5d8c [id=d6c6c699115c4d7c8edbc8a1131ab5c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.018555 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97025f1e0634720bc68d0a6196bd20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.020648 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 (DEFAULT_TABLE table=default.Table_2e44172c64aa41b6aabeefb64c938a21 [id=f0136eccfb674a15bb48064b19eef96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.021118 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a868706c23e948e5ba3320ceb4a19cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.023080 893 tablet_service.cc:1511] Processing CreateTablet for tablet 69fa5d1df8d84fcd938349af6d2d0af0 (DEFAULT_TABLE table=default.Table_ecfc3772c4c647cebd6135fa76d00708 [id=3627a34f612c45a0abd812cc4e70a5ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.023564 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fa5d1df8d84fcd938349af6d2d0af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.023512 1200 raft_consensus.cc:359] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.023896 1200 raft_consensus.cc:385] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.024040 1200 raft_consensus.cc:740] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.024122 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d97025f1e0634720bc68d0a6196bd20b (DEFAULT_TABLE table=default.Table_31acb6e850e140b09225f0905b1a5d8c [id=d6c6c699115c4d7c8edbc8a1131ab5c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.024408 1200 consensus_queue.cc:260] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.025038 1200 ts_tablet_manager.cc:1434] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:53:50.025390 1200 tablet_bootstrap.cc:492] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:50.025678 588 consensus_peers.cc:597] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 -> Peer 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791): Couldn't send request to peer 031619d60e724837bd292c5ce23d0aff. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.190:46791: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260619 19:53:50.030853 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 68746ca7888e4af891238f79dcfdde10 (DEFAULT_TABLE table=default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.024597 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97025f1e0634720bc68d0a6196bd20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.023582 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 69fa5d1df8d84fcd938349af6d2d0af0 (DEFAULT_TABLE table=default.Table_ecfc3772c4c647cebd6135fa76d00708 [id=3627a34f612c45a0abd812cc4e70a5ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.034126 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68746ca7888e4af891238f79dcfdde10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.037469 754 tablet_service.cc:1511] Processing CreateTablet for tablet a6b5f1da20614838aac1a0175ad4a67d (DEFAULT_TABLE table=default.Table_8e4651a9d7e04d9d8d1772515904d577 [id=ae897279d45c4caa8d2b55342f3f79f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.038615 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b5f1da20614838aac1a0175ad4a67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.038558 762 tablet_service.cc:1511] Processing CreateTablet for tablet 6baa466f30c2460697217f526fc4617f (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.039472 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6baa466f30c2460697217f526fc4617f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.040158 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 24) took 1434 ms. Trace:
I20260619 19:53:50.041119 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 950b8e74d12f46a68ba5eae3186c87a9 (DEFAULT_TABLE table=default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.041553 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950b8e74d12f46a68ba5eae3186c87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.043113 753 tablet_service.cc:1511] Processing CreateTablet for tablet 707af50da2ef469fb671df04cb72bb81 (DEFAULT_TABLE table=default.Table_556f20716eeb4ddb9f4f1adb0f0ef6c4 [id=288182d375434231a16e70f31f17f326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.043569 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707af50da2ef469fb671df04cb72bb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.045754 597 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_5023fdbc94ad42d1b931c6efb4e78679 [id=48b2e4a0c57a49ba85be21c915aa9502] alter complete (version 3)
I20260619 19:53:50.041363 1248 rpcz_store.cc:276] 0619 19:53:48.585699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.598931 (+ 13232us) service_pool.cc:224] Handling call
0619 19:53:50.016472 (+1417541us) ts_tablet_manager.cc:1151] Deleting tablet a9c566903d9848f0bbe046793922b778
0619 19:53:50.016483 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.020386 (+ 3903us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1417290}
I20260619 19:53:50.051355 752 tablet_service.cc:1511] Processing CreateTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a (DEFAULT_TABLE table=default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.053243 763 tablet_service.cc:1511] Processing CreateTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 (DEFAULT_TABLE table=default.Table_2e44172c64aa41b6aabeefb64c938a21 [id=f0136eccfb674a15bb48064b19eef96e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.053898 756 tablet_service.cc:1511] Processing CreateTablet for tablet 68746ca7888e4af891238f79dcfdde10 (DEFAULT_TABLE table=default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.054426 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd2fca96ee44cf297eb248b1f3ed00a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:50.054705 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 613372f5098b4c4fb69c4b88dd570f49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613372f5098b4c4fb69c4b88dd570f49 already in progress: creating tablet
W20260619 19:53:50.055418 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a9c566903d9848f0bbe046793922b778 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9c566903d9848f0bbe046793922b778 already in progress: creating tablet
I20260619 19:53:50.055704 758 tablet_service.cc:1511] Processing CreateTablet for tablet 950b8e74d12f46a68ba5eae3186c87a9 (DEFAULT_TABLE table=default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.055702 900 tablet_service.cc:1511] Processing CreateTablet for tablet 950b8e74d12f46a68ba5eae3186c87a9 (DEFAULT_TABLE table=default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.056182 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950b8e74d12f46a68ba5eae3186c87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.057636 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fa5d1df8d84fcd938349af6d2d0af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.058053 765 tablet_service.cc:1511] Processing CreateTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 (DEFAULT_TABLE table=default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.058782 759 tablet_service.cc:1511] Processing CreateTablet for tablet d97025f1e0634720bc68d0a6196bd20b (DEFAULT_TABLE table=default.Table_31acb6e850e140b09225f0905b1a5d8c [id=d6c6c699115c4d7c8edbc8a1131ab5c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.059230 764 tablet_service.cc:1511] Processing CreateTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a (DEFAULT_TABLE table=default.Table_863c40d4ebd846388b0f04695c7e577c [id=c2b19d2a6fe34187866a4ad49b0533d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.060189 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 25) took 1462 ms. Trace:
I20260619 19:53:50.064095 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 60324f7edaac45ed919be7e2368a4fd5
I20260619 19:53:50.060974 1333 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49744 (request call id 45) took 1122 ms. Trace:
I20260619 19:53:50.080201 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a93ce0dc0b034f7fa87f74768a0e5ba4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.082721 761 tablet_service.cc:1511] Processing CreateTablet for tablet 69fa5d1df8d84fcd938349af6d2d0af0 (DEFAULT_TABLE table=default.Table_ecfc3772c4c647cebd6135fa76d00708 [id=3627a34f612c45a0abd812cc4e70a5ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.083407 1248 rpcz_store.cc:276] 0619 19:53:48.590152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.602991 (+ 12839us) service_pool.cc:224] Handling call
0619 19:53:50.049540 (+1446549us) ts_tablet_manager.cc:1151] Deleting tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f
0619 19:53:50.049550 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.053072 (+ 3522us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446317}
I20260619 19:53:50.083922 1248 tablet_replica.cc:333] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.084939 1248 raft_consensus.cc:2243] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.085167 1248 raft_consensus.cc:2272] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:50.086402 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f already in progress: creating tablet
I20260619 19:53:50.086750 1248 ts_tablet_manager.cc:1916] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.086902 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a868706c23e948e5ba3320ceb4a19cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.087468 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950b8e74d12f46a68ba5eae3186c87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.087469 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.088434 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97025f1e0634720bc68d0a6196bd20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.091481 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_d11dd25ca82141b79681a23f91d8fcb0" } modify_external_catalogs: true
I20260619 19:53:50.091722 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_d11dd25ca82141b79681a23f91d8fcb0" } modify_external_catalogs: true
I20260619 19:53:50.091796 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_556f20716eeb4ddb9f4f1adb0f0ef6c4" } new_table_name: "default.Table_a4356f4b40cc4a4b8fdae91a4e687529" modify_external_catalogs: true
I20260619 19:53:50.092358 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a7d233d06c2e46f2b80d0fae2bd10906" } new_table_name: "default.Table_3f9f0e46c5464e259bcede04d74cb03b" modify_external_catalogs: true
I20260619 19:53:50.094266 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9b854aa69df5459692f816d4bdebc8cf" } modify_external_catalogs: true
I20260619 19:53:50.094514 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9b854aa69df5459692f816d4bdebc8cf" } modify_external_catalogs: true
I20260619 19:53:50.096630 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_bcdf2efed44b46e299f362ce5be7e911"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.097620 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcdf2efed44b46e299f362ce5be7e911 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.097779 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68746ca7888e4af891238f79dcfdde10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.100443 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_51fd4ae0228a4f85a8c1850aa29b9f32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.101215 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51fd4ae0228a4f85a8c1850aa29b9f32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.046052 899 tablet_service.cc:1511] Processing CreateTablet for tablet 68746ca7888e4af891238f79dcfdde10 (DEFAULT_TABLE table=default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:50.105369 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33ee0b30259741cdb2fb0e3c815e6b17 consensus state has no leader
I20260619 19:53:50.105722 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.107609 1200 tablet_bootstrap.cc:654] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.107981 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f909c3a4f24827867f9b2d0ded907e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.108355 1331 tablet_replica.cc:333] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:50.108561 1331 raft_consensus.cc:2243] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.108758 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.108940 1331 raft_consensus.cc:2272] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:50.109524 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 707af50da2ef469fb671df04cb72bb81 consensus state has no leader
I20260619 19:53:50.111909 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68746ca7888e4af891238f79dcfdde10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.112752 1247 tablet_replica.cc:333] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.112982 1247 raft_consensus.cc:2243] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.114614 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.115563 1331 ts_tablet_manager.cc:1916] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.117812 1247 raft_consensus.cc:2272] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.121964 1247 ts_tablet_manager.cc:1916] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.123162 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e9d98ec1084b2ea9c087238686ed38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.124266 595 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a146cb8bcd694f8482d04dcd9b0ac13c" } modify_external_catalogs: true
I20260619 19:53:50.124475 595 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a146cb8bcd694f8482d04dcd9b0ac13c" } modify_external_catalogs: true
W20260619 19:53:50.128543 590 catalog_manager.cc:5100] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): alter failed for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]),no further retry: Not found: Tablet not found: 48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:50.130964 1331 ts_tablet_manager.cc:1929] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.131124 1331 log.cc:1199] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/79f909c3a4f24827867f9b2d0ded907e
I20260619 19:53:50.131592 1331 ts_tablet_manager.cc:1950] T 79f909c3a4f24827867f9b2d0ded907e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:50.132745 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 79f909c3a4f24827867f9b2d0ded907e (table default.Table_879260ad54894aa5839b8cb3df8f3e56 [id=a8af5f54c3914c7a8ec2dbcd606c75c3]) successfully deleted
W20260619 19:53:50.133631 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 60324f7edaac45ed919be7e2368a4fd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60324f7edaac45ed919be7e2368a4fd5 already in progress: creating tablet
I20260619 19:53:50.134567 1200 tablet_bootstrap.cc:492] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.135411 1200 ts_tablet_manager.cc:1403] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.110s user 0.004s sys 0.001s
I20260619 19:53:50.088438 1333 rpcz_store.cc:276] 0619 19:53:48.932372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.932429 (+ 57us) service_pool.cc:224] Handling call
0619 19:53:50.055094 (+1122665us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:49.586962 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:49.587442 (+ 480us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:49.929983 (+342541us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:49.929992 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:49.930662 (+ 670us) alter_schema_op.cc:128] START. Timestamp: 1781898829930624
0619 19:53:49.930679 (+ 17us) op_driver.cc:348] REPLICATION: starting
0619 19:53:49.952915 (+ 22236us) log.cc:844] Serialized 173 byte log entry
0619 19:53:49.957584 (+ 4669us) op_driver.cc:464] REPLICATION: finished
0619 19:53:49.977608 (+ 20024us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:53:50.055001 (+ 77393us) log.cc:844] Serialized 94 byte log entry
0619 19:53:50.055051 (+ 50us) alter_schema_op.cc:73] Released schema lock
0619 19:53:50.055056 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"prepare.queue_time_us":616490,"prepare.run_cpu_time_us":31844,"prepare.run_wall_time_us":366078,"raft.queue_time_us":2329,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":989,"replication_time_us":26864,"thread_start_us":656410,"threads_started":1}]]}
I20260619 19:53:50.137696 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a9c566903d9848f0bbe046793922b778 with delete_type TABLET_DATA_DELETED (replaced by tablet 732a2e073e3442ff873ca00be6106744) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.142109 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.144325 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.148500 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c0afdcf96247b0a16c8f9ac71cc24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.149005 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fa5d1df8d84fcd938349af6d2d0af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.156320 1200 raft_consensus.cc:359] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.161057 1200 raft_consensus.cc:385] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.161518 1200 raft_consensus.cc:740] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.162752 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b7a2a555121041ac8ae5440181d205da" } new_table_name: "default.Table_62fe6139c5d044fdbbb960537c4609d2" modify_external_catalogs: true
I20260619 19:53:50.164952 1200 consensus_queue.cc:260] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.169169 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_96219489afdb43b891399da04a6bba32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.169785 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96219489afdb43b891399da04a6bba32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.172943 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_06fee996690b44c3ad920d2090ceffa6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.173547 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06fee996690b44c3ad920d2090ceffa6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.175606 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_863c40d4ebd846388b0f04695c7e577c" } new_table_name: "default.Table_99ad65d8226647b3b0292bb08bff8e51" modify_external_catalogs: true
I20260619 19:53:50.179239 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_178fe18a009943389544ff741edba23c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.180469 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_178fe18a009943389544ff741edba23c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.183874 1200 ts_tablet_manager.cc:1434] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260619 19:53:50.184559 1200 tablet_bootstrap.cc:492] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.195206 1200 tablet_bootstrap.cc:654] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.195719 1283 raft_consensus.cc:493] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:50.196087 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac0d317731824eb7862630a08f9328b5 consensus state has no leader
I20260619 19:53:50.196673 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8ff8a1a8004546dfbfc8cc11e97729cc" } new_table_name: "default.Table_26bc6a5e8a714cc0a11c5ec477638d40" modify_external_catalogs: true
I20260619 19:53:50.202510 1283 raft_consensus.cc:515] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.209966 1283 leader_election.cc:290] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:50.213737 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5be814604c5549c786e2dfad1fd57cd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:50.213912 601 master_service.cc:960] ReplaceTablet: received request to replace tablet 24916ace14294b1ea8f713d3fc876d7a from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:50.214316 1247 ts_tablet_manager.cc:1929] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.214440 1247 log.cc:1199] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/f0fc9c0f9ba246f6b650c22a90a5cc1f
W20260619 19:53:50.214507 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5be814604c5549c786e2dfad1fd57cd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.215049 596 master_service.cc:960] ReplaceTablet: received request to replace tablet d4460c79a15140d5b643130f4e0329aa from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:50.215629 596 master_service.cc:960] ReplaceTablet: received request to replace tablet 70716f209500400cae29b20ee1cb4882 from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:50.216006 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2c0afdcf96247b0a16c8f9ac71cc24a consensus state has no leader
I20260619 19:53:50.216236 602 master_service.cc:960] ReplaceTablet: received request to replace tablet ac0d317731824eb7862630a08f9328b5 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:50.214511 601 master_service.cc:960] ReplaceTablet: received request to replace tablet 7400734402ca426aa34a3b7b482e59f1 from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:50.219383 719 leader_election.cc:343] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:50.215576 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9c718229c76b4c2794a9bd5d5a26fc86" } modify_external_catalogs: true
I20260619 19:53:50.223028 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9c718229c76b4c2794a9bd5d5a26fc86" } modify_external_catalogs: true
W20260619 19:53:50.224145 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da983715197847f18466d61f1eade0f5 consensus state has no leader
I20260619 19:53:50.225805 1201 tablet_bootstrap.cc:492] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.226020 1201 ts_tablet_manager.cc:1403] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.340s user 0.021s sys 0.037s
I20260619 19:53:50.229719 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_73c7fd0a90bd417bbeec5f8f4d751d91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.230321 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73c7fd0a90bd417bbeec5f8f4d751d91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.234905 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.235600 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.237250 1247 ts_tablet_manager.cc:1950] T f0fc9c0f9ba246f6b650c22a90a5cc1f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.238373 1247 tablet_replica.cc:333] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.238587 1247 raft_consensus.cc:2243] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.238768 1247 raft_consensus.cc:2272] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:50.243284 720 leader_election.cc:343] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:50.243630 720 leader_election.cc:304] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:50.244077 1283 raft_consensus.cc:2749] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.244566 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet f0fc9c0f9ba246f6b650c22a90a5cc1f (table default.Table_b6822e2f028a4ee29e80309e9e006c0a [id=e2f073596be64b4c9e61b9a5f9962ef6]) successfully deleted
I20260619 19:53:50.246264 1200 tablet_bootstrap.cc:492] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.246505 1200 ts_tablet_manager.cc:1403] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.001s
I20260619 19:53:50.246528 1201 raft_consensus.cc:359] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.247679 1200 raft_consensus.cc:359] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.247951 1200 raft_consensus.cc:385] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.248081 1200 raft_consensus.cc:740] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.247663 1201 raft_consensus.cc:385] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.248517 1200 consensus_queue.cc:260] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.250602 1201 raft_consensus.cc:740] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.251968 1200 ts_tablet_manager.cc:1434] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:50.251770 1201 consensus_queue.cc:260] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.255494 1200 tablet_bootstrap.cc:492] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.257436 1200 tablet_bootstrap.cc:654] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.264804 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_17ad83fba0994578904672a32ee809a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.265484 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17ad83fba0994578904672a32ee809a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.266669 1247 ts_tablet_manager.cc:1916] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.267935 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f909c3a4f24827867f9b2d0ded907e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.270833 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6c3576d46ff5459cb3023b3c949bbf59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.271575 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c3576d46ff5459cb3023b3c949bbf59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.275956 1248 ts_tablet_manager.cc:1929] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.278512 1248 log.cc:1199] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f738fc8a167245c68181698f4b302176
I20260619 19:53:50.278237 1201 ts_tablet_manager.cc:1434] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.052s user 0.001s sys 0.002s
I20260619 19:53:50.278942 1248 ts_tablet_manager.cc:1950] T f738fc8a167245c68181698f4b302176 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.279742 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 27) took 1643 ms. Trace:
I20260619 19:53:50.282984 1248 rpcz_store.cc:276] 0619 19:53:48.636708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.636773 (+ 65us) service_pool.cc:224] Handling call
0619 19:53:50.083830 (+1447057us) ts_tablet_manager.cc:1151] Deleting tablet f738fc8a167245c68181698f4b302176
0619 19:53:50.083847 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.248513 (+164666us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.275876 (+ 27363us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.279687 (+ 3811us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446796}
I20260619 19:53:50.283069 1201 tablet_bootstrap.cc:492] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.283540 1248 tablet_replica.cc:333] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.283740 1248 raft_consensus.cc:2243] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.283941 1248 raft_consensus.cc:2272] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.284824 1248 ts_tablet_manager.cc:1916] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.286087 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f738fc8a167245c68181698f4b302176 (table default.Table_125f5c06b70f432981352415671f36a2 [id=cd3d8106476d40748b5940bfe4e46640]) successfully deleted
I20260619 19:53:50.288693 1208 tablet_bootstrap.cc:492] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.288879 1208 ts_tablet_manager.cc:1403] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.461s user 0.022s sys 0.020s
I20260619 19:53:50.289641 1208 raft_consensus.cc:359] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.289870 1208 raft_consensus.cc:385] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.289970 1208 raft_consensus.cc:740] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.290251 1208 consensus_queue.cc:260] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.293036 1208 ts_tablet_manager.cc:1434] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:53:50.293581 1208 tablet_bootstrap.cc:492] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.296525 1208 tablet_bootstrap.cc:654] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.298591 599 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cce57077140d46f9a0edd649b40aee9b" } modify_external_catalogs: true
I20260619 19:53:50.298818 599 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cce57077140d46f9a0edd649b40aee9b" } modify_external_catalogs: true
I20260619 19:53:50.302259 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b11228f4e7747619127ffbb99123e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.313326 1208 tablet_bootstrap.cc:492] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.314603 1208 ts_tablet_manager.cc:1403] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.000s
I20260619 19:53:50.315958 1208 raft_consensus.cc:359] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.316303 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_99ad65d8226647b3b0292bb08bff8e51" } new_table_name: "default.Table_fee05dbe2f3d4261b61052c1fa5e39f0" modify_external_catalogs: true
I20260619 19:53:50.318320 1208 raft_consensus.cc:385] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.318658 1208 raft_consensus.cc:740] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.319229 1208 consensus_queue.cc:260] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.325254 1208 ts_tablet_manager.cc:1434] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:53:50.325515 1248 ts_tablet_manager.cc:1929] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.326424 1248 log.cc:1199] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/5a21352877f94e508038c2c44617c4c7
I20260619 19:53:50.328135 1248 ts_tablet_manager.cc:1950] T 5a21352877f94e508038c2c44617c4c7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:53:50.329077 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2c0afdcf96247b0a16c8f9ac71cc24a consensus state has no leader
I20260619 19:53:50.329643 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 28) took 1674 ms. Trace:
I20260619 19:53:50.329774 1248 rpcz_store.cc:276] 0619 19:53:48.655291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.655358 (+ 67us) service_pool.cc:224] Handling call
0619 19:53:50.283446 (+1628088us) ts_tablet_manager.cc:1151] Deleting tablet 5a21352877f94e508038c2c44617c4c7
0619 19:53:50.283456 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.297100 (+ 13644us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.325416 (+ 28316us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.329605 (+ 4189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1627849}
I20260619 19:53:50.330127 1248 tablet_replica.cc:333] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.330318 1248 raft_consensus.cc:2243] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:50.332209 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_bcdf2efed44b46e299f362ce5be7e911" } new_table_name: "default.Table_0ae7f23fb2aa479d927ee98adabfeeb4" modify_external_catalogs: true
I20260619 19:53:50.334954 1247 ts_tablet_manager.cc:1929] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.335117 1247 log.cc:1199] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/397b0ded7d5c4b5a98bb07dd6bfdc52f
I20260619 19:53:50.330813 1248 pending_rounds.cc:70] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 2 pending ops.
I20260619 19:53:50.336570 1201 tablet_bootstrap.cc:654] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.335374 1208 tablet_bootstrap.cc:492] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.336102 759 tablet_service.cc:1558] Processing DeleteTablet for tablet a9c566903d9848f0bbe046793922b778 with delete_type TABLET_DATA_DELETED (replaced by tablet 732a2e073e3442ff873ca00be6106744) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.339061 1208 tablet_bootstrap.cc:654] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.336802 1248 pending_rounds.cc:77] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7298657602509361152 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "d4460c79a15140d5b643130f4e0329aa" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_14a85cdb58a44fcc9de119384824ea63" dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" new_extra_config { } }
W20260619 19:53:50.341034 1248 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49744: Aborted: Op aborted
I20260619 19:53:50.340487 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 5a21352877f94e508038c2c44617c4c7 (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]) successfully deleted
I20260619 19:53:50.341758 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49744 (request call id 26) took 1723 ms. Trace:
I20260619 19:53:50.342260 1248 rpcz_store.cc:276] 0619 19:53:48.617866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.617926 (+ 60us) service_pool.cc:224] Handling call
0619 19:53:50.341681 (+1723755us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:48.737286 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:48.737540 (+ 254us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:48.737579 (+ 39us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:48.737630 (+ 51us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:48.737765 (+ 135us) alter_schema_op.cc:128] START. Timestamp: 1781898828737637
0619 19:53:48.737772 (+ 7us) op_driver.cc:348] REPLICATION: starting
0619 19:53:48.738179 (+ 407us) log.cc:844] Serialized 173 byte log entry
0619 19:53:48.899798 (+161619us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x6160001054b8. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d0eaf2f 00007eff4d0b8c3b 00007eff4d0c3bd1 00007eff4d0c38bd 0000000000aa681c 00007eff411809ff 00007eff41183d1b 00007eff41183b98 0000000000aa681c 00007eff4115ff48
0619 19:53:50.340917 (+1441119us) op_driver.cc:464] REPLICATION: finished
0619 19:53:50.340954 (+ 37us) op_driver.cc:389] HandleFailure(Aborted: Op aborted)
0619 19:53:50.340964 (+ 10us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":115699,"prepare.run_cpu_time_us":1248,"prepare.run_wall_time_us":80512,"raft.queue_time_us":46873,"raft.run_cpu_time_us":2521,"raft.run_wall_time_us":98682,"replication_time_us":1603067,"spinlock_wait_cycles":205525376,"thread_start_us":116015,"threads_started":1}]]}
I20260619 19:53:50.344579 1248 pending_rounds.cc:77] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657600702431232 op_type: NO_OP noop_request { }
I20260619 19:53:50.345299 1248 raft_consensus.cc:2889] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:50.345651 1248 raft_consensus.cc:2272] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:50.347239 1268 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49744: Illegal state: RaftConsensus is not running: State = Stopped
I20260619 19:53:50.345732 1208 tablet_bootstrap.cc:492] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.347582 1268 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49744 (request call id 29) took 1679 ms. Trace:
I20260619 19:53:50.348007 1208 ts_tablet_manager.cc:1403] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260619 19:53:50.348178 1268 rpcz_store.cc:276] 0619 19:53:48.667755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.667830 (+ 75us) service_pool.cc:224] Handling call
0619 19:53:50.347539 (+1679709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:48.816012 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:48.816134 (+ 122us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:50.344638 (+1528504us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:50.344653 (+ 15us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:50.344716 (+ 63us) alter_schema_op.cc:128] START. Timestamp: 1781898830344637
0619 19:53:50.344722 (+ 6us) op_driver.cc:348] REPLICATION: starting
0619 19:53:50.347100 (+ 2378us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x6160000e0854. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1b609b 00007eff4e597305 00007eff4e595e29 00007eff4e59e250 00007eff4e59e05d 0000000000aa681c 00007eff411809ff 00007eff41183d1b 00007eff41183b98 0000000000aa681c
0619 19:53:50.347120 (+ 20us) op_driver.cc:389] HandleFailure(Illegal state: RaftConsensus is not running: State = Stopped)
0619 19:53:50.347172 (+ 52us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":147679,"spinlock_wait_cycles":4988160}]]}
I20260619 19:53:50.349073 1208 raft_consensus.cc:359] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.350803 1208 raft_consensus.cc:385] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:53:50.349917 1268 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49744: Illegal state: RaftConsensus is not running: State = Stopped
I20260619 19:53:50.351255 1208 raft_consensus.cc:740] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.351589 1268 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49744 (request call id 48) took 1260 ms. Trace:
I20260619 19:53:50.352097 1208 consensus_queue.cc:260] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.352236 1268 rpcz_store.cc:276] 0619 19:53:49.090974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:49.091049 (+ 75us) service_pool.cc:224] Handling call
0619 19:53:50.351531 (+1260482us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:50.349207 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:50.349347 (+ 140us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:50.349751 (+ 404us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:50.349763 (+ 12us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:50.349816 (+ 53us) alter_schema_op.cc:128] START. Timestamp: 1781898830349742
0619 19:53:50.349821 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 19:53:50.349870 (+ 49us) op_driver.cc:389] HandleFailure(Illegal state: RaftConsensus is not running: State = Stopped)
0619 19:53:50.349879 (+ 9us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":1257627}]]}
I20260619 19:53:50.356703 1247 ts_tablet_manager.cc:1950] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.357098 1248 ts_tablet_manager.cc:1916] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.358119 1247 tablet_replica.cc:333] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.358322 1247 raft_consensus.cc:2243] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.359937 1247 raft_consensus.cc:2272] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.360548 1247 ts_tablet_manager.cc:1916] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.360561 1208 ts_tablet_manager.cc:1434] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
W20260619 19:53:50.360663 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32665a93ee5b4f8290c79e2a1d4b1db1 has no consensus state
I20260619 19:53:50.363317 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.364188 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.359098 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f (table default.Table_a2a19e703d7d4d918901e6f436214186 [id=71e32801a3984b37a60e1597394442e3]) successfully deleted
I20260619 19:53:50.372395 1208 tablet_bootstrap.cc:492] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.377220 603 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 2 got 0
I20260619 19:53:50.377748 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d29506dab4c84850ad79b8b7a0340987 (DEFAULT_TABLE table=default.Table_42cd900805d040b9b7e27c6627dcc8d9 [id=5962b400e8ef4a4a821a8f964c73d730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.378337 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29506dab4c84850ad79b8b7a0340987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.378490 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_00a59df924104cdfa0cb0b3e4b9fd93b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.379057 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00a59df924104cdfa0cb0b3e4b9fd93b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.379446 1208 tablet_bootstrap.cc:654] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.383381 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f0fc9c0f9ba246f6b650c22a90a5cc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.394670 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc (DEFAULT_TABLE table=default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.395313 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.400039 893 tablet_service.cc:1511] Processing CreateTablet for tablet d29506dab4c84850ad79b8b7a0340987 (DEFAULT_TABLE table=default.Table_42cd900805d040b9b7e27c6627dcc8d9 [id=5962b400e8ef4a4a821a8f964c73d730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.400579 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29506dab4c84850ad79b8b7a0340987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.401624 1247 ts_tablet_manager.cc:1929] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.402384 1247 log.cc:1199] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a9c566903d9848f0bbe046793922b778
I20260619 19:53:50.402818 1247 ts_tablet_manager.cc:1950] T a9c566903d9848f0bbe046793922b778 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.404106 1247 tablet_replica.cc:333] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.404361 1247 raft_consensus.cc:2243] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.404564 1247 raft_consensus.cc:2272] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.405818 1208 tablet_bootstrap.cc:492] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.407055 1208 ts_tablet_manager.cc:1403] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.000s
I20260619 19:53:50.410339 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_b8b3924f19d84788a481e2980b4c7a24" } new_table_name: "default.Table_e8a37cf077e54a94804ae31d3a54650d" modify_external_catalogs: true
I20260619 19:53:50.410746 1208 raft_consensus.cc:359] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.411053 1208 raft_consensus.cc:385] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.411228 1208 raft_consensus.cc:740] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.413113 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet a9c566903d9848f0bbe046793922b778 (table default.Table_f91630ed9b14431d9b472c3362f8cecf [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
W20260619 19:53:50.413674 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 60324f7edaac45ed919be7e2368a4fd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60324f7edaac45ed919be7e2368a4fd5 already in progress: creating tablet
I20260619 19:53:50.417663 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 304e1eed89f54b809ac52efe2226dc35 (DEFAULT_TABLE table=default.Table_bd91ffa78d684545901aef8dfba81532 [id=1da67532fe5b4fa4991586fa3f7c2dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.418188 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e1eed89f54b809ac52efe2226dc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.413391 759 tablet_service.cc:1511] Processing CreateTablet for tablet d29506dab4c84850ad79b8b7a0340987 (DEFAULT_TABLE table=default.Table_42cd900805d040b9b7e27c6627dcc8d9 [id=5962b400e8ef4a4a821a8f964c73d730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.419556 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29506dab4c84850ad79b8b7a0340987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.418327 764 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc (DEFAULT_TABLE table=default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.420168 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.423417 1200 tablet_bootstrap.cc:492] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.423669 1200 ts_tablet_manager.cc:1403] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.168s user 0.041s sys 0.063s
I20260619 19:53:50.424620 1200 raft_consensus.cc:359] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.424913 1200 raft_consensus.cc:385] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.425045 1200 raft_consensus.cc:740] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.425318 1200 consensus_queue.cc:260] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.427516 761 tablet_service.cc:1511] Processing CreateTablet for tablet 304e1eed89f54b809ac52efe2226dc35 (DEFAULT_TABLE table=default.Table_bd91ffa78d684545901aef8dfba81532 [id=1da67532fe5b4fa4991586fa3f7c2dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.427601 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:53:50.409332 1248 ts_tablet_manager.cc:1929] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:53:50.428001 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e1eed89f54b809ac52efe2226dc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.428082 1248 log.cc:1199] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d4460c79a15140d5b643130f4e0329aa
I20260619 19:53:50.428583 1200 ts_tablet_manager.cc:1434] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:50.428635 1248 ts_tablet_manager.cc:1950] T d4460c79a15140d5b643130f4e0329aa P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.428983 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 30) took 1747 ms. Trace:
I20260619 19:53:50.429555 1208 consensus_queue.cc:260] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.429925 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.431594 1205 raft_consensus.cc:493] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.431759 1205 raft_consensus.cc:515] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.434105 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.434919 1208 ts_tablet_manager.cc:1434] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.025s user 0.001s sys 0.002s
I20260619 19:53:50.436204 1205 leader_election.cc:290] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:50.436247 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_e015b3b2661b46f5a24476b50a6616b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.437289 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e015b3b2661b46f5a24476b50a6616b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.437268 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c889f13fbe49c3aab1e7f0d0d08e98" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:50.437655 591 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 4e2f73871161488dbad7a19fc9e20b9c because the tablet was not found. No further retry: Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:53:50.438086 1200 tablet_bootstrap.cc:492] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:50.438628 996 leader_election.cc:343] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.429101 1248 rpcz_store.cc:276] 0619 19:53:48.681443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.681975 (+ 532us) service_pool.cc:224] Handling call
0619 19:53:50.330050 (+1648075us) ts_tablet_manager.cc:1151] Deleting tablet d4460c79a15140d5b643130f4e0329aa
0619 19:53:50.330060 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.389556 (+ 59496us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.409150 (+ 19594us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.428940 (+ 19790us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1647775}
I20260619 19:53:50.440357 1208 tablet_bootstrap.cc:492] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.443811 1205 raft_consensus.cc:493] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.444065 1208 tablet_bootstrap.cc:654] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.444016 1205 raft_consensus.cc:515] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.444747 1205 leader_election.cc:290] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:50.445485 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a468ca001340e98addf91dd3829efa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:50.446053 1248 tablet_replica.cc:333] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:53:50.446084 996 leader_election.cc:343] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.446303 1248 raft_consensus.cc:2243] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.446521 1248 raft_consensus.cc:2272] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.446558 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 70716f209500400cae29b20ee1cb4882
I20260619 19:53:50.447762 1248 ts_tablet_manager.cc:1916] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.448136 1283 raft_consensus.cc:493] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.448421 1283 raft_consensus.cc:515] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.448544 596 catalog_manager.cc:6784] ReplaceTablet: tablet 70716f209500400cae29b20ee1cb4882 deleted and replaced by tablet d4771739543f4b4189b7d603f76325f0
I20260619 19:53:50.449110 1283 leader_election.cc:290] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:50.452231 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 24916ace14294b1ea8f713d3fc876d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.452696 1040 tablet_service.cc:1511] Processing CreateTablet for tablet fd9c959792fa48e89b669520f7332b26 (DEFAULT_TABLE table=default.Table_d11dd25ca82141b79681a23f91d8fcb0 [id=0cb3b7f319a34662a7b8c13ecc98d360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.452910 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 70716f209500400cae29b20ee1cb4882 with delete_type TABLET_DATA_DELETED (replaced by tablet d4771739543f4b4189b7d603f76325f0) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.453161 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9c959792fa48e89b669520f7332b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.425266 899 tablet_service.cc:1511] Processing CreateTablet for tablet 304e1eed89f54b809ac52efe2226dc35 (DEFAULT_TABLE table=default.Table_bd91ffa78d684545901aef8dfba81532 [id=1da67532fe5b4fa4991586fa3f7c2dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.455545 1331 tablet_replica.cc:333] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:50.455670 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e1eed89f54b809ac52efe2226dc35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.455762 1331 raft_consensus.cc:2243] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.455927 1331 raft_consensus.cc:2272] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.457046 1331 ts_tablet_manager.cc:1916] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.430886 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.437062 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c889f13fbe49c3aab1e7f0d0d08e98" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:50.445510 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a468ca001340e98addf91dd3829efa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:50.447679 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 70716f209500400cae29b20ee1cb4882 with delete_type TABLET_DATA_DELETED (replaced by tablet d4771739543f4b4189b7d603f76325f0) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.452096 902 tablet_service.cc:1511] Processing CreateTablet for tablet fd9c959792fa48e89b669520f7332b26 (DEFAULT_TABLE table=default.Table_d11dd25ca82141b79681a23f91d8fcb0 [id=0cb3b7f319a34662a7b8c13ecc98d360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.460376 900 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c (DEFAULT_TABLE table=default.Table_a146cb8bcd694f8482d04dcd9b0ac13c [id=f73253a802944e92a24b1e8bbe5a5231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.418327 893 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc (DEFAULT_TABLE table=default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.439636 1201 tablet_bootstrap.cc:492] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.460764 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9c959792fa48e89b669520f7332b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.451195 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613372f5098b4c4fb69c4b88dd570f49" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:50.460908 1201 ts_tablet_manager.cc:1403] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.179s user 0.002s sys 0.004s
I20260619 19:53:50.460687 759 tablet_service.cc:1511] Processing CreateTablet for tablet fd9c959792fa48e89b669520f7332b26 (DEFAULT_TABLE table=default.Table_d11dd25ca82141b79681a23f91d8fcb0 [id=0cb3b7f319a34662a7b8c13ecc98d360]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:50.461254 719 leader_election.cc:343] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:50.461274 996 leader_election.cc:343] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.461447 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9c959792fa48e89b669520f7332b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.461418 996 leader_election.cc:304] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:53:50.461844 996 leader_election.cc:343] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.461959 996 leader_election.cc:304] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:50.462361 1201 raft_consensus.cc:359] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.462566 1201 raft_consensus.cc:385] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.462658 1201 raft_consensus.cc:740] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.462936 1201 consensus_queue.cc:260] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.464763 1205 raft_consensus.cc:2749] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.464960 1205 raft_consensus.cc:2749] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.465715 1201 ts_tablet_manager.cc:1434] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:50.471644 601 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 7400734402ca426aa34a3b7b482e59f1
I20260619 19:53:50.471589 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c (DEFAULT_TABLE table=default.Table_a146cb8bcd694f8482d04dcd9b0ac13c [id=f73253a802944e92a24b1e8bbe5a5231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.472047 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2f73871161488dbad7a19fc9e20b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.472257 601 catalog_manager.cc:6784] ReplaceTablet: tablet 7400734402ca426aa34a3b7b482e59f1 deleted and replaced by tablet 5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:53:50.473076 761 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c (DEFAULT_TABLE table=default.Table_a146cb8bcd694f8482d04dcd9b0ac13c [id=f73253a802944e92a24b1e8bbe5a5231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.473536 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2f73871161488dbad7a19fc9e20b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.474037 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_e628fda622264f3eb2fdbfbffbf213cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.474653 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e628fda622264f3eb2fdbfbffbf213cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.475427 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet ac0d317731824eb7862630a08f9328b5
I20260619 19:53:50.476054 602 catalog_manager.cc:6784] ReplaceTablet: tablet ac0d317731824eb7862630a08f9328b5 deleted and replaced by tablet fcaeebaaa93c479bafff14d312d526ec
I20260619 19:53:50.405201 1247 ts_tablet_manager.cc:1916] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.477972 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_768b98dd2476482fafa6579ecca2a1b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.478531 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768b98dd2476482fafa6579ecca2a1b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:50.479857 720 leader_election.cc:343] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:50.480020 720 leader_election.cc:304] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:50.480506 1283 raft_consensus.cc:2749] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.482189 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 7400734402ca426aa34a3b7b482e59f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ea9f17d5e75499a8433fc9a3043a88e) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.482455 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet ac0d317731824eb7862630a08f9328b5 with delete_type TABLET_DATA_DELETED (replaced by tablet fcaeebaaa93c479bafff14d312d526ec) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.483283 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 70716f209500400cae29b20ee1cb4882 with delete_type TABLET_DATA_DELETED (replaced by tablet d4771739543f4b4189b7d603f76325f0) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.487735 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7400734402ca426aa34a3b7b482e59f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ea9f17d5e75499a8433fc9a3043a88e) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.488153 901 tablet_service.cc:1558] Processing DeleteTablet for tablet fce3bcb89e664d9f867eb53e144e3304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.489039 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ac0d317731824eb7862630a08f9328b5 with delete_type TABLET_DATA_DELETED (replaced by tablet fcaeebaaa93c479bafff14d312d526ec) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.489708 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ac0d317731824eb7862630a08f9328b5 with delete_type TABLET_DATA_DELETED (replaced by tablet fcaeebaaa93c479bafff14d312d526ec) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.489812 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 613372f5098b4c4fb69c4b88dd570f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.491322 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7400734402ca426aa34a3b7b482e59f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ea9f17d5e75499a8433fc9a3043a88e) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.496249 903 tablet_service.cc:1511] Processing CreateTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee (DEFAULT_TABLE table=default.Table_8874e3261467434cb5316f5024d06ce7 [id=6acfde9eb89943c9b83cf58165e83ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.493893 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee (DEFAULT_TABLE table=default.Table_8874e3261467434cb5316f5024d06ce7 [id=6acfde9eb89943c9b83cf58165e83ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.497738 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f25c0378a6f4e9ea1a62d98f27778ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.498893 1248 ts_tablet_manager.cc:1929] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:53:50.499035 1248 log.cc:1199] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:50.499977 1248 ts_tablet_manager.cc:1950] T 48a58620df904c09b459d3f7ff72bcf8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.501129 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f25c0378a6f4e9ea1a62d98f27778ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.502862 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 9b08ab9ad59049919649b96890b6785d
I20260619 19:53:50.504506 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_42cd900805d040b9b7e27c6627dcc8d9" } new_table_name: "default.Table_2b48c7db31f34a0a84074efaf7f997a3" modify_external_catalogs: true
I20260619 19:53:50.505522 598 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8e4651a9d7e04d9d8d1772515904d577" } new_table_name: "default.Table_a3aea512fc0e4621ae8d112053e1e4b8" modify_external_catalogs: true
I20260619 19:53:50.506474 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 31) took 1782 ms. Trace:
I20260619 19:53:50.506606 1248 rpcz_store.cc:276] 0619 19:53:48.724248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.724318 (+ 70us) service_pool.cc:224] Handling call
0619 19:53:50.440145 (+1715827us) ts_tablet_manager.cc:1151] Deleting tablet 48a58620df904c09b459d3f7ff72bcf8
0619 19:53:50.445974 (+ 5829us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.456274 (+ 10300us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.498791 (+ 42517us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.506398 (+ 7607us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715585}
I20260619 19:53:50.512518 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 (DEFAULT_TABLE table=default.Table_a40ad9bc744448b78938f33623ed8d56 [id=f848b07a0fe748fe9168a487db41e041]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.513026 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0fe0c67fe84e5b866fd2553ea26d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.514169 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 38) took 1703 ms. Trace:
I20260619 19:53:50.514273 1248 rpcz_store.cc:276] 0619 19:53:48.810929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:48.811052 (+ 123us) service_pool.cc:224] Handling call
0619 19:53:50.513956 (+1702904us) ts_tablet_manager.cc:1151] Deleting tablet 24916ace14294b1ea8f713d3fc876d7a
0619 19:53:50.513968 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.514105 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617938}
I20260619 19:53:50.515636 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 49) took 1416 ms. Trace:
I20260619 19:53:50.519482 1248 rpcz_store.cc:276] 0619 19:53:49.099213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:49.099298 (+ 85us) service_pool.cc:224] Handling call
0619 19:53:50.515460 (+1416162us) ts_tablet_manager.cc:1151] Deleting tablet b0991def17b44b0d8e707d4deb64ecff
0619 19:53:50.515471 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.515576 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415874}
I20260619 19:53:50.521240 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 46) took 1511 ms. Trace:
I20260619 19:53:50.524008 1248 rpcz_store.cc:276] 0619 19:53:49.009823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:49.013255 (+ 3432us) service_pool.cc:224] Handling call
0619 19:53:50.520854 (+1507599us) ts_tablet_manager.cc:1151] Deleting tablet fbe3d9d2c43e4217b0429169ebfc3f43
0619 19:53:50.520875 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.521119 (+ 244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1391461}
I20260619 19:53:50.523049 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.525468 1201 tablet_bootstrap.cc:492] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.525669 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:50.527854 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 63456.7us
I20260619 19:53:50.528846 1331 ts_tablet_manager.cc:1929] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.528980 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 47) took 1510 ms. Trace:
I20260619 19:53:50.529111 604 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 9c379d780b294b9a863576f53f79ee7b
I20260619 19:53:50.529233 1331 log.cc:1199] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/24916ace14294b1ea8f713d3fc876d7a
I20260619 19:53:50.529197 1248 rpcz_store.cc:276] 0619 19:53:49.018129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:49.018221 (+ 92us) service_pool.cc:224] Handling call
0619 19:53:50.528726 (+1510505us) ts_tablet_manager.cc:1151] Deleting tablet fce3bcb89e664d9f867eb53e144e3304
0619 19:53:50.528742 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.528912 (+ 170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395149}
I20260619 19:53:50.529572 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.530692 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2f73871161488dbad7a19fc9e20b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.531970 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_35a806d3e4164ed4855c53a228466cc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:50.532263 1331 ts_tablet_manager.cc:1950] T 24916ace14294b1ea8f713d3fc876d7a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:53:50.532645 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35a806d3e4164ed4855c53a228466cc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.535337 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c379d780b294b9a863576f53f79ee7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.536036 1248 tablet_replica.cc:333] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.536273 1248 raft_consensus.cc:2243] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:50.536513 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]) successfully deleted
I20260619 19:53:50.536588 1248 pending_rounds.cc:70] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:53:50.536679 1248 pending_rounds.cc:77] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657605274451968 op_type: NO_OP noop_request { }
I20260619 19:53:50.536846 1248 raft_consensus.cc:2889] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:50.536963 1248 raft_consensus.cc:2272] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.540203 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.540611 1201 tablet_bootstrap.cc:654] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.541337 1200 tablet_bootstrap.cc:700] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Time spent opening tablet: real 0.101s user 0.001s sys 0.000s
W20260619 19:53:50.541426 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 24916ace14294b1ea8f713d3fc876d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24916ace14294b1ea8f713d3fc876d7a already in progress: creating tablet
I20260619 19:53:50.541723 1200 tablet_bootstrap.cc:654] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:50.542343 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b0991def17b44b0d8e707d4deb64ecff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0991def17b44b0d8e707d4deb64ecff already in progress: creating tablet
I20260619 19:53:50.543699 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f (DEFAULT_TABLE table=default.Table_ed51a352570c4c8bbd0801643773aca8 [id=40e068d4874b46e5bd112f84ad360dc6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:50.544283 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fbe3d9d2c43e4217b0429169ebfc3f43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbe3d9d2c43e4217b0429169ebfc3f43 already in progress: creating tablet
I20260619 19:53:50.544317 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e43148bb5b47128e08ed7faf8c7c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.547616 1248 ts_tablet_manager.cc:1916] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.547523 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 37393d7c16594032bf2a69abb0ab5931 (DEFAULT_TABLE table=default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.548220 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37393d7c16594032bf2a69abb0ab5931. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:50.549149 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fce3bcb89e664d9f867eb53e144e3304 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fce3bcb89e664d9f867eb53e144e3304 already in progress: creating tablet
I20260619 19:53:50.553906 1331 tablet_replica.cc:333] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:50.554158 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 24916ace14294b1ea8f713d3fc876d7a (table default.Table_795f746f2c61444fabf717551ba728e7 [id=49fc155330a542be88195064f2a6799e]) successfully deleted
I20260619 19:53:50.554256 1331 raft_consensus.cc:2243] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.554745 1331 raft_consensus.cc:2272] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.555696 1331 ts_tablet_manager.cc:1916] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.555997 1247 ts_tablet_manager.cc:1929] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.556274 1247 log.cc:1199] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:50.550500 761 tablet_service.cc:1511] Processing CreateTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee (DEFAULT_TABLE table=default.Table_8874e3261467434cb5316f5024d06ce7 [id=6acfde9eb89943c9b83cf58165e83ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.556970 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f25c0378a6f4e9ea1a62d98f27778ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.568675 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 (DEFAULT_TABLE table=default.Table_46d92f291f484d6eb807a09bd023a3d0 [id=596e254ea57a41eeae97ee0e8ff2adc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.569206 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be5cda43d0b4719a82f33a03e2261d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.569515 1247 ts_tablet_manager.cc:1950] T 613372f5098b4c4fb69c4b88dd570f49 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.570482 1247 tablet_replica.cc:333] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.570686 1247 raft_consensus.cc:2243] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.570871 1247 raft_consensus.cc:2272] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.571766 1200 tablet_bootstrap.cc:492] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.572033 1200 ts_tablet_manager.cc:1403] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.134s user 0.004s sys 0.000s
I20260619 19:53:50.573293 1200 raft_consensus.cc:359] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.573647 1200 raft_consensus.cc:385] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.573807 1200 raft_consensus.cc:740] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.574148 1200 consensus_queue.cc:260] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.574900 1247 ts_tablet_manager.cc:1916] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.579399 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c379d780b294b9a863576f53f79ee7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.579463 1200 ts_tablet_manager.cc:1434] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260619 19:53:50.580296 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c379d780b294b9a863576f53f79ee7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.583496 900 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 (DEFAULT_TABLE table=default.Table_a40ad9bc744448b78938f33623ed8d56 [id=f848b07a0fe748fe9168a487db41e041]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.583905 1200 tablet_bootstrap.cc:492] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.584014 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0fe0c67fe84e5b866fd2553ea26d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.584563 1201 tablet_bootstrap.cc:492] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.584719 1201 ts_tablet_manager.cc:1403] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.001s
I20260619 19:53:50.585632 1200 tablet_bootstrap.cc:654] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.585652 1201 raft_consensus.cc:359] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.586265 1201 raft_consensus.cc:385] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.586362 1201 raft_consensus.cc:740] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.586411 764 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 (DEFAULT_TABLE table=default.Table_a40ad9bc744448b78938f33623ed8d56 [id=f848b07a0fe748fe9168a487db41e041]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.586601 1201 consensus_queue.cc:260] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.586823 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0fe0c67fe84e5b866fd2553ea26d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.587303 1201 ts_tablet_manager.cc:1434] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:50.587738 1201 tablet_bootstrap.cc:492] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.588147 1208 tablet_bootstrap.cc:492] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.588312 1208 ts_tablet_manager.cc:1403] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.153s user 0.020s sys 0.012s
I20260619 19:53:50.588959 1208 raft_consensus.cc:359] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.589151 1208 raft_consensus.cc:385] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.589236 1208 raft_consensus.cc:740] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.589509 1208 consensus_queue.cc:260] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.590119 1201 tablet_bootstrap.cc:654] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.592545 1208 ts_tablet_manager.cc:1434] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:53:50.593691 1208 tablet_bootstrap.cc:492] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.595471 1208 tablet_bootstrap.cc:654] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.598384 1247 ts_tablet_manager.cc:1929] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.598537 1247 log.cc:1199] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/79f909c3a4f24827867f9b2d0ded907e
I20260619 19:53:50.610766 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc12bcf50074b46860899a82dc0b46e (DEFAULT_TABLE table=default.Table_6f48937efc8f41559b9dc1c81380c1cd [id=9d332d034c5d424f92ca51559775be6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.610873 764 tablet_service.cc:1511] Processing CreateTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f (DEFAULT_TABLE table=default.Table_ed51a352570c4c8bbd0801643773aca8 [id=40e068d4874b46e5bd112f84ad360dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.611454 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc12bcf50074b46860899a82dc0b46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.611470 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e43148bb5b47128e08ed7faf8c7c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.612370 1248 ts_tablet_manager.cc:1929] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:50.606627 1235 consensus_queue.cc:1048] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:50.613660 1331 ts_tablet_manager.cc:1929] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.613776 1331 log.cc:1199] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/7400734402ca426aa34a3b7b482e59f1
I20260619 19:53:50.613903 1247 ts_tablet_manager.cc:1950] T 79f909c3a4f24827867f9b2d0ded907e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.614112 1331 ts_tablet_manager.cc:1950] T 7400734402ca426aa34a3b7b482e59f1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:50.608623 893 tablet_service.cc:1511] Processing CreateTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f (DEFAULT_TABLE table=default.Table_ed51a352570c4c8bbd0801643773aca8 [id=40e068d4874b46e5bd112f84ad360dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.614886 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e43148bb5b47128e08ed7faf8c7c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.614902 1248 log.cc:1199] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/da8cc8a9266f43be995f7c4dcf2391f6
I20260619 19:53:50.615612 1248 ts_tablet_manager.cc:1950] T da8cc8a9266f43be995f7c4dcf2391f6 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.616760 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 7400734402ca426aa34a3b7b482e59f1 (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]) successfully deleted
I20260619 19:53:50.617478 1235 raft_consensus.cc:493] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.617638 1235 raft_consensus.cc:515] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.617729 1248 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49744 (request call id 50) took 1349 ms. Trace:
I20260619 19:53:50.617818 1248 rpcz_store.cc:276] 0619 19:53:49.267992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:49.268632 (+ 640us) service_pool.cc:224] Handling call
0619 19:53:50.535927 (+1267295us) ts_tablet_manager.cc:1151] Deleting tablet da8cc8a9266f43be995f7c4dcf2391f6
0619 19:53:50.535943 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:50.604324 (+ 68381us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.612303 (+ 7979us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:50.617653 (+ 5350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1111135}
I20260619 19:53:50.618399 1235 leader_election.cc:290] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:50.619166 1247 tablet_replica.cc:333] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.619390 1247 raft_consensus.cc:2243] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:50.619524 859 leader_election.cc:343] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fce3bcb89e664d9f867eb53e144e3304
I20260619 19:53:50.620222 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce3bcb89e664d9f867eb53e144e3304" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:50.620431 1200 tablet_bootstrap.cc:492] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.620647 1200 ts_tablet_manager.cc:1403] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260619 19:53:50.622862 1200 raft_consensus.cc:359] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.623272 1200 raft_consensus.cc:385] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.623409 1200 raft_consensus.cc:740] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:53:50.623680 858 leader_election.cc:343] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.623749 1200 consensus_queue.cc:260] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.623867 858 leader_election.cc:304] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:50.624359 1200 ts_tablet_manager.cc:1434] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260619 19:53:50.619565 1247 raft_consensus.cc:2272] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.628120 903 tablet_service.cc:1511] Processing CreateTablet for tablet 37393d7c16594032bf2a69abb0ab5931 (DEFAULT_TABLE table=default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.628582 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37393d7c16594032bf2a69abb0ab5931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.629397 899 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc12bcf50074b46860899a82dc0b46e (DEFAULT_TABLE table=default.Table_6f48937efc8f41559b9dc1c81380c1cd [id=9d332d034c5d424f92ca51559775be6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.629777 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc12bcf50074b46860899a82dc0b46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.631844 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 (DEFAULT_TABLE table=default.Table_46d92f291f484d6eb807a09bd023a3d0 [id=596e254ea57a41eeae97ee0e8ff2adc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.631871 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 (DEFAULT_TABLE table=default.Table_46d92f291f484d6eb807a09bd023a3d0 [id=596e254ea57a41eeae97ee0e8ff2adc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.632187 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be5cda43d0b4719a82f33a03e2261d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.632287 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be5cda43d0b4719a82f33a03e2261d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.634930 1200 tablet_bootstrap.cc:492] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.635778 1283 raft_consensus.cc:493] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.635962 1283 raft_consensus.cc:515] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.636507 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet da8cc8a9266f43be995f7c4dcf2391f6 (table default.Table_4926348283cd417fb921ee6e4b4b58ea [id=a913d888b0ea4839847ecb8b6dafc17a]) successfully deleted
I20260619 19:53:50.636684 1200 tablet_bootstrap.cc:654] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:50.636794 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ea818ec12a3744f5b377a55f2693caed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea818ec12a3744f5b377a55f2693caed already in progress: creating tablet
I20260619 19:53:50.636830 1283 leader_election.cc:290] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:50.637036 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 79f909c3a4f24827867f9b2d0ded907e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f909c3a4f24827867f9b2d0ded907e already in progress: creating tablet
I20260619 19:53:50.637555 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 613372f5098b4c4fb69c4b88dd570f49 (table default.Table_32f92f5c64464d989015e442afc82c76 [id=bb5f6f3462ca47d1a7cd4507fd093ac9]) successfully deleted
I20260619 19:53:50.637703 1331 tablet_replica.cc:333] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:50.637758 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 79f909c3a4f24827867f9b2d0ded907e (table default.Table_879260ad54894aa5839b8cb3df8f3e56 [id=a8af5f54c3914c7a8ec2dbcd606c75c3]) successfully deleted
I20260619 19:53:50.637897 1331 raft_consensus.cc:2243] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:50.637961 720 leader_election.cc:343] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9b11228f4e7747619127ffbb99123e9f
I20260619 19:53:50.638051 1331 raft_consensus.cc:2272] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.638599 1331 ts_tablet_manager.cc:1916] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:50.640259 719 leader_election.cc:343] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 9b11228f4e7747619127ffbb99123e9f
I20260619 19:53:50.640419 719 leader_election.cc:304] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:50.640990 1283 raft_consensus.cc:2749] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.647182 761 tablet_service.cc:1511] Processing CreateTablet for tablet 37393d7c16594032bf2a69abb0ab5931 (DEFAULT_TABLE table=default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.647778 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37393d7c16594032bf2a69abb0ab5931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.650518 1283 raft_consensus.cc:493] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.650698 1283 raft_consensus.cc:515] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.651425 1283 leader_election.cc:290] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:50.653689 719 leader_election.cc:343] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: f0fc9c0f9ba246f6b650c22a90a5cc1f
I20260619 19:53:50.662576 1200 tablet_bootstrap.cc:492] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.662846 1200 ts_tablet_manager.cc:1403] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
W20260619 19:53:50.663054 720 leader_election.cc:343] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f0fc9c0f9ba246f6b650c22a90a5cc1f
I20260619 19:53:50.663276 720 leader_election.cc:304] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:50.663846 1283 raft_consensus.cc:2749] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.665980 1248 tablet_replica.cc:333] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.666023 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 (DEFAULT_TABLE table=default.Table_b8b3924f19d84788a481e2980b4c7a24 [id=6c9fac095a1d4192b64322a131a26435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.666327 1200 raft_consensus.cc:359] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.666700 1200 raft_consensus.cc:385] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.666891 1200 raft_consensus.cc:740] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.667088 1248 raft_consensus.cc:2243] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.667634 1200 consensus_queue.cc:260] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.667986 1248 raft_consensus.cc:2272] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.668988 1248 ts_tablet_manager.cc:1916] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.667378 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.670775 1200 ts_tablet_manager.cc:1434] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:53:50.672406 1208 tablet_bootstrap.cc:492] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
W20260619 19:53:50.672452 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 4e2f73871161488dbad7a19fc9e20b9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e2f73871161488dbad7a19fc9e20b9c already in progress: creating tablet
I20260619 19:53:50.672485 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9b08ab9ad59049919649b96890b6785d (DEFAULT_TABLE table=default.Table_9b854aa69df5459692f816d4bdebc8cf [id=4e12ede134634d1a92d756ba9c4b3219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.672648 1208 ts_tablet_manager.cc:1403] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.080s user 0.010s sys 0.009s
I20260619 19:53:50.672958 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b08ab9ad59049919649b96890b6785d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:50.673020 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 70716f209500400cae29b20ee1cb4882 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70716f209500400cae29b20ee1cb4882 already in progress: creating tablet
I20260619 19:53:50.674105 1208 raft_consensus.cc:359] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.674327 1208 raft_consensus.cc:385] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.674417 1208 raft_consensus.cc:740] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.674712 1208 consensus_queue.cc:260] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.675803 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9c379d780b294b9a863576f53f79ee7b (DEFAULT_TABLE table=default.Table_9c718229c76b4c2794a9bd5d5a26fc86 [id=e546025d2806485aa4b7d9ec209ab2d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.676256 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c379d780b294b9a863576f53f79ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.679268 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet fd9c959792fa48e89b669520f7332b26
I20260619 19:53:50.679440 1208 ts_tablet_manager.cc:1434] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:53:50.683962 1208 tablet_bootstrap.cc:492] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.692145 1208 tablet_bootstrap.cc:654] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.692168 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.692451 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.696508 1248 ts_tablet_manager.cc:1929] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.696686 1248 log.cc:1199] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a93ce0dc0b034f7fa87f74768a0e5ba4
I20260619 19:53:50.699287 1200 tablet_bootstrap.cc:492] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.701411 1200 tablet_bootstrap.cc:654] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.704950 1248 ts_tablet_manager.cc:1950] T a93ce0dc0b034f7fa87f74768a0e5ba4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.706174 1331 ts_tablet_manager.cc:1929] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.706452 1331 log.cc:1199] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/ac0d317731824eb7862630a08f9328b5
I20260619 19:53:50.706928 1331 ts_tablet_manager.cc:1950] T ac0d317731824eb7862630a08f9328b5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:50.708856 1248 tablet_replica.cc:333] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.710546 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc12bcf50074b46860899a82dc0b46e (DEFAULT_TABLE table=default.Table_6f48937efc8f41559b9dc1c81380c1cd [id=9d332d034c5d424f92ca51559775be6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.710700 1248 raft_consensus.cc:2243] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.710896 1248 raft_consensus.cc:2272] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.711058 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc12bcf50074b46860899a82dc0b46e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.714061 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:50.717331 1248 ts_tablet_manager.cc:1916] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.721231 1331 tablet_replica.cc:333] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:50.721527 1331 raft_consensus.cc:2243] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.722239 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet ac0d317731824eb7862630a08f9328b5 (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]) successfully deleted
W20260619 19:53:50.722641 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 70716f209500400cae29b20ee1cb4882 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70716f209500400cae29b20ee1cb4882 already in progress: creating tablet
I20260619 19:53:50.722720 1331 raft_consensus.cc:2272] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:50.723440 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9c379d780b294b9a863576f53f79ee7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c379d780b294b9a863576f53f79ee7b already in progress: creating tablet
W20260619 19:53:50.723701 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9b08ab9ad59049919649b96890b6785d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b08ab9ad59049919649b96890b6785d already in progress: creating tablet
W20260619 19:53:50.723996 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fd9c959792fa48e89b669520f7332b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd9c959792fa48e89b669520f7332b26 already in progress: creating tablet
I20260619 19:53:50.724788 1200 tablet_bootstrap.cc:492] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.725062 1200 ts_tablet_manager.cc:1403] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260619 19:53:50.726267 1200 raft_consensus.cc:359] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.726639 1200 raft_consensus.cc:385] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.726787 1200 raft_consensus.cc:740] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.727952 1331 ts_tablet_manager.cc:1916] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.727458 1200 consensus_queue.cc:260] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.733476 1200 ts_tablet_manager.cc:1434] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:53:50.734411 903 tablet_service.cc:1511] Processing CreateTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 (DEFAULT_TABLE table=default.Table_b8b3924f19d84788a481e2980b4c7a24 [id=6c9fac095a1d4192b64322a131a26435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.735047 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.735948 761 tablet_service.cc:1511] Processing CreateTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 (DEFAULT_TABLE table=default.Table_b8b3924f19d84788a481e2980b4c7a24 [id=6c9fac095a1d4192b64322a131a26435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.736460 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.738361 1248 ts_tablet_manager.cc:1929] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.738531 1248 log.cc:1199] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9b11228f4e7747619127ffbb99123e9f
I20260619 19:53:50.738976 1248 ts_tablet_manager.cc:1950] T 9b11228f4e7747619127ffbb99123e9f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.742218 1201 tablet_bootstrap.cc:492] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.742792 1201 ts_tablet_manager.cc:1403] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.155s user 0.010s sys 0.014s
I20260619 19:53:50.743759 1201 raft_consensus.cc:359] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.744087 1201 raft_consensus.cc:385] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.744249 1201 raft_consensus.cc:740] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.744575 1201 consensus_queue.cc:260] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.742602 1247 ts_tablet_manager.cc:1916] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.744889 1200 tablet_bootstrap.cc:492] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.746728 1200 tablet_bootstrap.cc:654] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.751194 1247 ts_tablet_manager.cc:1929] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.752353 1208 tablet_bootstrap.cc:492] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.752636 1208 ts_tablet_manager.cc:1403] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.011s
I20260619 19:53:50.755506 1247 log.cc:1199] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fce3bcb89e664d9f867eb53e144e3304
I20260619 19:53:50.756312 1247 ts_tablet_manager.cc:1950] T fce3bcb89e664d9f867eb53e144e3304 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.757472 1208 raft_consensus.cc:359] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.757828 1208 raft_consensus.cc:385] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.757962 1208 raft_consensus.cc:740] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.758455 1208 consensus_queue.cc:260] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.758637 1331 ts_tablet_manager.cc:1929] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.758790 1331 log.cc:1199] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:50.760252 1247 tablet_replica.cc:333] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.760455 1247 raft_consensus.cc:2243] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.760640 1247 raft_consensus.cc:2272] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.761132 1331 ts_tablet_manager.cc:1950] T fbe3d9d2c43e4217b0429169ebfc3f43 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:50.761713 1379 raft_consensus.cc:493] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.767622 1248 tablet_replica.cc:333] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.767819 1248 raft_consensus.cc:2243] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.767724 1379 raft_consensus.cc:515] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.768008 1248 raft_consensus.cc:2272] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.768539 1208 ts_tablet_manager.cc:1434] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.016s user 0.002s sys 0.001s
I20260619 19:53:50.768679 1379 leader_election.cc:290] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:50.769704 1331 tablet_replica.cc:333] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:50.769667 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fbe3d9d2c43e4217b0429169ebfc3f43 (table default.Table_625833f4158e43439f15da6d59ba1797 [id=b0b1af506cad4219965fd83f04e7e5b5]) successfully deleted
I20260619 19:53:50.770109 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0991def17b44b0d8e707d4deb64ecff" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:50.770215 1331 raft_consensus.cc:2243] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:50.770745 996 leader_election.cc:343] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.770803 1331 raft_consensus.cc:2272] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.770928 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0991def17b44b0d8e707d4deb64ecff" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:50.771901 996 leader_election.cc:343] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.771961 1208 tablet_bootstrap.cc:492] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.772034 996 leader_election.cc:304] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:50.774209 1208 tablet_bootstrap.cc:654] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.776826 1247 ts_tablet_manager.cc:1916] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.777561 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9b08ab9ad59049919649b96890b6785d (DEFAULT_TABLE table=default.Table_9b854aa69df5459692f816d4bdebc8cf [id=4e12ede134634d1a92d756ba9c4b3219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.778023 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b08ab9ad59049919649b96890b6785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.781126 900 tablet_service.cc:1511] Processing CreateTablet for tablet 9c379d780b294b9a863576f53f79ee7b (DEFAULT_TABLE table=default.Table_9c718229c76b4c2794a9bd5d5a26fc86 [id=e546025d2806485aa4b7d9ec209ab2d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.781576 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c379d780b294b9a863576f53f79ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.775336 1248 ts_tablet_manager.cc:1916] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.780624 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9b08ab9ad59049919649b96890b6785d (DEFAULT_TABLE table=default.Table_9b854aa69df5459692f816d4bdebc8cf [id=4e12ede134634d1a92d756ba9c4b3219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.783536 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b08ab9ad59049919649b96890b6785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.788679 900 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:50.798504 1208 tablet_bootstrap.cc:492] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.798938 1208 ts_tablet_manager.cc:1403] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260619 19:53:50.799983 761 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.800071 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:50.804852 1247 ts_tablet_manager.cc:1929] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.805029 1247 log.cc:1199] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/ac0d317731824eb7862630a08f9328b5
I20260619 19:53:50.805421 1247 ts_tablet_manager.cc:1950] T ac0d317731824eb7862630a08f9328b5 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.806414 1247 tablet_replica.cc:333] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:50.808456 1208 raft_consensus.cc:359] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.808691 1208 raft_consensus.cc:385] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.808784 1208 raft_consensus.cc:740] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.810906 1283 raft_consensus.cc:493] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.811064 1283 raft_consensus.cc:515] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.811798 1283 leader_election.cc:290] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:50.812613 1248 ts_tablet_manager.cc:1929] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.812747 1248 log.cc:1199] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a9c566903d9848f0bbe046793922b778
I20260619 19:53:50.813205 1248 ts_tablet_manager.cc:1950] T a9c566903d9848f0bbe046793922b778 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:53:50.813872 719 leader_election.cc:343] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 397b0ded7d5c4b5a98bb07dd6bfdc52f
I20260619 19:53:50.814132 1208 consensus_queue.cc:260] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.815690 1208 ts_tablet_manager.cc:1434] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260619 19:53:50.816777 1208 tablet_bootstrap.cc:492] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.819890 1208 tablet_bootstrap.cc:654] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.824934 1248 tablet_replica.cc:333] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.825408 1283 raft_consensus.cc:493] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.825598 1283 raft_consensus.cc:515] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.826514 1283 leader_election.cc:290] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:50.827535 1248 raft_consensus.cc:2243] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.827519 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe3d9d2c43e4217b0429169ebfc3f43" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:50.827889 1248 raft_consensus.cc:2272] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:50.828426 719 leader_election.cc:343] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:50.826508 1208 tablet_bootstrap.cc:492] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.828691 1208 ts_tablet_manager.cc:1403] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.003s
I20260619 19:53:50.830533 1208 raft_consensus.cc:359] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.832119 1208 raft_consensus.cc:385] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.832410 1208 raft_consensus.cc:740] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.831264 1248 ts_tablet_manager.cc:1916] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.837689 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a93ce0dc0b034f7fa87f74768a0e5ba4 (table default.Table_cc82ca43b5cf464db8144b09e67a1b6a [id=4b2d780b8f1d4d8786bb33f2ec5ca8f4]) successfully deleted
W20260619 19:53:50.838598 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 60324f7edaac45ed919be7e2368a4fd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60324f7edaac45ed919be7e2368a4fd5 already in progress: creating tablet
I20260619 19:53:50.838768 1208 consensus_queue.cc:260] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.840402 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9b11228f4e7747619127ffbb99123e9f (table default.Table_b716080450d7415ebf6dfdc29033f87e [id=8ac1c025b7224f29a7967cd91efb3a95]) successfully deleted
I20260619 19:53:50.841727 1208 ts_tablet_manager.cc:1434] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260619 19:53:50.842880 1208 tablet_bootstrap.cc:492] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.845835 1208 tablet_bootstrap.cc:654] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:50.848559 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 87037.8us
I20260619 19:53:50.851600 1247 raft_consensus.cc:2243] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:50.852253 1247 raft_consensus.cc:2272] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.853731 1247 ts_tablet_manager.cc:1916] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.855998 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a9c566903d9848f0bbe046793922b778 (table default.Table_f91630ed9b14431d9b472c3362f8cecf [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
I20260619 19:53:50.857139 764 tablet_service.cc:1511] Processing CreateTablet for tablet 9c379d780b294b9a863576f53f79ee7b (DEFAULT_TABLE table=default.Table_9c718229c76b4c2794a9bd5d5a26fc86 [id=e546025d2806485aa4b7d9ec209ab2d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:50.857787 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c379d780b294b9a863576f53f79ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:50.860428 1247 ts_tablet_manager.cc:1929] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260619 19:53:50.861651 996 raft_consensus.cc:2686] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:53:50.861948 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 90144.9us
I20260619 19:53:50.862200 1247 log.cc:1199] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/7400734402ca426aa34a3b7b482e59f1
I20260619 19:53:50.862668 1247 ts_tablet_manager.cc:1950] T 7400734402ca426aa34a3b7b482e59f1 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:50.863487 1331 ts_tablet_manager.cc:1916] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.864600 1208 tablet_bootstrap.cc:492] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.864759 1208 ts_tablet_manager.cc:1403] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260619 19:53:50.865592 1208 raft_consensus.cc:359] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.865809 1208 raft_consensus.cc:385] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.865927 1208 raft_consensus.cc:740] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.867286 1248 ts_tablet_manager.cc:1929] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.867444 1248 log.cc:1199] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f0fc9c0f9ba246f6b650c22a90a5cc1f
I20260619 19:53:50.867798 1248 ts_tablet_manager.cc:1950] T f0fc9c0f9ba246f6b650c22a90a5cc1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.872156 595 master_service.cc:960] ReplaceTablet: received request to replace tablet 7cd2fca96ee44cf297eb248b1f3ed00a from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:50.872984 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 consensus state has no leader
I20260619 19:53:50.873773 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 6baa466f30c2460697217f526fc4617f from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:50.874223 720 leader_election.cc:343] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 397b0ded7d5c4b5a98bb07dd6bfdc52f
I20260619 19:53:50.874553 720 leader_election.cc:304] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:50.875208 720 leader_election.cc:343] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:50.875496 720 leader_election.cc:304] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:50.875874 1283 raft_consensus.cc:2749] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.876109 1283 raft_consensus.cc:2749] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:50.876250 1208 consensus_queue.cc:260] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.878172 1208 ts_tablet_manager.cc:1434] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260619 19:53:50.878779 1248 tablet_replica.cc:333] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.879405 1208 tablet_bootstrap.cc:492] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.881945 1208 tablet_bootstrap.cc:654] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.882253 1248 raft_consensus.cc:2243] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.885603 1248 raft_consensus.cc:2272] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.887153 1248 ts_tablet_manager.cc:1916] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.891109 1201 ts_tablet_manager.cc:1434] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.148s user 0.023s sys 0.006s
I20260619 19:53:50.892069 1201 tablet_bootstrap.cc:492] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.893944 1201 tablet_bootstrap.cc:654] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:50.896739 590 catalog_manager.cc:5100] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): alter failed for tablet 48a58620df904c09b459d3f7ff72bcf8 (table default.Table_d3b46da7823a441682cf7c3a4e321eed [id=3c9da136fa6d4578a5ad210801a2ccea]),no further retry: Not found: Tablet not found: 48a58620df904c09b459d3f7ff72bcf8
I20260619 19:53:50.900784 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fce3bcb89e664d9f867eb53e144e3304 (table default.Table_672e6fc5aebe40efbc58e5631f43b344 [id=1f81b05e18de4ce08b8880942569bafa]) successfully deleted
I20260619 19:53:50.900869 1200 tablet_bootstrap.cc:492] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.901065 1200 ts_tablet_manager.cc:1403] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.156s user 0.036s sys 0.053s
I20260619 19:53:50.902144 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet ac0d317731824eb7862630a08f9328b5 (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]) successfully deleted
I20260619 19:53:50.902215 1200 raft_consensus.cc:359] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.902475 1200 raft_consensus.cc:385] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.902590 1200 raft_consensus.cc:740] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.902925 1200 consensus_queue.cc:260] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.905094 1248 ts_tablet_manager.cc:1929] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:50.905261 1200 ts_tablet_manager.cc:1434] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 19:53:50.907095 1200 tablet_bootstrap.cc:492] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.909731 1200 tablet_bootstrap.cc:654] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.910151 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 7400734402ca426aa34a3b7b482e59f1 (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]) successfully deleted
I20260619 19:53:50.910552 1201 tablet_bootstrap.cc:492] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.910705 1201 ts_tablet_manager.cc:1403] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.002s
I20260619 19:53:50.911594 1201 raft_consensus.cc:359] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.911793 1201 raft_consensus.cc:385] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.911881 1201 raft_consensus.cc:740] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.912096 1201 consensus_queue.cc:260] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.912596 1201 ts_tablet_manager.cc:1434] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:50.912915 1201 tablet_bootstrap.cc:492] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.914804 1248 log.cc:1199] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/7400734402ca426aa34a3b7b482e59f1
I20260619 19:53:50.915537 1248 ts_tablet_manager.cc:1950] T 7400734402ca426aa34a3b7b482e59f1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.917088 1248 tablet_replica.cc:333] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:50.918493 1248 raft_consensus.cc:2243] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:50.918900 1248 raft_consensus.cc:2272] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:50.920259 1248 ts_tablet_manager.cc:1916] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:50.920938 1200 tablet_bootstrap.cc:492] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.921195 1200 ts_tablet_manager.cc:1403] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.004s
I20260619 19:53:50.922268 1201 tablet_bootstrap.cc:654] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.922284 1200 raft_consensus.cc:359] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.922552 1200 raft_consensus.cc:385] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.922650 1200 raft_consensus.cc:740] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.922963 1200 consensus_queue.cc:260] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.925096 1200 ts_tablet_manager.cc:1434] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:50.926790 1200 tablet_bootstrap.cc:492] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.929559 1200 tablet_bootstrap.cc:654] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.931825 1201 tablet_bootstrap.cc:492] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.931993 1201 ts_tablet_manager.cc:1403] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260619 19:53:50.932772 1201 raft_consensus.cc:359] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.932983 1201 raft_consensus.cc:385] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.933070 1201 raft_consensus.cc:740] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.933313 1201 consensus_queue.cc:260] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:50.912511 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d29506dab4c84850ad79b8b7a0340987 consensus state has no leader
W20260619 19:53:50.912760 598 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6b5f1da20614838aac1a0175ad4a67d consensus state has no leader
I20260619 19:53:50.934190 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_49472f6375c04623bbaba293eb98dd6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:50.934338 1200 tablet_bootstrap.cc:492] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:50.934269 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_9b3efa9d3b0942de927aee2f16dd653b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:50.934461 1200 ts_tablet_manager.cc:1403] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
W20260619 19:53:50.918222 591 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 (table default.Table_e8a37cf077e54a94804ae31d3a54650d [id=6c9fac095a1d4192b64322a131a26435], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 consensus state has no leader
W20260619 19:53:50.934859 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49472f6375c04623bbaba293eb98dd6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.920336 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:50.935249 1200 raft_consensus.cc:359] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.935426 1200 raft_consensus.cc:385] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.935515 1200 raft_consensus.cc:740] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:53:50.935544 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.935782 1200 consensus_queue.cc:260] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.936453 1200 ts_tablet_manager.cc:1434] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:50.936801 1200 tablet_bootstrap.cc:492] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:50.922185 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_66ddb27484c049a4a1043b72dd77d477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:50.937230 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66ddb27484c049a4a1043b72dd77d477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.938962 1200 tablet_bootstrap.cc:654] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.939782 1201 ts_tablet_manager.cc:1434] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260619 19:53:50.934865 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b3efa9d3b0942de927aee2f16dd653b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:50.941574 1248 ts_tablet_manager.cc:1929] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.941767 1248 log.cc:1199] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/ac0d317731824eb7862630a08f9328b5
I20260619 19:53:50.942144 1248 ts_tablet_manager.cc:1950] T ac0d317731824eb7862630a08f9328b5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:50.943465 1201 tablet_bootstrap.cc:492] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.945621 1201 tablet_bootstrap.cc:654] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.951704 1201 tablet_bootstrap.cc:492] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.951874 1201 ts_tablet_manager.cc:1403] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260619 19:53:50.952682 1201 raft_consensus.cc:359] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.952875 1201 raft_consensus.cc:385] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.952924 1331 ts_tablet_manager.cc:1929] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:50.952976 1201 raft_consensus.cc:740] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.953217 1201 consensus_queue.cc:260] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:50.953390 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9b08ab9ad59049919649b96890b6785d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b08ab9ad59049919649b96890b6785d already in progress: creating tablet
W20260619 19:53:50.953747 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9c379d780b294b9a863576f53f79ee7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c379d780b294b9a863576f53f79ee7b already in progress: creating tablet
W20260619 19:53:50.954075 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet fd9c959792fa48e89b669520f7332b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd9c959792fa48e89b669520f7332b26 already in progress: creating tablet
I20260619 19:53:50.957520 1201 ts_tablet_manager.cc:1434] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:50.957842 1201 tablet_bootstrap.cc:492] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.960139 1201 tablet_bootstrap.cc:654] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.972043 1201 tablet_bootstrap.cc:492] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:50.972153 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f0fc9c0f9ba246f6b650c22a90a5cc1f (table default.Table_b6822e2f028a4ee29e80309e9e006c0a [id=e2f073596be64b4c9e61b9a5f9962ef6]) successfully deleted
W20260619 19:53:50.972438 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 4e2f73871161488dbad7a19fc9e20b9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e2f73871161488dbad7a19fc9e20b9c already in progress: creating tablet
W20260619 19:53:50.972697 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 70716f209500400cae29b20ee1cb4882 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70716f209500400cae29b20ee1cb4882 already in progress: creating tablet
I20260619 19:53:50.972892 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 7400734402ca426aa34a3b7b482e59f1 (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]) successfully deleted
I20260619 19:53:50.972944 1201 ts_tablet_manager.cc:1403] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20260619 19:53:50.973994 1201 raft_consensus.cc:359] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.974274 1201 raft_consensus.cc:385] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.974393 1201 raft_consensus.cc:740] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.974689 1201 consensus_queue.cc:260] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.977326 1201 ts_tablet_manager.cc:1434] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:53:50.977695 1201 tablet_bootstrap.cc:492] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:50.980191 1201 tablet_bootstrap.cc:654] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.983870 1208 tablet_bootstrap.cc:492] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:50.984090 1208 ts_tablet_manager.cc:1403] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.105s user 0.012s sys 0.015s
I20260619 19:53:50.984927 1208 raft_consensus.cc:359] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.985157 1208 raft_consensus.cc:385] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:50.985249 1208 raft_consensus.cc:740] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:50.985504 1208 consensus_queue.cc:260] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.986035 1208 ts_tablet_manager.cc:1434] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:50.986373 1208 tablet_bootstrap.cc:492] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:50.989012 1208 tablet_bootstrap.cc:654] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:50.995940 1379 raft_consensus.cc:493] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:50.996239 1379 raft_consensus.cc:515] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:50.997114 1379 leader_election.cc:290] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:50.999647 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d37d6f54a96471fad26a342cab984ef" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.000115 785 raft_consensus.cc:2468] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:51.000412 1208 tablet_bootstrap.cc:492] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.000561 1208 ts_tablet_manager.cc:1403] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260619 19:53:51.000845 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d37d6f54a96471fad26a342cab984ef" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.001180 996 leader_election.cc:304] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.001561 1208 raft_consensus.cc:359] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.001623 1379 raft_consensus.cc:2804] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.001724 1208 raft_consensus.cc:385] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.001748 1379 raft_consensus.cc:493] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.001806 1208 raft_consensus.cc:740] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.001870 1379 raft_consensus.cc:3060] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.002084 1208 consensus_queue.cc:260] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.002136 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cf444a19b16a4d57a7aba0f06a100642" } new_table_name: "default.Table_e996cd4a2ce04c02a10ef16acb8d545b" modify_external_catalogs: true
I20260619 19:53:51.002620 1208 ts_tablet_manager.cc:1434] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:51.002933 1208 tablet_bootstrap.cc:492] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.004447 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_18793f9a9a8d4535bbfff03c8b2bb59f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.005016 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18793f9a9a8d4535bbfff03c8b2bb59f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.005623 1208 tablet_bootstrap.cc:654] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.006634 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a40ad9bc744448b78938f33623ed8d56" } modify_external_catalogs: true
I20260619 19:53:51.006805 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a40ad9bc744448b78938f33623ed8d56" } modify_external_catalogs: true
I20260619 19:53:51.007911 1379 raft_consensus.cc:515] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.008738 1201 tablet_bootstrap.cc:492] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:51.008898 1201 ts_tablet_manager.cc:1403] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.004s
I20260619 19:53:51.009281 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d37d6f54a96471fad26a342cab984ef" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:51.009563 785 raft_consensus.cc:3060] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.009713 1201 raft_consensus.cc:359] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.009910 1201 raft_consensus.cc:385] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.010006 1201 raft_consensus.cc:740] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.010033 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_d3b46da7823a441682cf7c3a4e321eed" } new_table_name: "default.Table_e902d26af2734b138a7beda9b1fc800c" modify_external_catalogs: true
I20260619 19:53:51.010246 1201 consensus_queue.cc:260] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.010874 1201 ts_tablet_manager.cc:1434] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:51.011998 1201 tablet_bootstrap.cc:492] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:51.013360 785 raft_consensus.cc:2468] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:51.013604 1201 tablet_bootstrap.cc:654] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.014138 996 leader_election.cc:304] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.024188 1379 leader_election.cc:290] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:51.025682 1379 raft_consensus.cc:493] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.026563 1379 raft_consensus.cc:515] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.028147 1379 leader_election.cc:290] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:51.030114 1379 raft_consensus.cc:2804] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:51.030866 1379 raft_consensus.cc:697] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:51.031479 1248 tablet_replica.cc:333] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.031705 1248 raft_consensus.cc:2243] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.031678 1379 consensus_queue.cc:237] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.031910 1248 raft_consensus.cc:2272] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.032513 1248 ts_tablet_manager.cc:1916] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:51.033944 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 438ce37bb8ca4088b308a457b7f17041 consensus state has no leader
I20260619 19:53:51.034212 596 master_service.cc:960] ReplaceTablet: received request to replace tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.035351 601 master_service.cc:960] ReplaceTablet: received request to replace tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:51.037073 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53ff57208565495480920b6eaaff9295 consensus state has no leader
I20260619 19:53:51.037353 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 37393d7c16594032bf2a69abb0ab5931 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.039371 1248 ts_tablet_manager.cc:1929] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.039566 1248 log.cc:1199] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/613372f5098b4c4fb69c4b88dd570f49
I20260619 19:53:51.039759 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet ac0d317731824eb7862630a08f9328b5 (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]) successfully deleted
I20260619 19:53:51.040060 1248 ts_tablet_manager.cc:1950] T 613372f5098b4c4fb69c4b88dd570f49 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.041884 1248 tablet_replica.cc:333] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.042224 1248 raft_consensus.cc:2243] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.042469 1248 raft_consensus.cc:2272] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.043366 1248 ts_tablet_manager.cc:1916] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:51.043318 996 leader_election.cc:343] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.044188 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d37d6f54a96471fad26a342cab984ef" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:51.044441 921 raft_consensus.cc:3060] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.048318 921 raft_consensus.cc:2468] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:51.048656 1401 raft_consensus.cc:493] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.048846 1401 raft_consensus.cc:515] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.049767 1401 leader_election.cc:290] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:51.050606 859 leader_election.cc:343] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:51.050432 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe3d9d2c43e4217b0429169ebfc3f43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.051049 785 raft_consensus.cc:2468] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:51.051677 858 leader_election.cc:304] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.052007 1401 raft_consensus.cc:2804] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.052124 1401 raft_consensus.cc:493] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.052219 1401 raft_consensus.cc:3060] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.052309 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 613372f5098b4c4fb69c4b88dd570f49 (table default.Table_32f92f5c64464d989015e442afc82c76 [id=bb5f6f3462ca47d1a7cd4507fd093ac9]) successfully deleted
W20260619 19:53:51.052610 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9b08ab9ad59049919649b96890b6785d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b08ab9ad59049919649b96890b6785d already in progress: creating tablet
W20260619 19:53:51.052829 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9c379d780b294b9a863576f53f79ee7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c379d780b294b9a863576f53f79ee7b already in progress: creating tablet
I20260619 19:53:51.053576 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732a2e073e3442ff873ca00be6106744" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:50.953078 1331 log.cc:1199] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b0991def17b44b0d8e707d4deb64ecff
I20260619 19:53:51.054417 1331 ts_tablet_manager.cc:1950] T b0991def17b44b0d8e707d4deb64ecff P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:51.054565 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732a2e073e3442ff873ca00be6106744" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.055639 1401 raft_consensus.cc:515] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:51.055794 996 leader_election.cc:343] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.056090 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b0991def17b44b0d8e707d4deb64ecff (table default.Table_3ed147ad3dd54cac8d31e443a31ae944 [id=d08fd6bb08ae4025a6e554581238c7ea]) successfully deleted
W20260619 19:53:51.056336 996 leader_election.cc:343] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.056406 1401 leader_election.cc:290] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.056478 996 leader_election.cc:304] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.056949 1424 raft_consensus.cc:2749] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:51.057108 859 leader_election.cc:343] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:51.057452 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbe3d9d2c43e4217b0429169ebfc3f43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:51.057731 785 raft_consensus.cc:3060] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.061491 785 raft_consensus.cc:2468] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:51.062222 858 leader_election.cc:304] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.062578 1401 raft_consensus.cc:2804] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:51.062731 1401 raft_consensus.cc:697] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:51.063051 1401 consensus_queue.cc:237] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:51.066915 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fd9c959792fa48e89b669520f7332b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd9c959792fa48e89b669520f7332b26 already in progress: creating tablet
I20260619 19:53:51.068651 1248 ts_tablet_manager.cc:1929] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.069585 1248 log.cc:1199] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/397b0ded7d5c4b5a98bb07dd6bfdc52f
I20260619 19:53:51.070295 1248 ts_tablet_manager.cc:1950] T 397b0ded7d5c4b5a98bb07dd6bfdc52f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.072216 1174 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.190:46791
I20260619 19:53:51.072232 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f (table default.Table_a2a19e703d7d4d918901e6f436214186 [id=71e32801a3984b37a60e1597394442e3]) successfully deleted
I20260619 19:53:51.072877 1417 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.190:46791 every 8 connection(s)
I20260619 19:53:51.073980 1200 tablet_bootstrap.cc:492] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.074635 1174 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-0/data/info.pb
I20260619 19:53:51.074856 1200 ts_tablet_manager.cc:1403] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.138s user 0.042s sys 0.024s
I20260619 19:53:51.075866 1200 raft_consensus.cc:359] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.077181 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 1174
I20260619 19:53:51.080022 1200 raft_consensus.cc:385] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.080163 1200 raft_consensus.cc:740] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.080476 1200 consensus_queue.cc:260] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.082974 1200 ts_tablet_manager.cc:1434] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:53:51.083425 1200 tablet_bootstrap.cc:492] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.085444 1407 raft_consensus.cc:493] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.085623 1407 raft_consensus.cc:515] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.085798 1200 tablet_bootstrap.cc:654] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.086314 1407 leader_election.cc:290] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:51.087443 720 leader_election.cc:343] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fce3bcb89e664d9f867eb53e144e3304
W20260619 19:53:51.088284 719 leader_election.cc:343] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: fce3bcb89e664d9f867eb53e144e3304
I20260619 19:53:51.088429 719 leader_election.cc:304] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.088973 1407 raft_consensus.cc:2749] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.110023 600 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:51.110843 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:53:51.113070 604 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:51.115226 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:51.116259 591 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5ea9f17d5e75499a8433fc9a3043a88e because the tablet was not found. No further retry: Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:53:51.118486 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_fee05dbe2f3d4261b61052c1fa5e39f0" } modify_external_catalogs: true
I20260619 19:53:51.118698 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_fee05dbe2f3d4261b61052c1fa5e39f0" } modify_external_catalogs: true
I20260619 19:53:51.121029 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9b3efa9d3b0942de927aee2f16dd653b" } new_table_name: "default.Table_dab7592aa5c140918ba0451a9fc4c9f9" modify_external_catalogs: true
I20260619 19:53:51.122483 1200 tablet_bootstrap.cc:492] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.122480 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a4356f4b40cc4a4b8fdae91a4e687529" } modify_external_catalogs: true
I20260619 19:53:51.122653 1200 ts_tablet_manager.cc:1403] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.006s
I20260619 19:53:51.122658 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a4356f4b40cc4a4b8fdae91a4e687529" } modify_external_catalogs: true
I20260619 19:53:51.123510 1200 raft_consensus.cc:359] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.123693 1200 raft_consensus.cc:385] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.123791 1200 raft_consensus.cc:740] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.124225 603 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_6f48937efc8f41559b9dc1c81380c1cd" } modify_external_catalogs: true
I20260619 19:53:51.124183 1200 consensus_queue.cc:260] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.124414 603 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_6f48937efc8f41559b9dc1c81380c1cd" } modify_external_catalogs: true
I20260619 19:53:51.127909 599 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 732a2e073e3442ff873ca00be6106744 (table default.Table_f91630ed9b14431d9b472c3362f8cecf [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 1 got 0
I20260619 19:53:51.128211 599 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet da983715197847f18466d61f1eade0f5 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:53:51.128526 1200 ts_tablet_manager.cc:1434] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:51.128458 599 catalog_manager.cc:5696] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:51.129222 599 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 438ce37bb8ca4088b308a457b7f17041 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:53:51.129441 599 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 4 got 0
I20260619 19:53:51.132207 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.133009 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.133950 903 tablet_service.cc:1558] Processing DeleteTablet for tablet ac0d317731824eb7862630a08f9328b5 with delete_type TABLET_DATA_DELETED (replaced by tablet fcaeebaaa93c479bafff14d312d526ec) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.135887 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.136561 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 7400734402ca426aa34a3b7b482e59f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:49744
W20260619 19:53:51.137017 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 5ea9f17d5e75499a8433fc9a3043a88e because the tablet was not found. No further retry: Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
W20260619 19:53:51.137302 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ac0d317731824eb7862630a08f9328b5 because the tablet was not found. No further retry: Not found: Tablet not found: ac0d317731824eb7862630a08f9328b5
W20260619 19:53:51.137529 590 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5ea9f17d5e75499a8433fc9a3043a88e because the tablet was not found. No further retry: Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:53:51.138252 1200 tablet_bootstrap.cc:492] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.140914 1200 tablet_bootstrap.cc:654] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.141896 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d4771739543f4b4189b7d603f76325f0 (DEFAULT_TABLE table=default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.142365 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4771739543f4b4189b7d603f76325f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.149130 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb (DEFAULT_TABLE table=default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f [id=a35219ac89654132bd60088b911b7859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.149794 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2dd6eedd24f44a6a17aceb20e62bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.150099 764 tablet_service.cc:1511] Processing CreateTablet for tablet d4771739543f4b4189b7d603f76325f0 (DEFAULT_TABLE table=default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.150617 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4771739543f4b4189b7d603f76325f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.151548 1032 tablet_service.cc:1511] Processing CreateTablet for tablet fcaeebaaa93c479bafff14d312d526ec (DEFAULT_TABLE table=default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.152058 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcaeebaaa93c479bafff14d312d526ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.154556 1200 tablet_bootstrap.cc:492] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.154726 1200 ts_tablet_manager.cc:1403] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260619 19:53:51.155753 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 108f1b2e9ec74271889ffff65d8e852e (DEFAULT_TABLE table=default.Table_96219489afdb43b891399da04a6bba32 [id=f1c35564785e48a6b6b465801f79ac2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.156101 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108f1b2e9ec74271889ffff65d8e852e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.155987 1200 raft_consensus.cc:359] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.156206 1200 raft_consensus.cc:385] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.156289 1200 raft_consensus.cc:740] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.156597 1200 consensus_queue.cc:260] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.159461 1041 tablet_service.cc:1511] Processing CreateTablet for tablet a690a4fdf60947acb271abe588d4b5c0 (DEFAULT_TABLE table=default.Table_178fe18a009943389544ff741edba23c [id=dc9ba30342a24a7daaa7ffa73975cc9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.159507 903 tablet_service.cc:1511] Processing CreateTablet for tablet d4771739543f4b4189b7d603f76325f0 (DEFAULT_TABLE table=default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.159854 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a690a4fdf60947acb271abe588d4b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.159930 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4771739543f4b4189b7d603f76325f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.160120 1200 ts_tablet_manager.cc:1434] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260619 19:53:51.163025 1200 tablet_bootstrap.cc:492] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.149137 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 906212dd25ef46f2b381ce6a99c39343 (DEFAULT_TABLE table=default.Table_17ad83fba0994578904672a32ee809a4 [id=64c1bcf3dc5048099e5aef869c6133f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.164160 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906212dd25ef46f2b381ce6a99c39343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.164932 1200 tablet_bootstrap.cc:654] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.167893 759 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb (DEFAULT_TABLE table=default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f [id=a35219ac89654132bd60088b911b7859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.168322 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2dd6eedd24f44a6a17aceb20e62bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.168484 893 tablet_service.cc:1511] Processing CreateTablet for tablet fcaeebaaa93c479bafff14d312d526ec (DEFAULT_TABLE table=default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.168895 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcaeebaaa93c479bafff14d312d526ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.169484 761 tablet_service.cc:1511] Processing CreateTablet for tablet fcaeebaaa93c479bafff14d312d526ec (DEFAULT_TABLE table=default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.169865 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcaeebaaa93c479bafff14d312d526ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.176033 903 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb (DEFAULT_TABLE table=default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f [id=a35219ac89654132bd60088b911b7859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.176375 969 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:51.177161 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2dd6eedd24f44a6a17aceb20e62bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.180464 900 tablet_service.cc:1511] Processing CreateTablet for tablet a690a4fdf60947acb271abe588d4b5c0 (DEFAULT_TABLE table=default.Table_178fe18a009943389544ff741edba23c [id=dc9ba30342a24a7daaa7ffa73975cc9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.180905 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a690a4fdf60947acb271abe588d4b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.181545 762 tablet_service.cc:1511] Processing CreateTablet for tablet 108f1b2e9ec74271889ffff65d8e852e (DEFAULT_TABLE table=default.Table_96219489afdb43b891399da04a6bba32 [id=f1c35564785e48a6b6b465801f79ac2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.181958 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108f1b2e9ec74271889ffff65d8e852e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.182557 893 tablet_service.cc:1511] Processing CreateTablet for tablet 108f1b2e9ec74271889ffff65d8e852e (DEFAULT_TABLE table=default.Table_96219489afdb43b891399da04a6bba32 [id=f1c35564785e48a6b6b465801f79ac2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.182922 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108f1b2e9ec74271889ffff65d8e852e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.184504 1405 raft_consensus.cc:493] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.184648 1405 raft_consensus.cc:515] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.185966 1405 leader_election.cc:290] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:51.187234 859 leader_election.cc:343] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b0991def17b44b0d8e707d4deb64ecff
W20260619 19:53:51.189219 590 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 397b0ded7d5c4b5a98bb07dd6bfdc52f because the tablet was not found. No further retry: Not found: Tablet not found: 397b0ded7d5c4b5a98bb07dd6bfdc52f
W20260619 19:53:51.189652 590 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7400734402ca426aa34a3b7b482e59f1 because the tablet was not found. No further retry: Not found: Tablet not found: 7400734402ca426aa34a3b7b482e59f1
I20260619 19:53:51.189647 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0991def17b44b0d8e707d4deb64ecff" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.190404 785 raft_consensus.cc:2468] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:51.190838 752 tablet_service.cc:1511] Processing CreateTablet for tablet 906212dd25ef46f2b381ce6a99c39343 (DEFAULT_TABLE table=default.Table_17ad83fba0994578904672a32ee809a4 [id=64c1bcf3dc5048099e5aef869c6133f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.191298 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906212dd25ef46f2b381ce6a99c39343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.195159 858 leader_election.cc:304] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.195806 1405 raft_consensus.cc:2804] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.195950 1405 raft_consensus.cc:493] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.196067 1405 raft_consensus.cc:3060] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.201251 761 tablet_service.cc:1511] Processing CreateTablet for tablet a690a4fdf60947acb271abe588d4b5c0 (DEFAULT_TABLE table=default.Table_178fe18a009943389544ff741edba23c [id=dc9ba30342a24a7daaa7ffa73975cc9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.201499 1037 tablet_service.cc:1511] Processing CreateTablet for tablet e4132f28c434492cbddc8da7d8075c43 (DEFAULT_TABLE table=default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4 [id=a57b082016f14ff48e4194fcbd7b63c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.201912 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a690a4fdf60947acb271abe588d4b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.199069 1405 raft_consensus.cc:515] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.205152 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0991def17b44b0d8e707d4deb64ecff" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:51.205416 785 raft_consensus.cc:3060] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.207226 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 5bae5be1340f4158a0b243415e232ae5 (DEFAULT_TABLE table=default.Table_5be814604c5549c786e2dfad1fd57cd8 [id=043c20ae78a943e0bbf1c9a6753261b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.208142 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 (DEFAULT_TABLE table=default.Table_6c3576d46ff5459cb3023b3c949bbf59 [id=1cf43945643240d2820b1de8551e394c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.209501 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 30e606b958d940c6a353a09a2eb627ee (DEFAULT_TABLE table=default.Table_51fd4ae0228a4f85a8c1850aa29b9f32 [id=6ae36ea0c1f740d983c6b27478be5665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.209946 1405 leader_election.cc:290] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.210742 1038 tablet_service.cc:1511] Processing CreateTablet for tablet aafe2a956b844c9998c84bbe52070e5d (DEFAULT_TABLE table=default.Table_06fee996690b44c3ad920d2090ceffa6 [id=129e814ff97d42f188d80f6418013bab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.202596 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e (DEFAULT_TABLE table=default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.212121 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1b92467a44737bfabb6ec1c924ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.212433 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bae5be1340f4158a0b243415e232ae5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:51.215472 859 leader_election.cc:343] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b0991def17b44b0d8e707d4deb64ecff
I20260619 19:53:51.215627 1201 tablet_bootstrap.cc:492] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:51.217027 1201 ts_tablet_manager.cc:1403] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.205s user 0.009s sys 0.009s
I20260619 19:53:51.219480 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4132f28c434492cbddc8da7d8075c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.219888 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafe2a956b844c9998c84bbe52070e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.220448 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea9f17d5e75499a8433fc9a3043a88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.202950 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (DEFAULT_TABLE table=default.Table_73c7fd0a90bd417bbeec5f8f4d751d91 [id=0206e06d5e5f4829aecf4be95ceea42d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.221735 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f8635b919a44a8a1e5fe48420ca4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.203536 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (DEFAULT_TABLE table=default.Table_0ae7f23fb2aa479d927ee98adabfeeb4 [id=eb99724694ef457287a4d0d0a263a0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.223450 785 raft_consensus.cc:2468] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:51.224018 858 leader_election.cc:304] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.224570 1405 raft_consensus.cc:2804] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:51.224768 1405 raft_consensus.cc:697] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:51.225142 1405 consensus_queue.cc:237] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.226109 1201 raft_consensus.cc:359] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.227903 903 tablet_service.cc:1511] Processing CreateTablet for tablet 906212dd25ef46f2b381ce6a99c39343 (DEFAULT_TABLE table=default.Table_17ad83fba0994578904672a32ee809a4 [id=64c1bcf3dc5048099e5aef869c6133f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.228355 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906212dd25ef46f2b381ce6a99c39343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.228379 1201 raft_consensus.cc:385] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.229157 1201 raft_consensus.cc:740] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.230815 1201 consensus_queue.cc:260] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.233079 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32665a93ee5b4f8290c79e2a1d4b1db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.233831 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e606b958d940c6a353a09a2eb627ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.235790 1201 ts_tablet_manager.cc:1434] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.018s user 0.002s sys 0.002s
I20260619 19:53:51.238234 1201 tablet_bootstrap.cc:492] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:51.244956 1208 tablet_bootstrap.cc:492] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.245764 1208 ts_tablet_manager.cc:1403] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.243s user 0.008s sys 0.012s
I20260619 19:53:51.248515 893 tablet_service.cc:1511] Processing CreateTablet for tablet e4132f28c434492cbddc8da7d8075c43 (DEFAULT_TABLE table=default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4 [id=a57b082016f14ff48e4194fcbd7b63c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.248858 762 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e (DEFAULT_TABLE table=default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.248994 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4132f28c434492cbddc8da7d8075c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.249274 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea9f17d5e75499a8433fc9a3043a88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.249540 1208 raft_consensus.cc:359] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.249754 1208 raft_consensus.cc:385] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.249830 1208 raft_consensus.cc:740] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.250108 1208 consensus_queue.cc:260] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.250651 1208 ts_tablet_manager.cc:1434] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260619 19:53:51.251040 1208 tablet_bootstrap.cc:492] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.253968 1200 tablet_bootstrap.cc:492] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.254145 1200 ts_tablet_manager.cc:1403] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.091s user 0.011s sys 0.000s
I20260619 19:53:51.256109 902 tablet_service.cc:1511] Processing CreateTablet for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (DEFAULT_TABLE table=default.Table_73c7fd0a90bd417bbeec5f8f4d751d91 [id=0206e06d5e5f4829aecf4be95ceea42d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.256598 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f8635b919a44a8a1e5fe48420ca4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.258913 900 tablet_service.cc:1511] Processing CreateTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e (DEFAULT_TABLE table=default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.259428 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea9f17d5e75499a8433fc9a3043a88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.260123 1201 tablet_bootstrap.cc:654] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.261723 1435 sys_catalog.cc:263] Verifying existing consensus state
I20260619 19:53:51.264235 831 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:51.264536 899 tablet_service.cc:1511] Processing CreateTablet for tablet aafe2a956b844c9998c84bbe52070e5d (DEFAULT_TABLE table=default.Table_06fee996690b44c3ad920d2090ceffa6 [id=129e814ff97d42f188d80f6418013bab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.264979 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafe2a956b844c9998c84bbe52070e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.267216 754 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 (DEFAULT_TABLE table=default.Table_6c3576d46ff5459cb3023b3c949bbf59 [id=1cf43945643240d2820b1de8551e394c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.267712 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1b92467a44737bfabb6ec1c924ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.270311 1435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Bootstrap starting.
I20260619 19:53:51.271215 764 tablet_service.cc:1511] Processing CreateTablet for tablet 30e606b958d940c6a353a09a2eb627ee (DEFAULT_TABLE table=default.Table_51fd4ae0228a4f85a8c1850aa29b9f32 [id=6ae36ea0c1f740d983c6b27478be5665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.271651 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e606b958d940c6a353a09a2eb627ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.275251 759 tablet_service.cc:1511] Processing CreateTablet for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (DEFAULT_TABLE table=default.Table_73c7fd0a90bd417bbeec5f8f4d751d91 [id=0206e06d5e5f4829aecf4be95ceea42d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.275792 765 tablet_service.cc:1511] Processing CreateTablet for tablet 5bae5be1340f4158a0b243415e232ae5 (DEFAULT_TABLE table=default.Table_5be814604c5549c786e2dfad1fd57cd8 [id=043c20ae78a943e0bbf1c9a6753261b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.276587 763 tablet_service.cc:1511] Processing CreateTablet for tablet aafe2a956b844c9998c84bbe52070e5d (DEFAULT_TABLE table=default.Table_06fee996690b44c3ad920d2090ceffa6 [id=129e814ff97d42f188d80f6418013bab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.276018 752 tablet_service.cc:1511] Processing CreateTablet for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (DEFAULT_TABLE table=default.Table_0ae7f23fb2aa479d927ee98adabfeeb4 [id=eb99724694ef457287a4d0d0a263a0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.277047 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f8635b919a44a8a1e5fe48420ca4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.277944 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 6baa466f30c2460697217f526fc4617f
I20260619 19:53:51.278498 597 catalog_manager.cc:6784] ReplaceTablet: tablet 6baa466f30c2460697217f526fc4617f deleted and replaced by tablet 33cfbae501de432cbcb34d2a6365f806
I20260619 19:53:51.279340 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bae5be1340f4158a0b243415e232ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.279696 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 7cd2fca96ee44cf297eb248b1f3ed00a
I20260619 19:53:51.280210 595 catalog_manager.cc:6784] ReplaceTablet: tablet 7cd2fca96ee44cf297eb248b1f3ed00a deleted and replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:53:51.282102 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 37393d7c16594032bf2a69abb0ab5931
I20260619 19:53:51.282610 602 catalog_manager.cc:6784] ReplaceTablet: tablet 37393d7c16594032bf2a69abb0ab5931 deleted and replaced by tablet a75baa585102481fa0ea01e87e394e32
I20260619 19:53:51.282778 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32665a93ee5b4f8290c79e2a1d4b1db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.283589 969 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:51.283967 601 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:53:51.284408 601 catalog_manager.cc:6784] ReplaceTablet: tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc deleted and replaced by tablet b7adec89ed984837a8cf3544679ca617
I20260619 19:53:51.284363 1435 log.cc:826] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Log is configured to *not* fsync() on all Append() calls
I20260619 19:53:51.284739 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_38edae940f8c454286821ba5a5703a7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.285306 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38edae940f8c454286821ba5a5703a7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.285400 899 tablet_service.cc:1511] Processing CreateTablet for tablet 5bae5be1340f4158a0b243415e232ae5 (DEFAULT_TABLE table=default.Table_5be814604c5549c786e2dfad1fd57cd8 [id=043c20ae78a943e0bbf1c9a6753261b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.285802 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bae5be1340f4158a0b243415e232ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.287106 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafe2a956b844c9998c84bbe52070e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.287266 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 1d0fe0c67fe84e5b866fd2553ea26d91
I20260619 19:53:51.287547 893 tablet_service.cc:1511] Processing CreateTablet for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (DEFAULT_TABLE table=default.Table_0ae7f23fb2aa479d927ee98adabfeeb4 [id=eb99724694ef457287a4d0d0a263a0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.287956 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32665a93ee5b4f8290c79e2a1d4b1db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.288017 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_ff9ca3289e4b45ba86c2ab483ea08d30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.288559 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff9ca3289e4b45ba86c2ab483ea08d30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.291306 903 tablet_service.cc:1511] Processing CreateTablet for tablet 30e606b958d940c6a353a09a2eb627ee (DEFAULT_TABLE table=default.Table_51fd4ae0228a4f85a8c1850aa29b9f32 [id=6ae36ea0c1f740d983c6b27478be5665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.291733 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e606b958d940c6a353a09a2eb627ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.282960 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5a8d285b403649bda850a2752754753b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.293150 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a8d285b403649bda850a2752754753b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.293892 761 tablet_service.cc:1511] Processing CreateTablet for tablet e4132f28c434492cbddc8da7d8075c43 (DEFAULT_TABLE table=default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4 [id=a57b082016f14ff48e4194fcbd7b63c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.294435 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4132f28c434492cbddc8da7d8075c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.294510 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 707af50da2ef469fb671df04cb72bb81
I20260619 19:53:51.295356 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_2a0e967a9ab24a16b767629e2c9c6529"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.295912 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a0e967a9ab24a16b767629e2c9c6529 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.301502 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6baa466f30c2460697217f526fc4617f with delete_type TABLET_DATA_DELETED (replaced by tablet 33cfbae501de432cbcb34d2a6365f806) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.302078 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.302268 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.302346 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 37393d7c16594032bf2a69abb0ab5931 with delete_type TABLET_DATA_DELETED (replaced by tablet a75baa585102481fa0ea01e87e394e32) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.302553 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.302738 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 707af50da2ef469fb671df04cb72bb81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.298207 900 tablet_service.cc:1511] Processing CreateTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 (DEFAULT_TABLE table=default.Table_6c3576d46ff5459cb3023b3c949bbf59 [id=1cf43945643240d2820b1de8551e394c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.305887 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e1b92467a44737bfabb6ec1c924ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.306986 1424 raft_consensus.cc:493] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.307050 604 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet c2c0afdcf96247b0a16c8f9ac71cc24a
I20260619 19:53:51.307286 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6baa466f30c2460697217f526fc4617f with delete_type TABLET_DATA_DELETED (replaced by tablet 33cfbae501de432cbcb34d2a6365f806) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.307929 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7d5f049a07fe4b8f9e0ea01960b23386"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.308586 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:51.310614 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 620f3a56e57e49b7b520012857e71187 has no consensus state
I20260619 19:53:51.311030 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5be814604c5549c786e2dfad1fd57cd8" } new_table_name: "default.Table_51eb31da347849a3a2e206fec7dbcee5" modify_external_catalogs: true
I20260619 19:53:51.313141 603 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 1bc12bcf50074b46860899a82dc0b46e
I20260619 19:53:51.313952 603 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_00a59df924104cdfa0cb0b3e4b9fd93b" } new_table_name: "default.Table_8e52c915643548ad8181928b723f114a" modify_external_catalogs: true
W20260619 19:53:51.321548 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6baa466f30c2460697217f526fc4617f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6baa466f30c2460697217f526fc4617f already in progress: creating tablet
W20260619 19:53:51.321832 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7cd2fca96ee44cf297eb248b1f3ed00a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cd2fca96ee44cf297eb248b1f3ed00a already in progress: creating tablet
W20260619 19:53:51.322019 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d0fe0c67fe84e5b866fd2553ea26d91 already in progress: creating tablet
W20260619 19:53:51.322194 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 37393d7c16594032bf2a69abb0ab5931 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37393d7c16594032bf2a69abb0ab5931 already in progress: creating tablet
W20260619 19:53:51.322365 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc already in progress: creating tablet
W20260619 19:53:51.322549 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 707af50da2ef469fb671df04cb72bb81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 707af50da2ef469fb671df04cb72bb81 already in progress: creating tablet
I20260619 19:53:51.323097 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.324159 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.324747 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 707af50da2ef469fb671df04cb72bb81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.325234 902 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.325748 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:51.326994 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1bc12bcf50074b46860899a82dc0b46e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bc12bcf50074b46860899a82dc0b46e already in progress: creating tablet
I20260619 19:53:51.328527 1108 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:51.329459 765 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
W20260619 19:53:51.330432 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6baa466f30c2460697217f526fc4617f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6baa466f30c2460697217f526fc4617f already in progress: creating tablet
I20260619 19:53:51.330286 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_09a6a4004a244d5087ee5476d0d28299"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.330968 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09a6a4004a244d5087ee5476d0d28299 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:51.331351 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d0fe0c67fe84e5b866fd2553ea26d91 already in progress: creating tablet
W20260619 19:53:51.331584 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 707af50da2ef469fb671df04cb72bb81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 707af50da2ef469fb671df04cb72bb81 already in progress: creating tablet
W20260619 19:53:51.331794 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet c2c0afdcf96247b0a16c8f9ac71cc24a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2c0afdcf96247b0a16c8f9ac71cc24a already in progress: creating tablet
W20260619 19:53:51.332031 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 1bc12bcf50074b46860899a82dc0b46e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bc12bcf50074b46860899a82dc0b46e already in progress: creating tablet
I20260619 19:53:51.332142 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 37393d7c16594032bf2a69abb0ab5931 with delete_type TABLET_DATA_DELETED (replaced by tablet a75baa585102481fa0ea01e87e394e32) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.332393 1379 raft_consensus.cc:493] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.332465 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.333575 1379 raft_consensus.cc:515] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.334313 1379 leader_election.cc:290] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:51.334533 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:51.335714 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 37393d7c16594032bf2a69abb0ab5931 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37393d7c16594032bf2a69abb0ab5931 already in progress: creating tablet
I20260619 19:53:51.336172 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 37393d7c16594032bf2a69abb0ab5931 with delete_type TABLET_DATA_DELETED (replaced by tablet a75baa585102481fa0ea01e87e394e32) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.336293 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:51.337143 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c2c0afdcf96247b0a16c8f9ac71cc24a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2c0afdcf96247b0a16c8f9ac71cc24a already in progress: creating tablet
W20260619 19:53:51.337487 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 7cd2fca96ee44cf297eb248b1f3ed00a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cd2fca96ee44cf297eb248b1f3ed00a already in progress: creating tablet
I20260619 19:53:51.337797 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 707af50da2ef469fb671df04cb72bb81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.337878 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f909c3a4f24827867f9b2d0ded907e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.338227 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.338619 1248 tablet_replica.cc:333] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.338816 1248 raft_consensus.cc:2243] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.339040 1248 raft_consensus.cc:2272] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.339290 764 tablet_service.cc:1558] Processing DeleteTablet for tablet fce3bcb89e664d9f867eb53e144e3304 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
W20260619 19:53:51.340051 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 37393d7c16594032bf2a69abb0ab5931 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37393d7c16594032bf2a69abb0ab5931 already in progress: creating tablet
I20260619 19:53:51.339522 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.339726 1248 ts_tablet_manager.cc:1916] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.340317 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.340350 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.340834 1208 tablet_bootstrap.cc:654] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.340881 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.341504 759 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
W20260619 19:53:51.341800 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc already in progress: creating tablet
I20260619 19:53:51.329121 1424 raft_consensus.cc:515] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:51.344331 996 leader_election.cc:343] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:51.344623 996 leader_election.cc:343] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:51.345019 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c2c0afdcf96247b0a16c8f9ac71cc24a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2c0afdcf96247b0a16c8f9ac71cc24a already in progress: creating tablet
W20260619 19:53:51.345280 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 707af50da2ef469fb671df04cb72bb81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 707af50da2ef469fb671df04cb72bb81 already in progress: creating tablet
I20260619 19:53:51.345490 996 leader_election.cc:304] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.346174 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 70716f209500400cae29b20ee1cb4882 with delete_type TABLET_DATA_DELETED (replaced by tablet d4771739543f4b4189b7d603f76325f0) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.346825 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.347025 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6baa466f30c2460697217f526fc4617f with delete_type TABLET_DATA_DELETED (replaced by tablet 33cfbae501de432cbcb34d2a6365f806) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.347374 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:51.348308 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 6baa466f30c2460697217f526fc4617f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6baa466f30c2460697217f526fc4617f already in progress: creating tablet
I20260619 19:53:51.349387 1379 raft_consensus.cc:2749] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.350009 1201 tablet_bootstrap.cc:492] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:51.350144 1331 tablet_replica.cc:333] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:51.350179 1201 ts_tablet_manager.cc:1403] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.001s
I20260619 19:53:51.350252 1248 ts_tablet_manager.cc:1929] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.350320 1331 raft_consensus.cc:2243] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.350381 1248 log.cc:1199] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/79f909c3a4f24827867f9b2d0ded907e
I20260619 19:53:51.350518 1331 raft_consensus.cc:2272] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.350999 1201 raft_consensus.cc:359] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.351161 1424 leader_election.cc:290] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.351229 1248 ts_tablet_manager.cc:1950] T 79f909c3a4f24827867f9b2d0ded907e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.351303 1201 raft_consensus.cc:385] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.351965 1331 ts_tablet_manager.cc:1916] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.352010 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea818ec12a3744f5b377a55f2693caed" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.351621 1201 raft_consensus.cc:740] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.353474 1248 tablet_replica.cc:333] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.353664 1248 raft_consensus.cc:2243] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.353832 1248 raft_consensus.cc:2272] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.353629 1201 consensus_queue.cc:260] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.354441 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 79f909c3a4f24827867f9b2d0ded907e (table default.Table_879260ad54894aa5839b8cb3df8f3e56 [id=a8af5f54c3914c7a8ec2dbcd606c75c3]) successfully deleted
I20260619 19:53:51.355075 1248 ts_tablet_manager.cc:1916] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.355489 1201 ts_tablet_manager.cc:1434] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:51.356688 1201 tablet_bootstrap.cc:492] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:51.358853 1331 ts_tablet_manager.cc:1929] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.358999 1331 log.cc:1199] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/70716f209500400cae29b20ee1cb4882
W20260619 19:53:51.359314 996 leader_election.cc:343] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:51.360495 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d0fe0c67fe84e5b866fd2553ea26d91 already in progress: creating tablet
I20260619 19:53:51.361316 1208 tablet_bootstrap.cc:492] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.361579 1208 ts_tablet_manager.cc:1403] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.111s user 0.003s sys 0.002s
I20260619 19:53:51.362026 1200 raft_consensus.cc:359] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.362242 1200 raft_consensus.cc:385] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.362334 1200 raft_consensus.cc:740] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.362744 1200 consensus_queue.cc:260] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.363046 1208 raft_consensus.cc:359] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.363473 1208 raft_consensus.cc:385] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.364121 1208 raft_consensus.cc:740] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.364542 1208 consensus_queue.cc:260] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.366313 1208 ts_tablet_manager.cc:1434] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:51.366993 1208 tablet_bootstrap.cc:492] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.367450 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea818ec12a3744f5b377a55f2693caed" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.368347 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_e4f08490c62f47249298bc6684dd80bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.368963 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4f08490c62f47249298bc6684dd80bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.369006 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.370790 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_516e7616f9ea454fbe587f5be52a3c55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.371451 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_516e7616f9ea454fbe587f5be52a3c55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.371908 1201 tablet_bootstrap.cc:654] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:51.372936 996 leader_election.cc:343] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.373093 996 leader_election.cc:304] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.373278 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_c89d6514dbcb43c0b65132772e18e5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:51.373584 1424 raft_consensus.cc:2749] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:51.373868 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c89d6514dbcb43c0b65132772e18e5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.375932 1200 ts_tablet_manager.cc:1434] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.122s user 0.002s sys 0.001s
I20260619 19:53:51.376097 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_ed51a352570c4c8bbd0801643773aca8" } new_table_name: "default.Table_add3279cce4944a1a6e56b997e6093e7" modify_external_catalogs: true
W20260619 19:53:51.377696 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bae5be1340f4158a0b243415e232ae5 consensus state has no leader
I20260619 19:53:51.378082 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_89c5f38b442e4e70869e688e61908787"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.378584 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89c5f38b442e4e70869e688e61908787 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.381354 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_51fd4ae0228a4f85a8c1850aa29b9f32" } new_table_name: "default.Table_c6ce6eae1a954a7092b9947edad827df" modify_external_catalogs: true
I20260619 19:53:51.382774 1208 tablet_bootstrap.cc:654] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.383577 595 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:51.383759 595 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 2 got 0
I20260619 19:53:51.385558 595 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5a7d4266ae434f74a819ed18281e9d27" } modify_external_catalogs: true
I20260619 19:53:51.385723 595 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5a7d4266ae434f74a819ed18281e9d27" } modify_external_catalogs: true
I20260619 19:53:51.387265 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da (DEFAULT_TABLE table=default.Table_66ddb27484c049a4a1043b72dd77d477 [id=1a15a941edb54adab68b83f9c30a77f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.387699 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3fa43017fa4c278111c29d0d22f7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.388038 599 master_service.cc:960] ReplaceTablet: received request to replace tablet 4e2f73871161488dbad7a19fc9e20b9c from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:51.388733 603 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2448429656934063887b63d9a6e79894 consensus state has no leader
I20260619 19:53:51.391068 601 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_3f9f0e46c5464e259bcede04d74cb03b [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]). Expected version 3 got 0
I20260619 19:53:51.391667 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 620f3a56e57e49b7b520012857e71187 (DEFAULT_TABLE table=default.Table_dab7592aa5c140918ba0451a9fc4c9f9 [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.392108 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620f3a56e57e49b7b520012857e71187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.394066 752 tablet_service.cc:1511] Processing CreateTablet for tablet 620f3a56e57e49b7b520012857e71187 (DEFAULT_TABLE table=default.Table_dab7592aa5c140918ba0451a9fc4c9f9 [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.394552 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620f3a56e57e49b7b520012857e71187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.395517 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (DEFAULT_TABLE table=default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b [id=57b57ad63a674bf08da4cf6d7bcd1b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.397919 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.399588 1248 ts_tablet_manager.cc:1929] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.399734 1248 log.cc:1199] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fce3bcb89e664d9f867eb53e144e3304
I20260619 19:53:51.400038 900 tablet_service.cc:1511] Processing CreateTablet for tablet 620f3a56e57e49b7b520012857e71187 (DEFAULT_TABLE table=default.Table_dab7592aa5c140918ba0451a9fc4c9f9 [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.400295 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da (DEFAULT_TABLE table=default.Table_66ddb27484c049a4a1043b72dd77d477 [id=1a15a941edb54adab68b83f9c30a77f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.400441 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 620f3a56e57e49b7b520012857e71187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.400693 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3fa43017fa4c278111c29d0d22f7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.402077 902 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.402382 1247 tablet_replica.cc:333] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:51.402580 1247 raft_consensus.cc:2243] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:51.402848 1247 pending_rounds.cc:70] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:51.402910 1247 pending_rounds.cc:77] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657612704440320 op_type: NO_OP noop_request { }
I20260619 19:53:51.403034 1247 raft_consensus.cc:2889] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:51.403124 1247 raft_consensus.cc:2272] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.403645 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 24916ace14294b1ea8f713d3fc876d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.403862 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da (DEFAULT_TABLE table=default.Table_66ddb27484c049a4a1043b72dd77d477 [id=1a15a941edb54adab68b83f9c30a77f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.403959 1247 ts_tablet_manager.cc:1916] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.404399 899 tablet_service.cc:1558] Processing DeleteTablet for tablet fbe3d9d2c43e4217b0429169ebfc3f43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.404825 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3fa43017fa4c278111c29d0d22f7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.404862 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 28e463032d0744cc88d011accbebfe1f (DEFAULT_TABLE table=default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.405261 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e463032d0744cc88d011accbebfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.407508 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 (DEFAULT_TABLE table=default.Table_e628fda622264f3eb2fdbfbffbf213cc [id=6db61c680af2412f8943d8fb98e9e7fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.408016 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b7b743e594e2aaeaeedd8613d9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.410081 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (DEFAULT_TABLE table=default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b [id=57b57ad63a674bf08da4cf6d7bcd1b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.410270 601 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet aca73f9ae5e94a29bdef0659082a2524 (table default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]). Expected version 1 got 0
I20260619 19:53:51.410537 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.411509 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.412015 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a (DEFAULT_TABLE table=default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.412439 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65f88b43b4e45c481aa7d43ef59fe7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.415762 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 297f07f2d08d47dfa69f845dadb973b1 (DEFAULT_TABLE table=default.Table_49472f6375c04623bbaba293eb98dd6f [id=8d6402c45a4d4456935a213be45b3c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.416205 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297f07f2d08d47dfa69f845dadb973b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.417356 1248 ts_tablet_manager.cc:1950] T fce3bcb89e664d9f867eb53e144e3304 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.418381 1248 tablet_replica.cc:333] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.418596 1248 raft_consensus.cc:2243] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.418776 1248 raft_consensus.cc:2272] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.419335 1248 ts_tablet_manager.cc:1916] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.419757 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 (DEFAULT_TABLE table=default.Table_18793f9a9a8d4535bbfff03c8b2bb59f [id=f6eb09cc59154cc7946ae43dc9e8a277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.420658 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467bb41a4e9f46e497726c6b29ddeb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.423777 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c (DEFAULT_TABLE table=default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.424235 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef20e35c612400bbbf1c707a36ced8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.427742 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2448429656934063887b63d9a6e79894 (DEFAULT_TABLE table=default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.427650 900 tablet_service.cc:1511] Processing CreateTablet for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (DEFAULT_TABLE table=default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b [id=57b57ad63a674bf08da4cf6d7bcd1b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.428280 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2448429656934063887b63d9a6e79894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.428524 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.432541 1248 ts_tablet_manager.cc:1929] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.432682 1248 log.cc:1199] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b0991def17b44b0d8e707d4deb64ecff
I20260619 19:53:51.433080 1248 ts_tablet_manager.cc:1950] T b0991def17b44b0d8e707d4deb64ecff P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.434293 903 tablet_service.cc:1511] Processing CreateTablet for tablet 28e463032d0744cc88d011accbebfe1f (DEFAULT_TABLE table=default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.434762 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e463032d0744cc88d011accbebfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.441309 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 24916ace14294b1ea8f713d3fc876d7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:48 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.441534 899 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 (DEFAULT_TABLE table=default.Table_e628fda622264f3eb2fdbfbffbf213cc [id=6db61c680af2412f8943d8fb98e9e7fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.441535 764 tablet_service.cc:1511] Processing CreateTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a (DEFAULT_TABLE table=default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.442005 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65f88b43b4e45c481aa7d43ef59fe7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.442050 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b7b743e594e2aaeaeedd8613d9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.443514 893 tablet_service.cc:1511] Processing CreateTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a (DEFAULT_TABLE table=default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.443945 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65f88b43b4e45c481aa7d43ef59fe7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.447505 901 tablet_service.cc:1511] Processing CreateTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 (DEFAULT_TABLE table=default.Table_18793f9a9a8d4535bbfff03c8b2bb59f [id=f6eb09cc59154cc7946ae43dc9e8a277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.447506 765 tablet_service.cc:1511] Processing CreateTablet for tablet 297f07f2d08d47dfa69f845dadb973b1 (DEFAULT_TABLE table=default.Table_49472f6375c04623bbaba293eb98dd6f [id=8d6402c45a4d4456935a213be45b3c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.447939 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467bb41a4e9f46e497726c6b29ddeb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.447968 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297f07f2d08d47dfa69f845dadb973b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.451498 902 tablet_service.cc:1511] Processing CreateTablet for tablet 297f07f2d08d47dfa69f845dadb973b1 (DEFAULT_TABLE table=default.Table_49472f6375c04623bbaba293eb98dd6f [id=8d6402c45a4d4456935a213be45b3c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.450452 754 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 (DEFAULT_TABLE table=default.Table_e628fda622264f3eb2fdbfbffbf213cc [id=6db61c680af2412f8943d8fb98e9e7fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.451953 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297f07f2d08d47dfa69f845dadb973b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.454625 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b7b743e594e2aaeaeedd8613d9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.458398 890 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c (DEFAULT_TABLE table=default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.459002 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef20e35c612400bbbf1c707a36ced8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.461441 1200 tablet_bootstrap.cc:492] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.333614 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.468165 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2448429656934063887b63d9a6e79894 (DEFAULT_TABLE table=default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.468609 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2448429656934063887b63d9a6e79894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.476111 765 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c (DEFAULT_TABLE table=default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.476393 1407 raft_consensus.cc:493] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.476594 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef20e35c612400bbbf1c707a36ced8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.476545 1407 raft_consensus.cc:515] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.477329 1407 leader_election.cc:290] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.478645 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a468ca001340e98addf91dd3829efa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:51.478857 1059 raft_consensus.cc:2468] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:51.480217 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.480285 720 leader_election.cc:304] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.480535 764 tablet_service.cc:1511] Processing CreateTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 (DEFAULT_TABLE table=default.Table_18793f9a9a8d4535bbfff03c8b2bb59f [id=f6eb09cc59154cc7946ae43dc9e8a277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.480798 1331 ts_tablet_manager.cc:1950] T 70716f209500400cae29b20ee1cb4882 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:51.481112 890 tablet_service.cc:1511] Processing CreateTablet for tablet 2448429656934063887b63d9a6e79894 (DEFAULT_TABLE table=default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.481519 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2448429656934063887b63d9a6e79894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.482335 1200 tablet_bootstrap.cc:654] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.484189 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a468ca001340e98addf91dd3829efa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.484438 921 raft_consensus.cc:2468] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:51.485350 1407 raft_consensus.cc:2804] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.485476 1407 raft_consensus.cc:493] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.485584 1407 raft_consensus.cc:3060] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.487419 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fce3bcb89e664d9f867eb53e144e3304 (table default.Table_672e6fc5aebe40efbc58e5631f43b344 [id=1f81b05e18de4ce08b8880942569bafa]) successfully deleted
I20260619 19:53:51.488842 752 tablet_service.cc:1511] Processing CreateTablet for tablet 28e463032d0744cc88d011accbebfe1f (DEFAULT_TABLE table=default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.490005 1247 ts_tablet_manager.cc:1929] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:51.490144 1247 log.cc:1199] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/b0991def17b44b0d8e707d4deb64ecff
I20260619 19:53:51.490765 1247 ts_tablet_manager.cc:1950] T b0991def17b44b0d8e707d4deb64ecff P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:51.491964 599 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_2e44172c64aa41b6aabeefb64c938a21" } modify_external_catalogs: true
I20260619 19:53:51.492188 599 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_2e44172c64aa41b6aabeefb64c938a21" } modify_external_catalogs: true
I20260619 19:53:51.498703 1200 tablet_bootstrap.cc:492] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.498944 1200 ts_tablet_manager.cc:1403] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.001s
I20260619 19:53:51.499774 1200 raft_consensus.cc:359] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.500070 1200 raft_consensus.cc:385] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.500176 1200 raft_consensus.cc:740] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.500505 1200 consensus_queue.cc:260] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.501179 1200 ts_tablet_manager.cc:1434] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:51.502871 1247 tablet_replica.cc:333] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:51.503108 1247 raft_consensus.cc:2243] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.503345 1247 raft_consensus.cc:2272] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.503939 1208 tablet_bootstrap.cc:492] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.503952 1247 ts_tablet_manager.cc:1916] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.504240 1208 ts_tablet_manager.cc:1403] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.137s user 0.012s sys 0.016s
I20260619 19:53:51.505115 1208 raft_consensus.cc:359] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.505427 1208 raft_consensus.cc:385] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.505584 1208 raft_consensus.cc:740] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.506634 1208 consensus_queue.cc:260] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.505930 1407 raft_consensus.cc:515] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.507398 1200 tablet_bootstrap.cc:492] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.509766 1200 tablet_bootstrap.cc:654] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.511889 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_43d3c7b37e664f8488c724a35db9191f" } modify_external_catalogs: true
I20260619 19:53:51.512022 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 70716f209500400cae29b20ee1cb4882 (table default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]) successfully deleted
I20260619 19:53:51.512136 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_43d3c7b37e664f8488c724a35db9191f" } modify_external_catalogs: true
W20260619 19:53:51.512917 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1bc12bcf50074b46860899a82dc0b46e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bc12bcf50074b46860899a82dc0b46e already in progress: creating tablet
W20260619 19:53:51.513551 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91e43148bb5b47128e08ed7faf8c7c1f consensus state has no leader
W20260619 19:53:51.513758 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7cd2fca96ee44cf297eb248b1f3ed00a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cd2fca96ee44cf297eb248b1f3ed00a already in progress: creating tablet
I20260619 19:53:51.514072 1331 tablet_replica.cc:333] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:53:51.514231 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30e606b958d940c6a353a09a2eb627ee consensus state has no leader
I20260619 19:53:51.514325 1331 raft_consensus.cc:2243] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.514520 1331 raft_consensus.cc:2272] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.514823 1424 raft_consensus.cc:493] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.515003 1424 raft_consensus.cc:515] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.515834 1424 leader_election.cc:290] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.516753 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_31acb6e850e140b09225f0905b1a5d8c" } modify_external_catalogs: true
I20260619 19:53:51.516774 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ee0b30259741cdb2fb0e3c815e6b17" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.516968 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_31acb6e850e140b09225f0905b1a5d8c" } modify_external_catalogs: true
W20260619 19:53:51.517473 996 leader_election.cc:343] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.520480 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_178fe18a009943389544ff741edba23c" } new_table_name: "default.Table_29f6e1631fc74719994ace470407f3e7" modify_external_catalogs: true
I20260619 19:53:51.523092 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ee0b30259741cdb2fb0e3c815e6b17" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:51.526218 996 leader_election.cc:343] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.526425 996 leader_election.cc:304] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.526960 1424 raft_consensus.cc:2749] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.528493 1331 ts_tablet_manager.cc:1916] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.529510 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_89c5f38b442e4e70869e688e61908787" } modify_external_catalogs: true
I20260619 19:53:51.529737 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_89c5f38b442e4e70869e688e61908787" } modify_external_catalogs: true
I20260619 19:53:51.532485 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 707af50da2ef469fb671df04cb72bb81 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.534080 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet d4771739543f4b4189b7d603f76325f0
I20260619 19:53:51.538107 1208 ts_tablet_manager.cc:1434] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.034s user 0.001s sys 0.009s
I20260619 19:53:51.539039 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.544727 1405 raft_consensus.cc:493] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.544931 1405 raft_consensus.cc:515] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.545032 1449 raft_consensus.cc:493] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.545228 1449 raft_consensus.cc:515] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.545679 1405 leader_election.cc:290] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.546599 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c889f13fbe49c3aab1e7f0d0d08e98" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.546798 785 raft_consensus.cc:2468] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:51.547256 858 leader_election.cc:304] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:51.547602 1200 tablet_bootstrap.cc:492] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.547567 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c889f13fbe49c3aab1e7f0d0d08e98" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:51.547827 1059 raft_consensus.cc:2468] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:51.547845 1200 ts_tablet_manager.cc:1403] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.041s user 0.010s sys 0.003s
I20260619 19:53:51.548151 1405 raft_consensus.cc:2804] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.548270 1405 raft_consensus.cc:493] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.548379 1405 raft_consensus.cc:3060] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.548882 1200 raft_consensus.cc:359] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.549055 1200 raft_consensus.cc:385] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.549137 1200 raft_consensus.cc:740] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.549393 1200 consensus_queue.cc:260] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.549633 1424 raft_consensus.cc:493] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.550248 1424 raft_consensus.cc:515] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.550706 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24916ace14294b1ea8f713d3fc876d7a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.550875 1424 leader_election.cc:290] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:51.551314 719 leader_election.cc:343] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:53:51.551594 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438ce37bb8ca4088b308a457b7f17041" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.551810 1200 ts_tablet_manager.cc:1434] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260619 19:53:51.551894 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438ce37bb8ca4088b308a457b7f17041" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.553110 595 master_service.cc:960] ReplaceTablet: received request to replace tablet b0991def17b44b0d8e707d4deb64ecff from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:51.552738 996 leader_election.cc:343] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:51.554704 996 leader_election.cc:343] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.554733 1405 raft_consensus.cc:515] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.554831 996 leader_election.cc:304] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:53:51.555063 720 leader_election.cc:343] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 24916ace14294b1ea8f713d3fc876d7a
I20260619 19:53:51.555222 720 leader_election.cc:304] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.555624 1424 raft_consensus.cc:2749] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.552093 1200 tablet_bootstrap.cc:492] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.555963 1405 leader_election.cc:290] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.557832 1200 tablet_bootstrap.cc:654] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.558418 1424 raft_consensus.cc:493] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.558578 1424 raft_consensus.cc:515] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:51.558482 590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 56332.8us
I20260619 19:53:51.559208 1424 leader_election.cc:290] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.559983 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c889f13fbe49c3aab1e7f0d0d08e98" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:51.560178 900 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.560218 785 raft_consensus.cc:3060] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.562371 1208 tablet_bootstrap.cc:492] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.564116 1208 tablet_bootstrap.cc:654] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.564061 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131ccb73ea1f4a7b8781c093ea2995d1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.564276 921 raft_consensus.cc:2468] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:51.565083 595 master_service.cc:960] ReplaceTablet: received request to replace tablet 37393d7c16594032bf2a69abb0ab5931 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.565733 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c889f13fbe49c3aab1e7f0d0d08e98" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:51.565966 1059 raft_consensus.cc:3060] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.566785 1201 tablet_bootstrap.cc:492] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:51.566975 1201 ts_tablet_manager.cc:1403] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.211s user 0.001s sys 0.003s
I20260619 19:53:51.567888 1201 raft_consensus.cc:359] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.568092 1201 raft_consensus.cc:385] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.568168 1201 raft_consensus.cc:740] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.568418 1201 consensus_queue.cc:260] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.568616 1200 tablet_bootstrap.cc:492] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.568781 1200 ts_tablet_manager.cc:1403] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20260619 19:53:51.569038 1201 ts_tablet_manager.cc:1434] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:51.569377 1201 tablet_bootstrap.cc:492] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:51.570210 996 leader_election.cc:304] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.570526 1424 raft_consensus.cc:2804] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.570612 1424 raft_consensus.cc:493] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.570705 1424 raft_consensus.cc:3060] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.571331 1201 tablet_bootstrap.cc:654] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.571395 1059 raft_consensus.cc:2468] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:51.572007 859 leader_election.cc:304] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.572723 1401 raft_consensus.cc:2804] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:51.572788 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.572858 1401 raft_consensus.cc:697] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:51.573101 1401 consensus_queue.cc:237] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.573493 1424 raft_consensus.cc:515] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.574100 1424 leader_election.cc:290] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.574905 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131ccb73ea1f4a7b8781c093ea2995d1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:51.575192 921 raft_consensus.cc:3060] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.577440 1200 raft_consensus.cc:359] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:51.578331 921 raft_consensus.cc:2468] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:51.579227 1248 tablet_replica.cc:333] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.579497 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e463032d0744cc88d011accbebfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.580129 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a468ca001340e98addf91dd3829efa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:51.580199 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a468ca001340e98addf91dd3829efa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:51.580355 923 raft_consensus.cc:3060] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.580385 1059 raft_consensus.cc:3060] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.578718 1200 raft_consensus.cc:385] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.580790 1200 raft_consensus.cc:740] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.583387 1059 raft_consensus.cc:2468] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:51.582442 1200 consensus_queue.cc:260] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:51.583559 996 leader_election.cc:304] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.583935 923 raft_consensus.cc:2468] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:51.584331 1424 raft_consensus.cc:2804] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:51.584503 1424 raft_consensus.cc:697] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:51.584739 1424 consensus_queue.cc:237] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.585482 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet b0991def17b44b0d8e707d4deb64ecff (table default.Table_3ed147ad3dd54cac8d31e443a31ae944 [id=d08fd6bb08ae4025a6e554581238c7ea]) successfully deleted
I20260619 19:53:51.586184 1200 ts_tablet_manager.cc:1434] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.017s user 0.003s sys 0.002s
I20260619 19:53:51.587210 1379 raft_consensus.cc:493] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.587404 1379 raft_consensus.cc:515] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.588135 1379 leader_election.cc:290] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.590660 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60324f7edaac45ed919be7e2368a4fd5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.592054 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7e1870963343443fac9b7d18ea95ac26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.592715 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e1870963343443fac9b7d18ea95ac26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:51.592880 996 leader_election.cc:343] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.593746 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131ccb73ea1f4a7b8781c093ea2995d1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:51.593784 785 raft_consensus.cc:2468] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:51.594189 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60324f7edaac45ed919be7e2368a4fd5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.594245 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_bd91ffa78d684545901aef8dfba81532" } new_table_name: "default.Table_d19624f3c0944eaaa5c1417bc0ebca2f" modify_external_catalogs: true
W20260619 19:53:51.594354 996 leader_election.cc:343] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:51.595110 996 leader_election.cc:343] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.595341 996 leader_election.cc:304] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.595773 1379 raft_consensus.cc:2749] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.601913 1200 tablet_bootstrap.cc:492] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.604113 1407 leader_election.cc:290] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.606020 1331 ts_tablet_manager.cc:1929] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.606017 720 leader_election.cc:304] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.607016 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "131ccb73ea1f4a7b8781c093ea2995d1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.608129 1248 raft_consensus.cc:2243] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:51.607753 996 leader_election.cc:343] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.619227 1331 log.cc:1199] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/ea818ec12a3744f5b377a55f2693caed
I20260619 19:53:51.622239 1435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260619 19:53:51.623581 1435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: Bootstrap complete.
I20260619 19:53:51.623518 1201 tablet_bootstrap.cc:492] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:51.624171 1201 ts_tablet_manager.cc:1403] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.007s
I20260619 19:53:51.628172 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467bb41a4e9f46e497726c6b29ddeb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.628232 1407 raft_consensus.cc:2749] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.628469 1248 raft_consensus.cc:2272] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.628479 1407 raft_consensus.cc:2804] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:51.628576 1331 ts_tablet_manager.cc:1950] T ea818ec12a3744f5b377a55f2693caed P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:51.629815 1407 raft_consensus.cc:697] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:51.630234 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet ea818ec12a3744f5b377a55f2693caed (table default.Table_82746ee331ef4c06bf7f1f322bcf1e1c [id=70e8c4fcd9c24e11af67b51e95c8434b]) successfully deleted
W20260619 19:53:51.630638 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc already in progress: creating tablet
W20260619 19:53:51.631197 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d4771739543f4b4189b7d603f76325f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4771739543f4b4189b7d603f76325f0 already in progress: creating tablet
I20260619 19:53:51.627977 1449 leader_election.cc:290] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.632637 1248 ts_tablet_manager.cc:1916] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.633078 1407 consensus_queue.cc:237] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.633204 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.655146 1200 tablet_bootstrap.cc:654] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.661317 1435 raft_consensus.cc:359] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 1 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:51.665510 1248 ts_tablet_manager.cc:1929] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.667297 1248 log.cc:1199] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:51.668319 1248 ts_tablet_manager.cc:1950] T fbe3d9d2c43e4217b0429169ebfc3f43 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.669405 1200 tablet_bootstrap.cc:492] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.669895 1200 ts_tablet_manager.cc:1403] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.069s user 0.008s sys 0.000s
I20260619 19:53:51.671468 1248 tablet_replica.cc:333] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:51.671705 1248 raft_consensus.cc:2243] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.672328 1248 raft_consensus.cc:2272] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.671890 1200 raft_consensus.cc:359] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:51.672582 1200 raft_consensus.cc:385] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.672768 1200 raft_consensus.cc:740] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.673269 1200 consensus_queue.cc:260] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:51.673961 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.674373 1248 ts_tablet_manager.cc:1916] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.680886 1200 ts_tablet_manager.cc:1434] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260619 19:53:51.683774 1200 tablet_bootstrap.cc:492] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.687484 1200 tablet_bootstrap.cc:654] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.695544 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet d97025f1e0634720bc68d0a6196bd20b
I20260619 19:53:51.696516 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_9608fb0beb2640e89ebfeceafaa4d82e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.697168 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9608fb0beb2640e89ebfeceafaa4d82e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:51.698501 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a690a4fdf60947acb271abe588d4b5c0 consensus state has no leader
I20260619 19:53:51.684098 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.698841 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_dab7592aa5c140918ba0451a9fc4c9f9" } new_table_name: "default.Table_3e4abf806ba34d899b138fb50dc5a60f" modify_external_catalogs: true
I20260619 19:53:51.703408 596 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 52b18248af87487590892c0f76080a1b
I20260619 19:53:51.703833 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_30ac9e6bf2a947009c67072b853bcf4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.711251 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30ac9e6bf2a947009c67072b853bcf4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.711385 1424 raft_consensus.cc:493] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.711553 1424 raft_consensus.cc:515] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.712263 1424 leader_election.cc:290] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.713492 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.714020 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:51.714332 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d97025f1e0634720bc68d0a6196bd20b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d97025f1e0634720bc68d0a6196bd20b already in progress: creating tablet
W20260619 19:53:51.714838 996 leader_election.cc:343] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.714922 900 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.716851 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b0991def17b44b0d8e707d4deb64ecff (table default.Table_3ed147ad3dd54cac8d31e443a31ae944 [id=d08fd6bb08ae4025a6e554581238c7ea]) successfully deleted
I20260619 19:53:51.718417 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fbe3d9d2c43e4217b0429169ebfc3f43 (table default.Table_625833f4158e43439f15da6d59ba1797 [id=b0b1af506cad4219965fd83f04e7e5b5]) successfully deleted
I20260619 19:53:51.719076 1201 raft_consensus.cc:359] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.719789 1201 raft_consensus.cc:385] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.719915 1201 raft_consensus.cc:740] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.724056 1435 raft_consensus.cc:740] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 031619d60e724837bd292c5ce23d0aff, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.724484 1247 ts_tablet_manager.cc:1929] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.724638 1247 log.cc:1199] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/24916ace14294b1ea8f713d3fc876d7a
I20260619 19:53:51.725112 1247 ts_tablet_manager.cc:1950] T 24916ace14294b1ea8f713d3fc876d7a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:51.725767 1435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:51.726418 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 24916ace14294b1ea8f713d3fc876d7a (table default.Table_795f746f2c61444fabf717551ba728e7 [id=49fc155330a542be88195064f2a6799e]) successfully deleted
I20260619 19:53:51.726836 1208 tablet_bootstrap.cc:492] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.727103 1200 tablet_bootstrap.cc:492] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:51.727430 1200 ts_tablet_manager.cc:1403] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.006s sys 0.000s
I20260619 19:53:51.728497 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.729403 1208 ts_tablet_manager.cc:1403] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.165s user 0.029s sys 0.014s
I20260619 19:53:51.729455 1200 raft_consensus.cc:359] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:51.729657 1200 raft_consensus.cc:385] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.729786 1200 raft_consensus.cc:740] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.730142 1200 consensus_queue.cc:260] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:51.732594 1201 consensus_queue.cc:260] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.733026 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:51.736730 1201 ts_tablet_manager.cc:1434] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.112s user 0.000s sys 0.003s
I20260619 19:53:51.737093 1201 tablet_bootstrap.cc:492] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:51.737478 1200 ts_tablet_manager.cc:1434] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:53:51.737865 1200 tablet_bootstrap.cc:492] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:51.740046 1200 tablet_bootstrap.cc:654] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.741196 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:51.745338 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 304e1eed89f54b809ac52efe2226dc35 consensus state has no leader
I20260619 19:53:51.745857 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7664c5ebb9804f838e732e7afc1b356b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.746543 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7664c5ebb9804f838e732e7afc1b356b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.748004 764 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.748338 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_91c55535580a45ac84980c9ba6792306"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:51.748196 1450 raft_consensus.cc:493] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:51.748961 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91c55535580a45ac84980c9ba6792306 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.749034 1450 raft_consensus.cc:515] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.749976 1450 leader_election.cc:290] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:51.750574 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 620f3a56e57e49b7b520012857e71187 consensus state has no leader
I20260619 19:53:51.750974 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_c775a92121304b789e5e4a1a08a165aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:51.751452 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:51.751591 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c775a92121304b789e5e4a1a08a165aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.751693 1059 raft_consensus.cc:2468] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:51.751929 1208 raft_consensus.cc:359] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.752130 1208 raft_consensus.cc:385] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.752213 1208 raft_consensus.cc:740] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.752452 1208 consensus_queue.cc:260] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.752605 720 leader_election.cc:304] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:51.752991 1208 ts_tablet_manager.cc:1434] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260619 19:53:51.753301 1208 tablet_bootstrap.cc:492] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.755820 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.756413 602 master_service.cc:960] ReplaceTablet: received request to replace tablet a2db4450a1a449b28f30933401ca0689 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.757715 782 raft_consensus.cc:2468] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:51.758201 1208 tablet_bootstrap.cc:654] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.758468 996 leader_election.cc:304] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:51.758940 1424 raft_consensus.cc:2804] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.759054 1424 raft_consensus.cc:493] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.759174 1424 raft_consensus.cc:3060] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.760308 1435 sys_catalog.cc:565] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: configured and running, proceeding with master startup.
I20260619 19:53:51.761030 1248 ts_tablet_manager.cc:1929] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:51.761165 1248 log.cc:1199] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/24916ace14294b1ea8f713d3fc876d7a
I20260619 19:53:51.761569 1248 ts_tablet_manager.cc:1950] T 24916ace14294b1ea8f713d3fc876d7a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:51.762203 1424 raft_consensus.cc:515] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.757211 1461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:51.763588 1461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:51.763883 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:51.766080 1208 tablet_bootstrap.cc:492] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.766294 1208 ts_tablet_manager.cc:1403] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260619 19:53:51.766944 1363 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:53:51.767342 1208 raft_consensus.cc:359] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.767599 1208 raft_consensus.cc:385] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.767679 1208 raft_consensus.cc:740] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.767973 1208 consensus_queue.cc:260] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.769491 1407 raft_consensus.cc:2804] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260619 19:53:51.770161 719 leader_election.cc:343] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.770324 1407 raft_consensus.cc:493] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.770386 1208 ts_tablet_manager.cc:1434] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260619 19:53:51.770463 1407 raft_consensus.cc:3060] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.770892 1208 tablet_bootstrap.cc:492] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.771310 1424 leader_election.cc:290] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:51.772085 996 leader_election.cc:343] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.772662 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:51.773365 1208 tablet_bootstrap.cc:654] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.780839 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 24916ace14294b1ea8f713d3fc876d7a (table default.Table_795f746f2c61444fabf717551ba728e7 [id=49fc155330a542be88195064f2a6799e]) successfully deleted
I20260619 19:53:51.773536 1407 raft_consensus.cc:515] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.781848 1407 leader_election.cc:290] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.783320 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:51.783627 1059 raft_consensus.cc:2393] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:53:51.785063 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca73f9ae5e94a29bdef0659082a2524" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:53:51.785693 719 leader_election.cc:343] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.785868 719 leader_election.cc:304] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:51.786149 1407 raft_consensus.cc:2749] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.786954 782 raft_consensus.cc:2393] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:51.792378 996 leader_election.cc:304] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.793668 1424 raft_consensus.cc:2749] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.780375 765 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:51.794194 831 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
W20260619 19:53:51.781215 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d4771739543f4b4189b7d603f76325f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4771739543f4b4189b7d603f76325f0 already in progress: creating tablet
I20260619 19:53:51.796424 1208 tablet_bootstrap.cc:492] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.796599 1208 ts_tablet_manager.cc:1403] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.002s
I20260619 19:53:51.797547 1208 raft_consensus.cc:359] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.797758 1208 raft_consensus.cc:385] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.797842 1208 raft_consensus.cc:740] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.800093 596 master_service.cc:960] ReplaceTablet: received request to replace tablet 438ce37bb8ca4088b308a457b7f17041 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.801519 601 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet aca73f9ae5e94a29bdef0659082a2524 (table default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]). Expected version 1 got 0
I20260619 19:53:51.803689 603 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 4 got 0
I20260619 19:53:51.804949 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f2b7aed4e720476cb97127ea1b58db50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.805572 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2b7aed4e720476cb97127ea1b58db50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.807348 1208 consensus_queue.cc:260] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.807559 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_c2dbeec92873437ab12eedf151dbd3ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.808079 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2dbeec92873437ab12eedf151dbd3ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.808107 1208 ts_tablet_manager.cc:1434] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s
I20260619 19:53:51.811002 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 71d212a279754f2497ad4fc2a3c8b5c3 (DEFAULT_TABLE table=default.Table_09a6a4004a244d5087ee5476d0d28299 [id=f58a91c6f29e4958b3de00addcb87fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.811640 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d212a279754f2497ad4fc2a3c8b5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.819011 1208 tablet_bootstrap.cc:492] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.820430 600 catalog_manager.cc:5696] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:51.821853 1208 tablet_bootstrap.cc:654] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.822645 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_873b6850a58041da8c91101a792a1c80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:51.824378 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_873b6850a58041da8c91101a792a1c80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.828405 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 12258d3bcc714f34857d7362c49ee787 (DEFAULT_TABLE table=default.Table_5a8d285b403649bda850a2752754753b [id=1bb7a7cd9bca4a98b3138955924f8eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.828493 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 221cc85629ca41e9ad71adfe0beb392a (DEFAULT_TABLE table=default.Table_ff9ca3289e4b45ba86c2ab483ea08d30 [id=96dda797fa474e119e765b5d9946bfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.828877 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12258d3bcc714f34857d7362c49ee787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.829113 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1fdec7ead34f9188d73507cf1c620a (DEFAULT_TABLE table=default.Table_38edae940f8c454286821ba5a5703a7f [id=388e0d04a45e495aa4e3bbc05802a988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.829505 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1fdec7ead34f9188d73507cf1c620a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.821862 600 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]). Expected version 1 got 0
I20260619 19:53:51.836694 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 376dfca0b54d4c689c96242566869717 (DEFAULT_TABLE table=default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.837074 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221cc85629ca41e9ad71adfe0beb392a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.837742 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 (DEFAULT_TABLE table=default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:51.837836 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d97025f1e0634720bc68d0a6196bd20b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d97025f1e0634720bc68d0a6196bd20b already in progress: creating tablet
I20260619 19:53:51.838138 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a686826694b49b9bb5bcdefd61c9a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.839425 764 tablet_service.cc:1511] Processing CreateTablet for tablet 12258d3bcc714f34857d7362c49ee787 (DEFAULT_TABLE table=default.Table_5a8d285b403649bda850a2752754753b [id=1bb7a7cd9bca4a98b3138955924f8eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.839826 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12258d3bcc714f34857d7362c49ee787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.842377 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 33cfbae501de432cbcb34d2a6365f806 (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.843180 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cfbae501de432cbcb34d2a6365f806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.844012 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376dfca0b54d4c689c96242566869717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.844048 900 tablet_service.cc:1511] Processing CreateTablet for tablet 12258d3bcc714f34857d7362c49ee787 (DEFAULT_TABLE table=default.Table_5a8d285b403649bda850a2752754753b [id=1bb7a7cd9bca4a98b3138955924f8eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.844466 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12258d3bcc714f34857d7362c49ee787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.855748 890 tablet_service.cc:1511] Processing CreateTablet for tablet 71d212a279754f2497ad4fc2a3c8b5c3 (DEFAULT_TABLE table=default.Table_09a6a4004a244d5087ee5476d0d28299 [id=f58a91c6f29e4958b3de00addcb87fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.856513 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d212a279754f2497ad4fc2a3c8b5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.859584 765 tablet_service.cc:1511] Processing CreateTablet for tablet 71d212a279754f2497ad4fc2a3c8b5c3 (DEFAULT_TABLE table=default.Table_09a6a4004a244d5087ee5476d0d28299 [id=f58a91c6f29e4958b3de00addcb87fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.860100 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d212a279754f2497ad4fc2a3c8b5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.866142 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b0991def17b44b0d8e707d4deb64ecff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:51.869105 899 tablet_service.cc:1511] Processing CreateTablet for tablet 221cc85629ca41e9ad71adfe0beb392a (DEFAULT_TABLE table=default.Table_ff9ca3289e4b45ba86c2ab483ea08d30 [id=96dda797fa474e119e765b5d9946bfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.869530 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221cc85629ca41e9ad71adfe0beb392a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.876199 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1fdec7ead34f9188d73507cf1c620a (DEFAULT_TABLE table=default.Table_38edae940f8c454286821ba5a5703a7f [id=388e0d04a45e495aa4e3bbc05802a988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.876828 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1fdec7ead34f9188d73507cf1c620a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.876957 1208 tablet_bootstrap.cc:492] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:51.877216 1208 ts_tablet_manager.cc:1403] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.058s user 0.025s sys 0.020s
I20260619 19:53:51.878394 1208 raft_consensus.cc:359] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.878662 1208 raft_consensus.cc:385] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:51.878743 1208 raft_consensus.cc:740] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:51.879117 1208 consensus_queue.cc:260] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.880168 1208 ts_tablet_manager.cc:1434] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260619 19:53:51.880782 1208 tablet_bootstrap.cc:492] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:51.883285 1208 tablet_bootstrap.cc:654] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:51.889704 764 tablet_service.cc:1511] Processing CreateTablet for tablet 221cc85629ca41e9ad71adfe0beb392a (DEFAULT_TABLE table=default.Table_ff9ca3289e4b45ba86c2ab483ea08d30 [id=96dda797fa474e119e765b5d9946bfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.890393 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221cc85629ca41e9ad71adfe0beb392a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.895097 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 (DEFAULT_TABLE table=default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.895293 902 tablet_service.cc:1511] Processing CreateTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 (DEFAULT_TABLE table=default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.895591 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a686826694b49b9bb5bcdefd61c9a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.895710 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a686826694b49b9bb5bcdefd61c9a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.903334 900 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1fdec7ead34f9188d73507cf1c620a (DEFAULT_TABLE table=default.Table_38edae940f8c454286821ba5a5703a7f [id=388e0d04a45e495aa4e3bbc05802a988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.903975 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1fdec7ead34f9188d73507cf1c620a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.908874 1424 raft_consensus.cc:493] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.909210 1424 raft_consensus.cc:515] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.910635 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da983715197847f18466d61f1eade0f5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:51.911605 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da983715197847f18466d61f1eade0f5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:51.912308 996 leader_election.cc:343] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:51.912559 996 leader_election.cc:343] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.912658 996 leader_election.cc:304] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.913035 1379 raft_consensus.cc:2749] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:51.913389 1424 leader_election.cc:290] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:51.916085 1037 tablet_service.cc:1511] Processing CreateTablet for tablet a75baa585102481fa0ea01e87e394e32 (DEFAULT_TABLE table=default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.916550 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75baa585102481fa0ea01e87e394e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.919850 1041 tablet_service.cc:1511] Processing CreateTablet for tablet b7adec89ed984837a8cf3544679ca617 (DEFAULT_TABLE table=default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.920324 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7adec89ed984837a8cf3544679ca617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.923547 1040 tablet_service.cc:1511] Processing CreateTablet for tablet ecbe466eee2f43359181a1d26d6e761e (DEFAULT_TABLE table=default.Table_2a0e967a9ab24a16b767629e2c9c6529 [id=f9c9368e00a44a3cba3399486f27f016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.923993 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbe466eee2f43359181a1d26d6e761e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.930514 902 tablet_service.cc:1511] Processing CreateTablet for tablet 33cfbae501de432cbcb34d2a6365f806 (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.931414 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cfbae501de432cbcb34d2a6365f806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.934068 754 tablet_service.cc:1511] Processing CreateTablet for tablet 33cfbae501de432cbcb34d2a6365f806 (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.934523 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cfbae501de432cbcb34d2a6365f806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.935514 899 tablet_service.cc:1511] Processing CreateTablet for tablet 376dfca0b54d4c689c96242566869717 (DEFAULT_TABLE table=default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.936019 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376dfca0b54d4c689c96242566869717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.939868 752 tablet_service.cc:1511] Processing CreateTablet for tablet 376dfca0b54d4c689c96242566869717 (DEFAULT_TABLE table=default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.940415 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376dfca0b54d4c689c96242566869717. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:51.944401 590 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a690a4fdf60947acb271abe588d4b5c0 consensus state has no leader
I20260619 19:53:51.945549 759 tablet_service.cc:1511] Processing CreateTablet for tablet a75baa585102481fa0ea01e87e394e32 (DEFAULT_TABLE table=default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.946133 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75baa585102481fa0ea01e87e394e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.954572 1401 raft_consensus.cc:493] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.954779 1401 raft_consensus.cc:515] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.955603 1401 leader_election.cc:290] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:51.956264 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:51.956804 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:51.957093 1059 raft_consensus.cc:2468] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:53:51.957345 858 leader_election.cc:343] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:51.957707 859 leader_election.cc:304] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:51.958041 1401 raft_consensus.cc:2804] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:51.958171 1401 raft_consensus.cc:493] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:51.958262 1401 raft_consensus.cc:3060] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:51.960990 754 tablet_service.cc:1511] Processing CreateTablet for tablet ecbe466eee2f43359181a1d26d6e761e (DEFAULT_TABLE table=default.Table_2a0e967a9ab24a16b767629e2c9c6529 [id=f9c9368e00a44a3cba3399486f27f016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:51.961483 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbe466eee2f43359181a1d26d6e761e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:51.966020 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet aca73f9ae5e94a29bdef0659082a2524
I20260619 19:53:51.966775 601 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_2b48c7db31f34a0a84074efaf7f997a3" } new_table_name: "default.Table_0bbd4672f505430eaf0de7479560b0ee" modify_external_catalogs: true
I20260619 19:53:51.966929 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_faa9be975d4742bf90dcee0feb53cc93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:51.967566 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet a2db4450a1a449b28f30933401ca0689
I20260619 19:53:51.968153 602 catalog_manager.cc:6784] ReplaceTablet: tablet a2db4450a1a449b28f30933401ca0689 deleted and replaced by tablet 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:53:51.968566 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_3f9f0e46c5464e259bcede04d74cb03b" } new_table_name: "default.Table_9229096a47ef4a3d912826fe42bda5b4" modify_external_catalogs: true
I20260619 19:53:51.969290 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet a2db4450a1a449b28f30933401ca0689 with delete_type TABLET_DATA_DELETED (replaced by tablet 42b0e811cf2a4bf4a23351f9ba5b6173) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.970422 1331 tablet_replica.cc:333] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:51.970641 1331 raft_consensus.cc:2243] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.970687 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 438ce37bb8ca4088b308a457b7f17041
I20260619 19:53:51.970886 1331 raft_consensus.cc:2272] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.971212 596 catalog_manager.cc:6784] ReplaceTablet: tablet 438ce37bb8ca4088b308a457b7f17041 deleted and replaced by tablet 9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:53:51.971540 1331 ts_tablet_manager.cc:1916] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.971499 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_573c9bb6dffe4624b4281ba8299a28c8" } modify_external_catalogs: true
I20260619 19:53:51.971684 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_573c9bb6dffe4624b4281ba8299a28c8" } modify_external_catalogs: true
I20260619 19:53:51.973398 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:53:51.973961 599 master_service.cc:960] ReplaceTablet: received request to replace tablet da983715197847f18466d61f1eade0f5 from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:51.975509 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faa9be975d4742bf90dcee0feb53cc93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:51.977774 597 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a3fa43017fa4c278111c29d0d22f7da from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.977931 1331 ts_tablet_manager.cc:1929] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:53:51.978070 1331 log.cc:1199] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a2db4450a1a449b28f30933401ca0689
I20260619 19:53:51.978544 1331 ts_tablet_manager.cc:1950] T a2db4450a1a449b28f30933401ca0689 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:51.979748 604 master_service.cc:960] ReplaceTablet: received request to replace tablet d29506dab4c84850ad79b8b7a0340987 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:51.979770 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet aca73f9ae5e94a29bdef0659082a2524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.980018 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.980214 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 438ce37bb8ca4088b308a457b7f17041 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c335fc5ca4885b5482c6b749f76f9) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:51.980938 1331 tablet_replica.cc:333] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:51.981264 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]) successfully deleted
I20260619 19:53:51.981199 1331 raft_consensus.cc:2243] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:51.981590 1331 raft_consensus.cc:2272] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:51.981935 603 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8874e3261467434cb5316f5024d06ce7" } modify_external_catalogs: true
I20260619 19:53:51.982117 603 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8874e3261467434cb5316f5024d06ce7" } modify_external_catalogs: true
I20260619 19:53:51.982239 1331 ts_tablet_manager.cc:1916] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:51.995771 1407 raft_consensus.cc:493] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:51.996027 1407 raft_consensus.cc:515] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:51.996999 1407 leader_election.cc:290] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:51.998245 720 leader_election.cc:343] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 70716f209500400cae29b20ee1cb4882
I20260619 19:53:51.998330 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_0ae7f23fb2aa479d927ee98adabfeeb4" } new_table_name: "default.Table_5ef20cd46a1d47c69c65a8a9aba25edf" modify_external_catalogs: true
I20260619 19:53:52.000761 595 catalog_manager.cc:5696] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:52.001492 595 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:52.002244 595 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 2 got 0
I20260619 19:53:52.004241 893 tablet_service.cc:1511] Processing CreateTablet for tablet a75baa585102481fa0ea01e87e394e32 (DEFAULT_TABLE table=default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.004621 903 tablet_service.cc:1511] Processing CreateTablet for tablet ecbe466eee2f43359181a1d26d6e761e (DEFAULT_TABLE table=default.Table_2a0e967a9ab24a16b767629e2c9c6529 [id=f9c9368e00a44a3cba3399486f27f016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.005035 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75baa585102481fa0ea01e87e394e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.005270 759 tablet_service.cc:1511] Processing CreateTablet for tablet b7adec89ed984837a8cf3544679ca617 (DEFAULT_TABLE table=default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.005815 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7adec89ed984837a8cf3544679ca617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.007355 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 6baa466f30c2460697217f526fc4617f with delete_type TABLET_DATA_DELETED (replaced by tablet 33cfbae501de432cbcb34d2a6365f806) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.007867 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 707af50da2ef469fb671df04cb72bb81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.008092 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.010784 1331 ts_tablet_manager.cc:1929] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.011268 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbe466eee2f43359181a1d26d6e761e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:52.018028 590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 57166.8us
I20260619 19:53:52.019312 1331 log.cc:1199] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/aca73f9ae5e94a29bdef0659082a2524
I20260619 19:53:52.020819 761 tablet_service.cc:1558] Processing DeleteTablet for tablet a2db4450a1a449b28f30933401ca0689 with delete_type TABLET_DATA_DELETED (replaced by tablet 42b0e811cf2a4bf4a23351f9ba5b6173) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.021238 1248 tablet_replica.cc:333] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.021538 1248 raft_consensus.cc:2243] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:52.021575 761 tablet_service.cc:1558] Processing DeleteTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.021984 1248 raft_consensus.cc:2272] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.022378 754 tablet_service.cc:1558] Processing DeleteTablet for tablet aca73f9ae5e94a29bdef0659082a2524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.022838 1248 ts_tablet_manager.cc:1916] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.023304 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 438ce37bb8ca4088b308a457b7f17041 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c335fc5ca4885b5482c6b749f76f9) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.024287 1331 ts_tablet_manager.cc:1950] T aca73f9ae5e94a29bdef0659082a2524 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:52.026070 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet aca73f9ae5e94a29bdef0659082a2524 (table default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]) successfully deleted
I20260619 19:53:52.028671 1331 tablet_replica.cc:333] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:53:52.028641 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a868706c23e948e5ba3320ceb4a19cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a868706c23e948e5ba3320ceb4a19cf8 already in progress: creating tablet
I20260619 19:53:52.030669 1331 raft_consensus.cc:2243] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.030920 1331 raft_consensus.cc:2272] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.031548 1331 ts_tablet_manager.cc:1916] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.032238 1401 raft_consensus.cc:515] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.032310 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70716f209500400cae29b20ee1cb4882" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.033104 1201 tablet_bootstrap.cc:654] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.033380 1401 leader_election.cc:290] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:52.033697 719 leader_election.cc:343] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.033895 719 leader_election.cc:304] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.032778 901 tablet_service.cc:1511] Processing CreateTablet for tablet b7adec89ed984837a8cf3544679ca617 (DEFAULT_TABLE table=default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.034449 898 tablet_service.cc:1558] Processing DeleteTablet for tablet aca73f9ae5e94a29bdef0659082a2524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.034588 1407 raft_consensus.cc:2749] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.035120 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:52.036615 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 438ce37bb8ca4088b308a457b7f17041 with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c335fc5ca4885b5482c6b749f76f9) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.037148 1248 ts_tablet_manager.cc:1929] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:53:52.037173 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7adec89ed984837a8cf3544679ca617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.037380 1248 log.cc:1199] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a2db4450a1a449b28f30933401ca0689
I20260619 19:53:52.037423 896 tablet_service.cc:1558] Processing DeleteTablet for tablet a2db4450a1a449b28f30933401ca0689 with delete_type TABLET_DATA_DELETED (replaced by tablet 42b0e811cf2a4bf4a23351f9ba5b6173) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.037665 891 tablet_service.cc:1558] Processing DeleteTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:52.038034 858 leader_election.cc:343] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.038499 1248 ts_tablet_manager.cc:1950] T a2db4450a1a449b28f30933401ca0689 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.044276 1248 tablet_replica.cc:333] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.044462 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:52.044759 1059 raft_consensus.cc:3060] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.045222 1248 raft_consensus.cc:2243] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.045497 1248 raft_consensus.cc:2272] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.048311 1248 ts_tablet_manager.cc:1916] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.048317 1059 raft_consensus.cc:2468] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:52.050110 859 leader_election.cc:304] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.051306 1401 raft_consensus.cc:2804] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.051473 1401 raft_consensus.cc:697] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:52.052143 1407 raft_consensus.cc:493] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.052325 1407 raft_consensus.cc:515] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.052434 1401 consensus_queue.cc:237] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.053126 1407 leader_election.cc:290] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.054461 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60324f7edaac45ed919be7e2368a4fd5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:52.054708 1059 raft_consensus.cc:2468] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:52.055380 720 leader_election.cc:304] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:52.055670 1407 raft_consensus.cc:2804] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.055804 1407 raft_consensus.cc:493] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.055895 1407 raft_consensus.cc:3060] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.056313 1200 tablet_bootstrap.cc:492] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.056450 1200 ts_tablet_manager.cc:1403] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.319s user 0.028s sys 0.065s
I20260619 19:53:52.056847 1247 tablet_replica.cc:333] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:52.058585 1200 raft_consensus.cc:359] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.058782 1200 raft_consensus.cc:385] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.058871 1200 raft_consensus.cc:740] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.058794 1407 raft_consensus.cc:515] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.059538 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60324f7edaac45ed919be7e2368a4fd5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.059089 1200 consensus_queue.cc:260] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.060708 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:52.061622 719 leader_election.cc:343] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.062563 1200 ts_tablet_manager.cc:1434] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:52.063215 1407 leader_election.cc:290] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.063828 1379 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.063982 1379 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.064281 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60324f7edaac45ed919be7e2368a4fd5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:52.064467 1059 raft_consensus.cc:3060] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.064649 1379 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.065573 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa466f30c2460697217f526fc4617f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:52.067411 996 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.067553 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa466f30c2460697217f526fc4617f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.067770 1059 raft_consensus.cc:2468] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:53:52.068130 996 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.068292 996 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.068796 1379 raft_consensus.cc:2749] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.068852 720 leader_election.cc:304] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:52.069140 1407 raft_consensus.cc:2804] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.069402 1407 raft_consensus.cc:697] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:52.069731 1407 consensus_queue.cc:237] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.081074 1247 raft_consensus.cc:2243] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:52.081403 1247 pending_rounds.cc:70] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:52.081346 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60324f7edaac45ed919be7e2368a4fd5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.081485 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]) successfully deleted
I20260619 19:53:52.081506 1247 pending_rounds.cc:77] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657612036784128 op_type: NO_OP noop_request { }
I20260619 19:53:52.081616 1247 raft_consensus.cc:2889] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:52.081907 1247 raft_consensus.cc:2272] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.082167 1108 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
W20260619 19:53:52.082113 719 leader_election.cc:343] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.082345 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:52.082572 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a868706c23e948e5ba3320ceb4a19cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a868706c23e948e5ba3320ceb4a19cf8 already in progress: creating tablet
I20260619 19:53:52.086580 1248 ts_tablet_manager.cc:1929] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.086808 1248 log.cc:1199] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/aca73f9ae5e94a29bdef0659082a2524
I20260619 19:53:52.089331 1247 ts_tablet_manager.cc:1916] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.090811 1201 tablet_bootstrap.cc:492] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:52.091109 1201 ts_tablet_manager.cc:1403] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.354s user 0.007s sys 0.011s
I20260619 19:53:52.095749 1208 tablet_bootstrap.cc:492] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.095918 1208 ts_tablet_manager.cc:1403] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.215s user 0.003s sys 0.070s
I20260619 19:53:52.096783 1208 raft_consensus.cc:359] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.096998 1208 raft_consensus.cc:385] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.097102 1208 raft_consensus.cc:740] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.097337 1208 consensus_queue.cc:260] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.097970 1201 raft_consensus.cc:359] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.098354 1200 tablet_bootstrap.cc:492] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.100868 1200 tablet_bootstrap.cc:654] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.101078 1201 raft_consensus.cc:385] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.101279 1201 raft_consensus.cc:740] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.101666 1201 consensus_queue.cc:260] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.102975 1450 raft_consensus.cc:493] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.103209 1450 raft_consensus.cc:515] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.103844 1450 leader_election.cc:290] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.104337 1201 ts_tablet_manager.cc:1434] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260619 19:53:52.104488 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438ce37bb8ca4088b308a457b7f17041" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.104713 923 raft_consensus.cc:2468] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:52.104899 1201 tablet_bootstrap.cc:492] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:52.105388 719 leader_election.cc:304] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:52.105749 1449 raft_consensus.cc:2804] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.105870 1449 raft_consensus.cc:493] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.105964 1449 raft_consensus.cc:3060] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.109269 1449 raft_consensus.cc:515] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.111223 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438ce37bb8ca4088b308a457b7f17041" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.111465 923 raft_consensus.cc:3060] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.112872 1201 tablet_bootstrap.cc:654] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.115042 923 raft_consensus.cc:2468] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:52.116041 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438ce37bb8ca4088b308a457b7f17041" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:53:52.116812 720 leader_election.cc:343] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:53:52.117063 1449 leader_election.cc:290] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.117643 719 leader_election.cc:304] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.118292 1449 raft_consensus.cc:2804] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.118577 1449 raft_consensus.cc:697] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:52.118897 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438ce37bb8ca4088b308a457b7f17041" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:52.119411 1449 consensus_queue.cc:237] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:52.120124 720 leader_election.cc:343] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:53:52.122435 1208 ts_tablet_manager.cc:1434] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.026s user 0.000s sys 0.002s
I20260619 19:53:52.122875 1208 tablet_bootstrap.cc:492] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.123921 1248 ts_tablet_manager.cc:1950] T aca73f9ae5e94a29bdef0659082a2524 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.126019 1331 ts_tablet_manager.cc:1929] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.127413 1208 tablet_bootstrap.cc:654] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:52.128010 601 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d29506dab4c84850ad79b8b7a0340987 consensus state has no leader
I20260619 19:53:52.129024 1248 tablet_replica.cc:333] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:53:52.129762 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33ee0b30259741cdb2fb0e3c815e6b17 consensus state has no leader
I20260619 19:53:52.131419 1247 ts_tablet_manager.cc:1929] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:52.131613 1247 log.cc:1199] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fbe3d9d2c43e4217b0429169ebfc3f43
I20260619 19:53:52.132181 602 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_2a0e967a9ab24a16b767629e2c9c6529" } modify_external_catalogs: true
I20260619 19:53:52.132269 1248 raft_consensus.cc:2243] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:52.132452 602 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_2a0e967a9ab24a16b767629e2c9c6529" } modify_external_catalogs: true
I20260619 19:53:52.133020 1248 pending_rounds.cc:70] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:53:52.133133 1248 pending_rounds.cc:77] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657616368562176 op_type: NO_OP noop_request { }
I20260619 19:53:52.133301 1248 raft_consensus.cc:2889] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:52.133459 1248 raft_consensus.cc:2272] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.134274 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet b7adec89ed984837a8cf3544679ca617
W20260619 19:53:52.134740 1485 consensus_queue.cc:1175] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260619 19:53:52.135149 1331 log.cc:1199] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/438ce37bb8ca4088b308a457b7f17041
I20260619 19:53:52.135244 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_46d92f291f484d6eb807a09bd023a3d0" } new_table_name: "default.Table_f17eeb5cd144427d8bf4066856809dfe" modify_external_catalogs: true
I20260619 19:53:52.135767 1331 ts_tablet_manager.cc:1950] T 438ce37bb8ca4088b308a457b7f17041 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:52.135946 1200 tablet_bootstrap.cc:492] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.136154 1200 ts_tablet_manager.cc:1403] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.001s
I20260619 19:53:52.136304 1208 tablet_bootstrap.cc:492] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.136473 1208 ts_tablet_manager.cc:1403] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.004s
I20260619 19:53:52.136946 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet da983715197847f18466d61f1eade0f5
I20260619 19:53:52.137147 1200 raft_consensus.cc:359] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.137358 1200 raft_consensus.cc:385] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.137405 599 catalog_manager.cc:6784] ReplaceTablet: tablet da983715197847f18466d61f1eade0f5 deleted and replaced by tablet a33cb04fdb8944e8817d51bd56806665
I20260619 19:53:52.137300 1208 raft_consensus.cc:359] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.137427 1200 raft_consensus.cc:740] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.137523 1208 raft_consensus.cc:385] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.137652 1208 raft_consensus.cc:740] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.137715 1200 consensus_queue.cc:260] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.137732 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f91630ed9b14431d9b472c3362f8cecf" } new_table_name: "default.Table_5e374217e35c4c1aae543439fcf83a5c" modify_external_catalogs: true
I20260619 19:53:52.137977 1208 consensus_queue.cc:260] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.138602 1208 ts_tablet_manager.cc:1434] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260619 19:53:52.138931 1208 tablet_bootstrap.cc:492] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.139400 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_62d0e0d461a74b99bac5c2251f7f7f63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.139555 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:52.139971 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62d0e0d461a74b99bac5c2251f7f7f63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.141188 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 2a3fa43017fa4c278111c29d0d22f7da
I20260619 19:53:52.141593 1208 tablet_bootstrap.cc:654] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.141657 597 catalog_manager.cc:6784] ReplaceTablet: tablet 2a3fa43017fa4c278111c29d0d22f7da deleted and replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51
I20260619 19:53:52.141996 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_64306ac3336a496b97becea891be9344"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.142561 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64306ac3336a496b97becea891be9344 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.143679 603 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 5f25c0378a6f4e9ea1a62d98f27778ee
I20260619 19:53:52.144343 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5315cb7e69284c01ab36267884d6abf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.144835 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5315cb7e69284c01ab36267884d6abf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.146963 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 438ce37bb8ca4088b308a457b7f17041 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]) successfully deleted
I20260619 19:53:52.147634 1247 ts_tablet_manager.cc:1950] T fbe3d9d2c43e4217b0429169ebfc3f43 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:52.148643 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.149600 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.149825 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet da983715197847f18466d61f1eade0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet a33cb04fdb8944e8817d51bd56806665) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.150059 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.150264 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.150619 1208 tablet_bootstrap.cc:492] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.150801 1208 ts_tablet_manager.cc:1403] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260619 19:53:52.151716 1208 raft_consensus.cc:359] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.151917 1208 raft_consensus.cc:385] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.152014 1208 raft_consensus.cc:740] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.152336 1208 consensus_queue.cc:260] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.152994 1200 ts_tablet_manager.cc:1434] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260619 19:53:52.153219 1208 ts_tablet_manager.cc:1434] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:52.153517 1208 tablet_bootstrap.cc:492] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.154345 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.156759 601 catalog_manager.cc:5696] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:52.157207 601 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 2 got 0
I20260619 19:53:52.157676 1208 tablet_bootstrap.cc:654] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.159013 1331 tablet_replica.cc:333] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:53:52.159086 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32665a93ee5b4f8290c79e2a1d4b1db1 consensus state has no leader
I20260619 19:53:52.160470 1401 raft_consensus.cc:493] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.160501 1449 raft_consensus.cc:493] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.160665 1401 raft_consensus.cc:515] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.160717 1449 raft_consensus.cc:515] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.161163 604 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet d29506dab4c84850ad79b8b7a0340987
I20260619 19:53:52.161388 1401 leader_election.cc:290] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.155965 1200 tablet_bootstrap.cc:492] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.161566 1449 leader_election.cc:290] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.161630 604 catalog_manager.cc:6784] ReplaceTablet: tablet d29506dab4c84850ad79b8b7a0340987 deleted and replaced by tablet 991c877feeae43c580d9471c25c4424c
I20260619 19:53:52.162020 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_ddb7644529644ea3ab7f8fcca9fdfc34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.162573 1247 tablet_replica.cc:333] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
W20260619 19:53:52.162624 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.161761 1331 raft_consensus.cc:2243] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.162892 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da983715197847f18466d61f1eade0f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:52.162983 1331 raft_consensus.cc:2272] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.163123 1059 raft_consensus.cc:2468] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:52.164170 720 leader_election.cc:304] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:52.164752 1200 tablet_bootstrap.cc:654] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.164842 1449 raft_consensus.cc:2804] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.164949 1449 raft_consensus.cc:493] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.165062 1449 raft_consensus.cc:3060] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.166795 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea818ec12a3744f5b377a55f2693caed" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.167069 782 raft_consensus.cc:2468] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:52.167655 1331 ts_tablet_manager.cc:1916] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.168282 1449 raft_consensus.cc:515] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.172729 1449 leader_election.cc:290] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.168870 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet d29506dab4c84850ad79b8b7a0340987 with delete_type TABLET_DATA_DELETED (replaced by tablet 991c877feeae43c580d9471c25c4424c) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.172528 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da983715197847f18466d61f1eade0f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:52.175495 1059 raft_consensus.cc:3060] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.173074 1200 tablet_bootstrap.cc:492] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.175938 1200 ts_tablet_manager.cc:1403] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260619 19:53:52.178576 1059 raft_consensus.cc:2468] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:52.179282 1208 tablet_bootstrap.cc:492] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.179414 720 leader_election.cc:304] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:52.179874 1449 raft_consensus.cc:2804] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.180043 1449 raft_consensus.cc:697] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:52.180313 1449 consensus_queue.cc:237] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.180750 1247 raft_consensus.cc:2243] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.180665 1424 consensus_queue.cc:1048] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.180953 1247 raft_consensus.cc:2272] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.181360 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da983715197847f18466d61f1eade0f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:52.181710 590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 61152.5us
W20260619 19:53:52.182156 719 leader_election.cc:343] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.182361 1247 ts_tablet_manager.cc:1916] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.182964 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.183257 762 tablet_service.cc:1558] Processing DeleteTablet for tablet da983715197847f18466d61f1eade0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet a33cb04fdb8944e8817d51bd56806665) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.183297 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.183552 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.183599 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da983715197847f18466d61f1eade0f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.183691 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
W20260619 19:53:52.183547 859 leader_election.cc:343] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: ea818ec12a3744f5b377a55f2693caed
I20260619 19:53:52.184129 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 70716f209500400cae29b20ee1cb4882 with delete_type TABLET_DATA_DELETED (replaced by tablet d4771739543f4b4189b7d603f76325f0) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.184590 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.185541 903 tablet_service.cc:1558] Processing DeleteTablet for tablet d29506dab4c84850ad79b8b7a0340987 with delete_type TABLET_DATA_DELETED (replaced by tablet 991c877feeae43c580d9471c25c4424c) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:52.185554 719 leader_election.cc:343] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.186115 858 leader_election.cc:304] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.186304 762 tablet_service.cc:1558] Processing DeleteTablet for tablet d29506dab4c84850ad79b8b7a0340987 with delete_type TABLET_DATA_DELETED (replaced by tablet 991c877feeae43c580d9471c25c4424c) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.189420 1401 raft_consensus.cc:2804] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.189561 1401 raft_consensus.cc:493] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.189694 1401 raft_consensus.cc:3060] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.192170 1200 raft_consensus.cc:359] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.192389 1200 raft_consensus.cc:385] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.192493 1200 raft_consensus.cc:740] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.192582 1401 raft_consensus.cc:515] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.192780 765 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.192791 1200 consensus_queue.cc:260] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.194343 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea818ec12a3744f5b377a55f2693caed" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:52.194581 782 raft_consensus.cc:3060] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.197813 1401 leader_election.cc:290] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.198156 782 raft_consensus.cc:2468] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:52.198213 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fbe3d9d2c43e4217b0429169ebfc3f43 (table default.Table_625833f4158e43439f15da6d59ba1797 [id=b0b1af506cad4219965fd83f04e7e5b5]) successfully deleted
W20260619 19:53:52.198752 859 leader_election.cc:343] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: ea818ec12a3744f5b377a55f2693caed
I20260619 19:53:52.199270 858 leader_election.cc:304] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.199728 1401 raft_consensus.cc:2804] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.199916 1401 raft_consensus.cc:697] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:52.200212 1401 consensus_queue.cc:237] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:52.202098 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d4771739543f4b4189b7d603f76325f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4771739543f4b4189b7d603f76325f0 already in progress: creating tablet
I20260619 19:53:52.202473 1248 ts_tablet_manager.cc:1916] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.179704 1208 ts_tablet_manager.cc:1403] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.004s
W20260619 19:53:52.204840 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d97025f1e0634720bc68d0a6196bd20b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d97025f1e0634720bc68d0a6196bd20b already in progress: creating tablet
I20260619 19:53:52.205160 1208 raft_consensus.cc:359] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.205493 1208 raft_consensus.cc:385] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.205614 1208 raft_consensus.cc:740] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.205986 1208 consensus_queue.cc:260] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.206816 1200 ts_tablet_manager.cc:1434] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260619 19:53:52.207182 1200 tablet_bootstrap.cc:492] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.207167 1208 ts_tablet_manager.cc:1434] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:52.207690 1208 tablet_bootstrap.cc:492] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.209117 1200 tablet_bootstrap.cc:654] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:52.209856 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b0991def17b44b0d8e707d4deb64ecff because the tablet was not found. No further retry: Not found: Tablet not found: b0991def17b44b0d8e707d4deb64ecff
I20260619 19:53:52.211436 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.212600 902 tablet_service.cc:1558] Processing DeleteTablet for tablet da983715197847f18466d61f1eade0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet a33cb04fdb8944e8817d51bd56806665) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.212646 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet aca73f9ae5e94a29bdef0659082a2524 (table default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]) successfully deleted
I20260619 19:53:52.201278 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_02d1f42490804c6ea53f8e922447bfc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.213512 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02d1f42490804c6ea53f8e922447bfc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.213732 1331 ts_tablet_manager.cc:1929] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.215111 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.216068 1247 ts_tablet_manager.cc:1929] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.216234 1247 log.cc:1199] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/aca73f9ae5e94a29bdef0659082a2524
I20260619 19:53:52.216674 1247 ts_tablet_manager.cc:1950] T aca73f9ae5e94a29bdef0659082a2524 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:52.217257 1247 tablet_replica.cc:333] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:52.217479 1247 raft_consensus.cc:2243] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.217716 1247 raft_consensus.cc:2272] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.218407 1247 ts_tablet_manager.cc:1916] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.219861 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet aca73f9ae5e94a29bdef0659082a2524 (table default.Table_43d3c7b37e664f8488c724a35db9191f [id=915737091f5d44598f193099d8f5f232]) successfully deleted
I20260619 19:53:52.223865 1208 tablet_bootstrap.cc:654] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.230528 1208 tablet_bootstrap.cc:492] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.230886 1208 ts_tablet_manager.cc:1403] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260619 19:53:52.232084 1208 raft_consensus.cc:359] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.233269 1208 raft_consensus.cc:385] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.233697 1208 raft_consensus.cc:740] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.234283 1208 consensus_queue.cc:260] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.236408 1208 ts_tablet_manager.cc:1434] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:52.236961 1208 tablet_bootstrap.cc:492] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.237308 1424 raft_consensus.cc:493] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.237520 1424 raft_consensus.cc:515] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.238652 1424 leader_election.cc:290] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.239435 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.239892 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:52.240509 996 leader_election.cc:343] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:52.240805 996 leader_election.cc:343] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.240926 996 leader_election.cc:304] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.241787 1424 raft_consensus.cc:2749] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.244177 1208 tablet_bootstrap.cc:654] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.245361 1201 tablet_bootstrap.cc:492] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:52.245555 1201 ts_tablet_manager.cc:1403] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.141s user 0.007s sys 0.012s
I20260619 19:53:52.246687 1201 raft_consensus.cc:359] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.246991 1201 raft_consensus.cc:385] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.247102 1201 raft_consensus.cc:740] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.247498 1201 consensus_queue.cc:260] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.248042 1201 ts_tablet_manager.cc:1434] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:52.248363 1201 tablet_bootstrap.cc:492] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:52.248556 1331 log.cc:1199] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/6baa466f30c2460697217f526fc4617f
I20260619 19:53:52.249177 1331 ts_tablet_manager.cc:1950] T 6baa466f30c2460697217f526fc4617f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:52.250217 969 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:52.252149 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 6baa466f30c2460697217f526fc4617f (table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]) successfully deleted
I20260619 19:53:52.252462 1208 tablet_bootstrap.cc:492] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.252625 1424 consensus_queue.cc:1048] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.252719 1208 ts_tablet_manager.cc:1403] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260619 19:53:52.254521 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:52.260861 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9be5cda43d0b4719a82f33a03e2261d3 consensus state has no leader
I20260619 19:53:52.262840 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf" } modify_external_catalogs: true
I20260619 19:53:52.263051 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf" } modify_external_catalogs: true
I20260619 19:53:52.263201 1331 tablet_replica.cc:333] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:52.263410 1331 raft_consensus.cc:2243] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.263610 1331 raft_consensus.cc:2272] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.264174 1331 ts_tablet_manager.cc:1916] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.264777 1208 raft_consensus.cc:359] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.265015 1208 raft_consensus.cc:385] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.265095 1208 raft_consensus.cc:740] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.265384 1208 consensus_queue.cc:260] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.265569 1379 raft_consensus.cc:493] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.265738 1379 raft_consensus.cc:515] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.266938 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.267156 1379 leader_election.cc:290] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:52.267472 996 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.267767 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:52.268363 996 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.268496 996 leader_election.cc:304] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.268934 1379 raft_consensus.cc:2749] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.267719 1208 ts_tablet_manager.cc:1434] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260619 19:53:52.269589 1208 tablet_bootstrap.cc:492] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:53:52.263419 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 732a2e073e3442ff873ca00be6106744 consensus state has no leader
I20260619 19:53:52.273469 1200 tablet_bootstrap.cc:492] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.273838 1200 ts_tablet_manager.cc:1403] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.000s
I20260619 19:53:52.274423 599 master_service.cc:960] ReplaceTablet: received request to replace tablet 620f3a56e57e49b7b520012857e71187 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:52.274847 1200 raft_consensus.cc:359] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.275121 1200 raft_consensus.cc:385] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.275272 1200 raft_consensus.cc:740] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.263962 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_03e300273881446b96748d3f1700e660"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.275619 1200 consensus_queue.cc:260] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:52.276682 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03e300273881446b96748d3f1700e660 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.264495 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e628fda622264f3eb2fdbfbffbf213cc" } modify_external_catalogs: true
I20260619 19:53:52.278039 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e628fda622264f3eb2fdbfbffbf213cc" } modify_external_catalogs: true
I20260619 19:53:52.265064 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_e170513f38a14ffcaceccb5ee9052c80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.279024 1208 tablet_bootstrap.cc:654] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:52.279322 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e170513f38a14ffcaceccb5ee9052c80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.280349 1200 ts_tablet_manager.cc:1434] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:52.266448 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_8d50f1b1ec814e8d85b077e1eb08a18c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.280779 1200 tablet_bootstrap.cc:492] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:52.280895 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d50f1b1ec814e8d85b077e1eb08a18c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.267033 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_38a961b0cc2946c7b79e57cd66fbe323"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.282455 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38a961b0cc2946c7b79e57cd66fbe323 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.282644 1200 tablet_bootstrap.cc:654] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.268584 600 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 4 got 0
I20260619 19:53:52.286430 600 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a6b5f1da20614838aac1a0175ad4a67d (table default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1]). Expected version 1 got 0
I20260619 19:53:52.286499 1449 raft_consensus.cc:493] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.286672 1449 raft_consensus.cc:515] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.270720 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet ecbe466eee2f43359181a1d26d6e761e
I20260619 19:53:52.287539 1449 leader_election.cc:290] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.288345 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.288570 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ee0b30259741cdb2fb0e3c815e6b17" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:52.288777 1059 raft_consensus.cc:2468] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:52.289997 720 leader_election.cc:304] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:52.290337 600 master_service.cc:960] ReplaceTablet: received request to replace tablet 5bae5be1340f4158a0b243415e232ae5 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:52.290395 1449 raft_consensus.cc:2804] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.290530 1449 raft_consensus.cc:493] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.290639 1449 raft_consensus.cc:3060] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.294144 1449 raft_consensus.cc:515] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.296119 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ee0b30259741cdb2fb0e3c815e6b17" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:52.296361 1059 raft_consensus.cc:3060] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.298327 602 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a6b5f1da20614838aac1a0175ad4a67d (table default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1]). Expected version 1 got 0
I20260619 19:53:52.299203 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ee0b30259741cdb2fb0e3c815e6b17" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.299443 923 raft_consensus.cc:2468] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:52.299715 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ee0b30259741cdb2fb0e3c815e6b17" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.300472 899 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.303479 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.304045 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.307287 1449 leader_election.cc:290] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.307571 1331 ts_tablet_manager.cc:1929] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.307751 1331 log.cc:1199] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/707af50da2ef469fb671df04cb72bb81
I20260619 19:53:52.308284 1331 ts_tablet_manager.cc:1950] T 707af50da2ef469fb671df04cb72bb81 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:52.309746 1331 tablet_replica.cc:333] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:52.310072 1331 raft_consensus.cc:2243] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.310294 1331 raft_consensus.cc:2272] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.310971 921 raft_consensus.cc:3060] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.311030 1331 ts_tablet_manager.cc:1916] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.311215 899 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.311637 1208 tablet_bootstrap.cc:492] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.311935 1208 ts_tablet_manager.cc:1403] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20260619 19:53:52.312680 1208 raft_consensus.cc:359] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.312877 1208 raft_consensus.cc:385] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.312987 1208 raft_consensus.cc:740] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.313292 1208 consensus_queue.cc:260] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.313799 1208 ts_tablet_manager.cc:1434] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:52.314138 1208 tablet_bootstrap.cc:492] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.319276 921 raft_consensus.cc:2468] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:52.319691 1208 tablet_bootstrap.cc:654] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.320019 719 leader_election.cc:304] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:52.321599 1449 raft_consensus.cc:2804] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.321943 1449 raft_consensus.cc:697] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:52.323503 1449 consensus_queue.cc:237] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.326551 1247 ts_tablet_manager.cc:1929] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.326687 1247 log.cc:1199] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/438ce37bb8ca4088b308a457b7f17041
I20260619 19:53:52.327062 1247 ts_tablet_manager.cc:1950] T 438ce37bb8ca4088b308a457b7f17041 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:52.328027 1247 tablet_replica.cc:333] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:52.328227 1247 raft_consensus.cc:2243] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.328415 1247 raft_consensus.cc:2272] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.328693 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 438ce37bb8ca4088b308a457b7f17041 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]) successfully deleted
I20260619 19:53:52.329644 1247 ts_tablet_manager.cc:1916] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.331766 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 707af50da2ef469fb671df04cb72bb81 (table default.Table_a4356f4b40cc4a4b8fdae91a4e687529 [id=288182d375434231a16e70f31f17f326]) successfully deleted
I20260619 19:53:52.335896 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet a75baa585102481fa0ea01e87e394e32
I20260619 19:53:52.336645 1247 ts_tablet_manager.cc:1929] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:53:52.336843 1247 log.cc:1199] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a2db4450a1a449b28f30933401ca0689
I20260619 19:53:52.337271 1247 ts_tablet_manager.cc:1950] T a2db4450a1a449b28f30933401ca0689 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:52.337734 759 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.339486 1247 tablet_replica.cc:333] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:52.339709 1247 raft_consensus.cc:2243] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:52.339995 1247 pending_rounds.cc:70] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:52.340083 1247 pending_rounds.cc:77] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657616694972416 op_type: NO_OP noop_request { }
I20260619 19:53:52.340274 899 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.340855 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet a2db4450a1a449b28f30933401ca0689 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]) successfully deleted
I20260619 19:53:52.341060 1201 tablet_bootstrap.cc:654] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:52.341358 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet a868706c23e948e5ba3320ceb4a19cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a868706c23e948e5ba3320ceb4a19cf8 already in progress: creating tablet
I20260619 19:53:52.341424 1059 raft_consensus.cc:2468] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:52.341720 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.341904 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
W20260619 19:53:52.342372 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2a3fa43017fa4c278111c29d0d22f7da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a3fa43017fa4c278111c29d0d22f7da already in progress: creating tablet
W20260619 19:53:52.342706 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 5f25c0378a6f4e9ea1a62d98f27778ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f25c0378a6f4e9ea1a62d98f27778ee already in progress: creating tablet
I20260619 19:53:52.340278 1247 raft_consensus.cc:2889] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:52.342909 1247 raft_consensus.cc:2272] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:53:52.343068 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d29506dab4c84850ad79b8b7a0340987 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d29506dab4c84850ad79b8b7a0340987 already in progress: creating tablet
W20260619 19:53:52.343418 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet da983715197847f18466d61f1eade0f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da983715197847f18466d61f1eade0f5 already in progress: creating tablet
W20260619 19:53:52.343709 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b7adec89ed984837a8cf3544679ca617 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7adec89ed984837a8cf3544679ca617 already in progress: creating tablet
I20260619 19:53:52.343865 1247 ts_tablet_manager.cc:1916] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.350785 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5023fdbc94ad42d1b931c6efb4e78679" } modify_external_catalogs: true
I20260619 19:53:52.351019 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5023fdbc94ad42d1b931c6efb4e78679" } modify_external_catalogs: true
I20260619 19:53:52.353248 1200 tablet_bootstrap.cc:492] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.353825 1200 ts_tablet_manager.cc:1403] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.073s user 0.000s sys 0.003s
I20260619 19:53:52.354171 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_6c3576d46ff5459cb3023b3c949bbf59" } new_table_name: "default.Table_fd5f53962cfd4900a0a79ba7de140a88" modify_external_catalogs: true
I20260619 19:53:52.354735 1200 raft_consensus.cc:359] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.354938 1200 raft_consensus.cc:385] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.355034 1200 raft_consensus.cc:740] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.355296 1200 consensus_queue.cc:260] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.355859 1200 ts_tablet_manager.cc:1434] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:52.356168 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.356632 1200 tablet_bootstrap.cc:492] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.358578 1200 tablet_bootstrap.cc:654] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.361915 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_96219489afdb43b891399da04a6bba32" } new_table_name: "default.Table_97bcd24488634ad1a7b636e894bd36f2" modify_external_catalogs: true
I20260619 19:53:52.362758 1331 ts_tablet_manager.cc:1929] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.362897 1331 log.cc:1199] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/60324f7edaac45ed919be7e2368a4fd5
I20260619 19:53:52.363349 1331 ts_tablet_manager.cc:1950] T 60324f7edaac45ed919be7e2368a4fd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:52.375399 1248 ts_tablet_manager.cc:1929] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:52.377347 1331 tablet_replica.cc:333] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:52.377601 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 60324f7edaac45ed919be7e2368a4fd5 (table default.Table_8526777c611949f8bebf5e9bc5b28b6f [id=de3457c27b2b4bdb8e37ac998bdcaeeb]) successfully deleted
I20260619 19:53:52.378327 1247 ts_tablet_manager.cc:1929] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:52.378508 1247 log.cc:1199] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/ea818ec12a3744f5b377a55f2693caed
I20260619 19:53:52.378966 1247 ts_tablet_manager.cc:1950] T ea818ec12a3744f5b377a55f2693caed P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:52.381870 1248 log.cc:1199] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/438ce37bb8ca4088b308a457b7f17041
I20260619 19:53:52.382517 1248 ts_tablet_manager.cc:1950] T 438ce37bb8ca4088b308a457b7f17041 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.383352 1331 raft_consensus.cc:2243] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.383597 1248 tablet_replica.cc:333] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.383975 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 438ce37bb8ca4088b308a457b7f17041 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]) successfully deleted
I20260619 19:53:52.384191 1248 raft_consensus.cc:2243] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:52.384452 1248 pending_rounds.cc:70] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
W20260619 19:53:52.384449 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2a3fa43017fa4c278111c29d0d22f7da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a3fa43017fa4c278111c29d0d22f7da already in progress: creating tablet
I20260619 19:53:52.384559 1248 pending_rounds.cc:77] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657616613146624 op_type: NO_OP noop_request { }
I20260619 19:53:52.384706 1248 raft_consensus.cc:2889] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:52.384848 1248 raft_consensus.cc:2272] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.386543 1248 ts_tablet_manager.cc:1916] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.389703 1331 raft_consensus.cc:2272] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.390501 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 620f3a56e57e49b7b520012857e71187
I20260619 19:53:52.391114 599 catalog_manager.cc:6784] ReplaceTablet: tablet 620f3a56e57e49b7b520012857e71187 deleted and replaced by tablet 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:53:52.391533 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.391691 1200 tablet_bootstrap.cc:492] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.391556 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_baef1a6b19f94884934f0c54a4dda5d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.391860 1200 ts_tablet_manager.cc:1403] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
W20260619 19:53:52.392189 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baef1a6b19f94884934f0c54a4dda5d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.392252 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.393144 1200 raft_consensus.cc:359] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.393383 1200 raft_consensus.cc:385] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.393467 1200 raft_consensus.cc:740] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.394179 1200 consensus_queue.cc:260] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.394326 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.394898 1200 ts_tablet_manager.cc:1434] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:52.395926 1200 tablet_bootstrap.cc:492] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.397774 1200 tablet_bootstrap.cc:654] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.399696 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.402148 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f" } modify_external_catalogs: true
I20260619 19:53:52.402365 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f" } modify_external_catalogs: true
I20260619 19:53:52.406334 1201 tablet_bootstrap.cc:492] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:52.408447 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet c9652b7e593c4c2597a1f9268d67b6d1
I20260619 19:53:52.409420 598 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9608fb0beb2640e89ebfeceafaa4d82e" } new_table_name: "default.Table_7ed722632f664c4f83d095f3acee831b" modify_external_catalogs: true
I20260619 19:53:52.409637 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c9652b7e593c4c2597a1f9268d67b6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.410497 1248 ts_tablet_manager.cc:1929] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:52.410622 1248 log.cc:1199] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/da983715197847f18466d61f1eade0f5
I20260619 19:53:52.411653 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet c9652b7e593c4c2597a1f9268d67b6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:52.413354 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40e1b92467a44737bfabb6ec1c924ea1 consensus state has no leader
I20260619 19:53:52.413786 596 master_service.cc:960] ReplaceTablet: received request to replace tablet 68746ca7888e4af891238f79dcfdde10 from {username='slave'} at 127.0.0.1:51756
W20260619 19:53:52.414894 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 108f1b2e9ec74271889ffff65d8e852e consensus state has no leader
I20260619 19:53:52.415338 595 master_service.cc:960] ReplaceTablet: received request to replace tablet 467bb41a4e9f46e497726c6b29ddeb04 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:52.417481 599 master_service.cc:960] ReplaceTablet: received request to replace tablet 620f3a56e57e49b7b520012857e71187 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:52.410132 899 tablet_service.cc:1558] Processing DeleteTablet for tablet c9652b7e593c4c2597a1f9268d67b6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.419070 1201 ts_tablet_manager.cc:1403] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.171s user 0.002s sys 0.002s
I20260619 19:53:52.419893 1248 ts_tablet_manager.cc:1950] T da983715197847f18466d61f1eade0f5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.419975 1201 raft_consensus.cc:359] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.420938 1208 tablet_bootstrap.cc:492] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.421157 1208 ts_tablet_manager.cc:1403] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.107s user 0.007s sys 0.015s
I20260619 19:53:52.422025 1208 raft_consensus.cc:359] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.422335 1208 raft_consensus.cc:385] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.422477 1208 raft_consensus.cc:740] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.422902 1208 consensus_queue.cc:260] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.425079 1208 ts_tablet_manager.cc:1434] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:52.425498 1208 tablet_bootstrap.cc:492] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.428236 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet da983715197847f18466d61f1eade0f5 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]) successfully deleted
W20260619 19:53:52.428582 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5f25c0378a6f4e9ea1a62d98f27778ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f25c0378a6f4e9ea1a62d98f27778ee already in progress: creating tablet
I20260619 19:53:52.428651 1248 tablet_replica.cc:333] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.428877 1248 raft_consensus.cc:2243] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.430054 1248 raft_consensus.cc:2272] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.430670 1248 ts_tablet_manager.cc:1916] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.430820 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.429867 1208 tablet_bootstrap.cc:654] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.434158 1201 raft_consensus.cc:385] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.435701 1200 tablet_bootstrap.cc:492] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.434204 1401 consensus_queue.cc:1048] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.435827 602 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 732a2e073e3442ff873ca00be6106744 (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:53:52.435904 1200 ts_tablet_manager.cc:1403] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.001s
I20260619 19:53:52.436043 602 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]). Expected version 4 got 0
I20260619 19:53:52.438308 603 catalog_manager.cc:5696] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:52.438768 603 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 4 got 0
I20260619 19:53:52.439040 603 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]). Expected version 4 got 0
I20260619 19:53:52.440889 759 tablet_service.cc:1558] Processing DeleteTablet for tablet da983715197847f18466d61f1eade0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet a33cb04fdb8944e8817d51bd56806665) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.442111 899 tablet_service.cc:1511] Processing CreateTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb (DEFAULT_TABLE table=default.Table_9608fb0beb2640e89ebfeceafaa4d82e [id=02f9b7422ad049e19c6d57b58f7fbc96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.442231 1201 raft_consensus.cc:740] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.442636 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33935217c1f44ce0ad5b8610d368f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.442709 1201 consensus_queue.cc:260] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.448069 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.448225 1201 ts_tablet_manager.cc:1434] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260619 19:53:52.448812 1201 tablet_bootstrap.cc:492] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:52.451035 759 tablet_service.cc:1511] Processing CreateTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb (DEFAULT_TABLE table=default.Table_9608fb0beb2640e89ebfeceafaa4d82e [id=02f9b7422ad049e19c6d57b58f7fbc96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.451509 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33935217c1f44ce0ad5b8610d368f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.456861 1401 consensus_queue.cc:1048] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.458178 1201 tablet_bootstrap.cc:654] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.461989 1379 raft_consensus.cc:493] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.462188 1379 raft_consensus.cc:515] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.463454 1379 leader_election.cc:290] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:52.464213 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.464217 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.464444 785 raft_consensus.cc:2468] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:52.464848 996 leader_election.cc:304] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:52.465202 996 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.465685 1379 raft_consensus.cc:2804] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.465737 1208 tablet_bootstrap.cc:492] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.465813 1379 raft_consensus.cc:493] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.465871 1208 ts_tablet_manager.cc:1403] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260619 19:53:52.465900 1379 raft_consensus.cc:3060] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.466620 1208 raft_consensus.cc:359] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.466804 1208 raft_consensus.cc:385] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.466881 1208 raft_consensus.cc:740] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.467098 1208 consensus_queue.cc:260] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.467682 1208 ts_tablet_manager.cc:1434] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:52.468096 1208 tablet_bootstrap.cc:492] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.468652 1379 raft_consensus.cc:515] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.470940 1248 ts_tablet_manager.cc:1929] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.476322 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.476703 1248 log.cc:1199] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/70716f209500400cae29b20ee1cb4882
I20260619 19:53:52.472793 1449 consensus_queue.cc:1048] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.473980 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:52.475546 784 raft_consensus.cc:3060] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:52.477203 996 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.477275 785 raft_consensus.cc:3060] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.477591 1379 leader_election.cc:290] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:52.480288 785 raft_consensus.cc:2468] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:52.480875 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb (DEFAULT_TABLE table=default.Table_9608fb0beb2640e89ebfeceafaa4d82e [id=02f9b7422ad049e19c6d57b58f7fbc96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.482537 899 tablet_service.cc:1511] Processing CreateTablet for tablet e3031a45cf534814bbece8d271c0420e (DEFAULT_TABLE table=default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.483079 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3031a45cf534814bbece8d271c0420e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.483661 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33935217c1f44ce0ad5b8610d368f2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.485462 1200 raft_consensus.cc:359] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.485688 1200 raft_consensus.cc:385] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.485807 1200 raft_consensus.cc:740] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.471966 1208 tablet_bootstrap.cc:654] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.490829 1248 ts_tablet_manager.cc:1950] T 70716f209500400cae29b20ee1cb4882 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.491098 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.492309 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_fa6e27c7a16c411e91a2913fda307afb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.493986 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa6e27c7a16c411e91a2913fda307afb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.495434 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 70716f209500400cae29b20ee1cb4882 (table default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]) successfully deleted
I20260619 19:53:52.495538 996 leader_election.cc:304] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:52.495227 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e8a37cf077e54a94804ae31d3a54650d" } new_table_name: "default.Table_06a592321d9b45b1b878d51b17c448c6" modify_external_catalogs: true
I20260619 19:53:52.498481 1379 raft_consensus.cc:2804] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.499869 1424 consensus_queue.cc:1048] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.502121 1248 tablet_replica.cc:333] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.504070 1248 raft_consensus.cc:2243] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:52.505967 1248 pending_rounds.cc:70] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:53:52.508257 1200 consensus_queue.cc:260] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.508674 1424 raft_consensus.cc:493] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.507438 1248 pending_rounds.cc:77] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657616160415744 op_type: NO_OP noop_request { }
I20260619 19:53:52.508855 1248 raft_consensus.cc:2889] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:52.508904 1200 ts_tablet_manager.cc:1434] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.073s user 0.002s sys 0.000s
I20260619 19:53:52.508877 1424 raft_consensus.cc:515] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.508986 1248 raft_consensus.cc:2272] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.509202 1200 tablet_bootstrap.cc:492] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.509753 1424 leader_election.cc:290] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.510385 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:52.511389 996 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.511380 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:52.511914 996 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.512122 996 leader_election.cc:304] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.512570 1424 raft_consensus.cc:2749] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.514436 1248 ts_tablet_manager.cc:1916] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.523659 1379 raft_consensus.cc:697] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:52.524142 1379 consensus_queue.cc:237] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.525430 831 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:52.526930 1331 ts_tablet_manager.cc:1916] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.532388 759 tablet_service.cc:1511] Processing CreateTablet for tablet e3031a45cf534814bbece8d271c0420e (DEFAULT_TABLE table=default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.533082 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3031a45cf534814bbece8d271c0420e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.534020 1040 tablet_service.cc:1511] Processing CreateTablet for tablet e3031a45cf534814bbece8d271c0420e (DEFAULT_TABLE table=default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.542359 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c (DEFAULT_TABLE table=default.Table_e4f08490c62f47249298bc6684dd80bb [id=7018bca0519c45289b5131c3e4484774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.542924 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.543429 1449 raft_consensus.cc:493] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.543612 1449 raft_consensus.cc:515] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.544414 1449 leader_election.cc:290] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:52.545418 720 leader_election.cc:343] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 707af50da2ef469fb671df04cb72bb81
I20260619 19:53:52.534209 1200 tablet_bootstrap.cc:654] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.547297 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707af50da2ef469fb671df04cb72bb81" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:52.548390 719 leader_election.cc:343] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.548569 719 leader_election.cc:304] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.548977 1407 consensus_queue.cc:1048] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:52.549189 1363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56874 (request call id 0) took 1373 ms. Trace:
I20260619 19:53:52.549520 1407 raft_consensus.cc:2749] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.549799 1502 raft_consensus.cc:493] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d38b77ff37948e19592b36b6d884fe0)
I20260619 19:53:52.550077 1502 raft_consensus.cc:515] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:52.552045 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet ea818ec12a3744f5b377a55f2693caed (table default.Table_82746ee331ef4c06bf7f1f322bcf1e1c [id=70e8c4fcd9c24e11af67b51e95c8434b]) successfully deleted
W20260619 19:53:52.553057 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ecbe466eee2f43359181a1d26d6e761e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecbe466eee2f43359181a1d26d6e761e already in progress: creating tablet
I20260619 19:53:52.552949 1461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d38b77ff37948e19592b36b6d884fe0. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:52.553251 1461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: FOLLOWER
W20260619 19:53:52.553648 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet a75baa585102481fa0ea01e87e394e32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75baa585102481fa0ea01e87e394e32 already in progress: creating tablet
I20260619 19:53:52.563512 1248 ts_tablet_manager.cc:1929] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:52.563707 1248 log.cc:1199] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/60324f7edaac45ed919be7e2368a4fd5
I20260619 19:53:52.564010 1502 leader_election.cc:290] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:52.564188 1248 ts_tablet_manager.cc:1950] T 60324f7edaac45ed919be7e2368a4fd5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.565014 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 60324f7edaac45ed919be7e2368a4fd5 (table default.Table_8526777c611949f8bebf5e9bc5b28b6f [id=de3457c27b2b4bdb8e37ac998bdcaeeb]) successfully deleted
I20260619 19:53:52.573740 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c (DEFAULT_TABLE table=default.Table_e4f08490c62f47249298bc6684dd80bb [id=7018bca0519c45289b5131c3e4484774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.574349 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:52.581728 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d29506dab4c84850ad79b8b7a0340987 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d29506dab4c84850ad79b8b7a0340987 already in progress: creating tablet
W20260619 19:53:52.583884 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b7adec89ed984837a8cf3544679ca617 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7adec89ed984837a8cf3544679ca617 already in progress: creating tablet
I20260619 19:53:52.585280 1248 tablet_replica.cc:333] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.585764 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 2d1b7b743e594e2aaeaeedd8613d9789
I20260619 19:53:52.587077 1248 raft_consensus.cc:2243] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.587951 597 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]). Expected version 2 got 0
I20260619 19:53:52.588135 1200 tablet_bootstrap.cc:492] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.588191 1248 raft_consensus.cc:2272] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.589112 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 5bae5be1340f4158a0b243415e232ae5
I20260619 19:53:52.589723 600 catalog_manager.cc:6784] ReplaceTablet: tablet 5bae5be1340f4158a0b243415e232ae5 deleted and replaced by tablet 55684b109a03488a88efd45a067159a0
I20260619 19:53:52.590108 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a88e7ac803114a2798fdbbc76e8b41c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.590659 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:32994
W20260619 19:53:52.590889 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a88e7ac803114a2798fdbbc76e8b41c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.591939 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.592043 1248 ts_tablet_manager.cc:1916] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:52.592466 598 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33935217c1f44ce0ad5b8610d368f2eb consensus state has no leader
I20260619 19:53:52.593003 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_287609e30d09421a9d7a5126eef7ad2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.593789 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_287609e30d09421a9d7a5126eef7ad2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.595894 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_30932010f9e54c029a0c57b5c379957e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.596295 1424 consensus_queue.cc:1048] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:53:52.597121 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30932010f9e54c029a0c57b5c379957e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.599107 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.599634 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.600308 1379 raft_consensus.cc:493] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:52.601234 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 620f3a56e57e49b7b520012857e71187 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 620f3a56e57e49b7b520012857e71187 already in progress: creating tablet
I20260619 19:53:52.601755 1247 tablet_replica.cc:333] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:52.603529 1247 raft_consensus.cc:2243] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.603911 1247 raft_consensus.cc:2272] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.604605 1247 ts_tablet_manager.cc:1916] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.611122 1401 raft_consensus.cc:493] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.611420 1401 raft_consensus.cc:515] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.612339 1401 leader_election.cc:290] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:52.613548 858 leader_election.cc:343] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 70716f209500400cae29b20ee1cb4882
W20260619 19:53:52.613739 859 leader_election.cc:343] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 70716f209500400cae29b20ee1cb4882
I20260619 19:53:52.613898 859 leader_election.cc:304] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.614341 1401 raft_consensus.cc:2749] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.626494 902 tablet_service.cc:1511] Processing CreateTablet for tablet c83c093717ef4424b56d49e2689a6d0b (DEFAULT_TABLE table=default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.627228 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83c093717ef4424b56d49e2689a6d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.640995 1449 raft_consensus.cc:493] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.641242 1248 ts_tablet_manager.cc:1929] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.641220 1449 raft_consensus.cc:515] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.641366 1248 log.cc:1199] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/ea818ec12a3744f5b377a55f2693caed
I20260619 19:53:52.641746 1248 ts_tablet_manager.cc:1950] T ea818ec12a3744f5b377a55f2693caed P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.642055 1449 leader_election.cc:290] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.642728 1248 tablet_replica.cc:333] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.642783 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet ea818ec12a3744f5b377a55f2693caed (table default.Table_82746ee331ef4c06bf7f1f322bcf1e1c [id=70e8c4fcd9c24e11af67b51e95c8434b]) successfully deleted
I20260619 19:53:52.642935 1248 raft_consensus.cc:2243] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
W20260619 19:53:52.643024 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ecbe466eee2f43359181a1d26d6e761e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecbe466eee2f43359181a1d26d6e761e already in progress: creating tablet
W20260619 19:53:52.643257 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a75baa585102481fa0ea01e87e394e32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75baa585102481fa0ea01e87e394e32 already in progress: creating tablet
W20260619 19:53:52.643659 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 620f3a56e57e49b7b520012857e71187 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 620f3a56e57e49b7b520012857e71187 already in progress: creating tablet
I20260619 19:53:52.643827 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:52.644308 1208 tablet_bootstrap.cc:492] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.644337 752 tablet_service.cc:1511] Processing CreateTablet for tablet c83c093717ef4424b56d49e2689a6d0b (DEFAULT_TABLE table=default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.644497 1208 ts_tablet_manager.cc:1403] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.176s user 0.012s sys 0.014s
I20260619 19:53:52.644873 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83c093717ef4424b56d49e2689a6d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.645491 1208 raft_consensus.cc:359] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.645735 1208 raft_consensus.cc:385] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.645809 1208 raft_consensus.cc:740] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.646100 1208 consensus_queue.cc:260] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.646731 1208 ts_tablet_manager.cc:1434] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:52.647105 1208 tablet_bootstrap.cc:492] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.650729 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3031a45cf534814bbece8d271c0420e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.653694 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ff57208565495480920b6eaaff9295" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.654893 1200 ts_tablet_manager.cc:1403] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.001s
I20260619 19:53:52.654930 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.655175 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.655895 1200 raft_consensus.cc:359] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.656113 1200 raft_consensus.cc:385] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.656694 1200 raft_consensus.cc:740] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.656211 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c (DEFAULT_TABLE table=default.Table_e4f08490c62f47249298bc6684dd80bb [id=7018bca0519c45289b5131c3e4484774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.656960 1200 consensus_queue.cc:260] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.657122 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.657511 1200 ts_tablet_manager.cc:1434] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:52.657872 1200 tablet_bootstrap.cc:492] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:52.658181 1208 tablet_bootstrap.cc:654] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.651881 1248 raft_consensus.cc:2272] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.659871 1248 ts_tablet_manager.cc:1916] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.663653 1059 raft_consensus.cc:2393] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:52.664369 720 leader_election.cc:304] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:52.664956 1449 raft_consensus.cc:3060] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.668586 1449 raft_consensus.cc:2749] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.670470 1379 raft_consensus.cc:515] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.672588 1379 leader_election.cc:290] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.672703 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97025f1e0634720bc68d0a6196bd20b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.654845 1530 raft_consensus.cc:493] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:52.673336 996 leader_election.cc:343] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.673550 1530 raft_consensus.cc:515] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.674786 1248 ts_tablet_manager.cc:1929] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260619 19:53:52.675964 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b5f1da20614838aac1a0175ad4a67d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:52.678357 996 leader_election.cc:343] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.680954 1530 leader_election.cc:290] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.682905 1041 tablet_service.cc:1511] Processing CreateTablet for tablet c83c093717ef4424b56d49e2689a6d0b (DEFAULT_TABLE table=default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.683558 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83c093717ef4424b56d49e2689a6d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.685572 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 41455237399b45efbe8190dcb01e764c (DEFAULT_TABLE table=default.Table_516e7616f9ea454fbe587f5be52a3c55 [id=af3f4335b675482195a6511647ca2871]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.686097 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41455237399b45efbe8190dcb01e764c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.677404 1208 tablet_bootstrap.cc:492] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.687345 1200 tablet_bootstrap.cc:654] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.687572 1208 ts_tablet_manager.cc:1403] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.004s
I20260619 19:53:52.681079 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b5f1da20614838aac1a0175ad4a67d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.688570 784 raft_consensus.cc:2468] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:52.688653 1208 raft_consensus.cc:359] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.689066 1208 raft_consensus.cc:385] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.689249 1208 raft_consensus.cc:740] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.689618 1208 consensus_queue.cc:260] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.690416 1208 ts_tablet_manager.cc:1434] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:53:52.690834 1208 tablet_bootstrap.cc:492] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.684253 764 tablet_service.cc:1511] Processing CreateTablet for tablet 41455237399b45efbe8190dcb01e764c (DEFAULT_TABLE table=default.Table_516e7616f9ea454fbe587f5be52a3c55 [id=af3f4335b675482195a6511647ca2871]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.691715 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41455237399b45efbe8190dcb01e764c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.693212 1248 log.cc:1199] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/c9652b7e593c4c2597a1f9268d67b6d1
I20260619 19:53:52.693743 1248 ts_tablet_manager.cc:1950] T c9652b7e593c4c2597a1f9268d67b6d1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.695508 1208 tablet_bootstrap.cc:654] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.697396 996 leader_election.cc:304] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:52.698244 1530 raft_consensus.cc:2804] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.698477 1530 raft_consensus.cc:493] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.698670 1530 raft_consensus.cc:3060] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.703444 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_5023fdbc94ad42d1b931c6efb4e78679 [id=48b2e4a0c57a49ba85be21c915aa9502]) successfully deleted
W20260619 19:53:52.703828 590 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet da983715197847f18466d61f1eade0f5 because the tablet was not found. No further retry: Not found: Tablet not found: da983715197847f18466d61f1eade0f5
W20260619 19:53:52.704134 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5bae5be1340f4158a0b243415e232ae5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bae5be1340f4158a0b243415e232ae5 already in progress: creating tablet
I20260619 19:53:52.709911 899 tablet_service.cc:1511] Processing CreateTablet for tablet fade40bf3e7145f29076821f091677bd (DEFAULT_TABLE table=default.Table_7664c5ebb9804f838e732e7afc1b356b [id=7a2746a71d40404a9c2ddf50e04ec15c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.710480 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fade40bf3e7145f29076821f091677bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.714125 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:53:52.714686 595 catalog_manager.cc:6784] ReplaceTablet: tablet 467bb41a4e9f46e497726c6b29ddeb04 deleted and replaced by tablet 5fcb1050f57246feb65f7e8948856c21
I20260619 19:53:52.716558 1200 tablet_bootstrap.cc:492] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:52.716327 595 catalog_manager.cc:5696] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:52.716998 595 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:52.717996 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 68746ca7888e4af891238f79dcfdde10
I20260619 19:53:52.718488 596 catalog_manager.cc:6784] ReplaceTablet: tablet 68746ca7888e4af891238f79dcfdde10 deleted and replaced by tablet 3091dd1a525a4f779c68b8b77afa5b26
I20260619 19:53:52.718847 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c6ce6eae1a954a7092b9947edad827df" } new_table_name: "default.Table_44549b66c4e94538a73089d9d7ebb012" modify_external_catalogs: true
I20260619 19:53:52.719548 1200 ts_tablet_manager.cc:1403] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.006s
I20260619 19:53:52.721911 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.722134 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 68746ca7888e4af891238f79dcfdde10 with delete_type TABLET_DATA_DELETED (replaced by tablet 3091dd1a525a4f779c68b8b77afa5b26) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.722954 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 68746ca7888e4af891238f79dcfdde10 with delete_type TABLET_DATA_DELETED (replaced by tablet 3091dd1a525a4f779c68b8b77afa5b26) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.730383 604 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 82d2dd6eedd24f44a6a17aceb20e62bb
I20260619 19:53:52.733812 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.744776 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8103445a5e2e424a92b928a93c4b24df" } modify_external_catalogs: true
I20260619 19:53:52.745040 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_8103445a5e2e424a92b928a93c4b24df" } modify_external_catalogs: true
I20260619 19:53:52.550081 1509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:52.754568 1509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:52.754767 602 catalog_manager.cc:5696] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:52.755299 602 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]). Expected version 4 got 0
I20260619 19:53:52.760365 1201 tablet_bootstrap.cc:492] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:52.762104 764 tablet_service.cc:1511] Processing CreateTablet for tablet fade40bf3e7145f29076821f091677bd (DEFAULT_TABLE table=default.Table_7664c5ebb9804f838e732e7afc1b356b [id=7a2746a71d40404a9c2ddf50e04ec15c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.762683 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fade40bf3e7145f29076821f091677bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.763319 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.763633 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 68746ca7888e4af891238f79dcfdde10 with delete_type TABLET_DATA_DELETED (replaced by tablet 3091dd1a525a4f779c68b8b77afa5b26) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.763837 902 tablet_service.cc:1511] Processing CreateTablet for tablet 41455237399b45efbe8190dcb01e764c (DEFAULT_TABLE table=default.Table_516e7616f9ea454fbe587f5be52a3c55 [id=af3f4335b675482195a6511647ca2871]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.764082 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.764292 903 tablet_service.cc:1558] Processing DeleteTablet for tablet ea818ec12a3744f5b377a55f2693caed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.759686 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97025f1e0634720bc68d0a6196bd20b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.765218 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_632006bb13d74ee3aa918786f1448683"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.765823 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_632006bb13d74ee3aa918786f1448683 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.722198 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.774364 1108 heartbeater.cc:344] Connected to a master server at 127.0.105.190:46791
I20260619 19:53:52.777302 1201 ts_tablet_manager.cc:1403] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.312s user 0.023s sys 0.018s
I20260619 19:53:52.777837 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41455237399b45efbe8190dcb01e764c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.778905 1541 tablet.cc:1724] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:52.781399 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7d551806d81544f7ad830cb1c7c9f6c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.782142 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d551806d81544f7ad830cb1c7c9f6c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:52.787037 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2d1b7b743e594e2aaeaeedd8613d9789 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1b7b743e594e2aaeaeedd8613d9789 already in progress: creating tablet
W20260619 19:53:52.788843 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 467bb41a4e9f46e497726c6b29ddeb04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 467bb41a4e9f46e497726c6b29ddeb04 already in progress: creating tablet
I20260619 19:53:52.789469 752 tablet_service.cc:1511] Processing CreateTablet for tablet 184d655694434b0bbfa178fcd3110405 (DEFAULT_TABLE table=default.Table_30ac9e6bf2a947009c67072b853bcf4e [id=88b02ca24c9f4dc6bf751de7bed9499c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.791401 1340 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "95181cc281b946c8b81aa825232d9498" instance_seqno: 1781898825902521) as {username='slave'} at 127.0.105.130:51237; Asking this server to re-register.
I20260619 19:53:52.800035 903 tablet_service.cc:1511] Processing CreateTablet for tablet 184d655694434b0bbfa178fcd3110405 (DEFAULT_TABLE table=default.Table_30ac9e6bf2a947009c67072b853bcf4e [id=88b02ca24c9f4dc6bf751de7bed9499c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:52.805044 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 consensus state has no leader
I20260619 19:53:52.809530 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184d655694434b0bbfa178fcd3110405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.810245 1379 raft_consensus.cc:493] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.810213 599 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f17eeb5cd144427d8bf4066856809dfe" } modify_external_catalogs: true
I20260619 19:53:52.810444 599 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f17eeb5cd144427d8bf4066856809dfe" } modify_external_catalogs: true
I20260619 19:53:52.810750 969 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:52.811507 1201 raft_consensus.cc:359] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.811728 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:52.812294 996 leader_election.cc:343] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.812467 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 184d655694434b0bbfa178fcd3110405 (DEFAULT_TABLE table=default.Table_30ac9e6bf2a947009c67072b853bcf4e [id=88b02ca24c9f4dc6bf751de7bed9499c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.789808 1248 tablet_replica.cc:333] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.814327 1248 raft_consensus.cc:2243] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.814967 1248 raft_consensus.cc:2272] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.815219 1201 raft_consensus.cc:385] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.815588 1201 raft_consensus.cc:740] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.815984 1201 consensus_queue.cc:260] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.816098 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184d655694434b0bbfa178fcd3110405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.818660 1201 ts_tablet_manager.cc:1434] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.041s user 0.003s sys 0.000s
I20260619 19:53:52.819010 1201 tablet_bootstrap.cc:492] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:52.821346 759 tablet_service.cc:1511] Processing CreateTablet for tablet b57381b0a02141459dc582196d0c0095 (DEFAULT_TABLE table=default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.821857 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57381b0a02141459dc582196d0c0095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.822348 1248 ts_tablet_manager.cc:1916] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.824774 890 tablet_service.cc:1511] Processing CreateTablet for tablet b57381b0a02141459dc582196d0c0095 (DEFAULT_TABLE table=default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.828387 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 3 candidate_status { last_received { term: 2 index: 192 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:52.831653 1108 heartbeater.cc:499] Master 127.0.105.190:46791 was elected leader, sending a full tablet report...
I20260619 19:53:52.832355 1201 tablet_bootstrap.cc:654] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.832391 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57381b0a02141459dc582196d0c0095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.834044 1037 tablet_service.cc:1511] Processing CreateTablet for tablet b57381b0a02141459dc582196d0c0095 (DEFAULT_TABLE table=default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.837980 1379 raft_consensus.cc:515] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.840965 1247 ts_tablet_manager.cc:1929] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260619 19:53:52.845332 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6354f0bf977c438d9ffcf548901ac7af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.846045 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6354f0bf977c438d9ffcf548901ac7af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.847398 1247 log.cc:1199] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/c9652b7e593c4c2597a1f9268d67b6d1
I20260619 19:53:52.851115 1340 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" instance_seqno: 1781898825346256) as {username='slave'} at 127.0.105.129:43281; Asking this server to re-register.
I20260619 19:53:52.852542 831 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:52.853637 1519 raft_consensus.cc:493] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.853803 1519 raft_consensus.cc:515] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.854601 1200 raft_consensus.cc:359] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.854912 1200 raft_consensus.cc:385] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.854624 1519 leader_election.cc:290] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.855062 1200 raft_consensus.cc:740] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.860867 1248 ts_tablet_manager.cc:1929] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:52.861042 1248 log.cc:1199] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/68746ca7888e4af891238f79dcfdde10
I20260619 19:53:52.861119 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184d655694434b0bbfa178fcd3110405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.861052 996 leader_election.cc:304] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.861510 1331 ts_tablet_manager.cc:1929] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:53:52.861572 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 81719.7us
I20260619 19:53:52.861773 1331 log.cc:1199] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/7cd2fca96ee44cf297eb248b1f3ed00a
I20260619 19:53:52.862265 1331 ts_tablet_manager.cc:1950] T 7cd2fca96ee44cf297eb248b1f3ed00a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:52.862479 1526 raft_consensus.cc:2749] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.862969 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 7cd2fca96ee44cf297eb248b1f3ed00a (table default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]) successfully deleted
I20260619 19:53:52.863090 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68746ca7888e4af891238f79dcfdde10" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.865621 1208 tablet_bootstrap.cc:492] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:52.865919 1208 ts_tablet_manager.cc:1403] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.175s user 0.051s sys 0.039s
I20260619 19:53:52.865643 1340 ts_manager.cc:194] Registered new tserver with Master: b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.866886 1208 raft_consensus.cc:359] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.867180 1208 raft_consensus.cc:385] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.867311 1208 raft_consensus.cc:740] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.867621 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68746ca7888e4af891238f79dcfdde10" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.867624 1208 consensus_queue.cc:260] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.860888 1041 tablet_service.cc:1511] Processing CreateTablet for tablet fade40bf3e7145f29076821f091677bd (DEFAULT_TABLE table=default.Table_7664c5ebb9804f838e732e7afc1b356b [id=7a2746a71d40404a9c2ddf50e04ec15c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:52.870414 1248 ts_tablet_manager.cc:1950] T 68746ca7888e4af891238f79dcfdde10 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:52.854785 1540 tablet.cc:1724] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:52.871739 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5ba1b89a3b684c4f9927a1cefb74588d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:52.872159 1537 raft_consensus.cc:493] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:52.872514 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ba1b89a3b684c4f9927a1cefb74588d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.872381 1537 raft_consensus.cc:515] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.873440 1537 leader_election.cc:290] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.855432 1200 consensus_queue.cc:260] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.874981 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_24d96d4b01f94727832aaf2c7fc13576"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:52.875609 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24d96d4b01f94727832aaf2c7fc13576 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:52.876055 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732a2e073e3442ff873ca00be6106744" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.876343 1340 ts_manager.cc:194] Registered new tserver with Master: 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:52.876390 923 raft_consensus.cc:2468] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:52.877094 719 leader_election.cc:304] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
W20260619 19:53:52.877223 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30e606b958d940c6a353a09a2eb627ee consensus state has no leader
I20260619 19:53:52.877570 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_17ad83fba0994578904672a32ee809a4" } modify_external_catalogs: true
I20260619 19:53:52.877669 1537 raft_consensus.cc:2804] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:52.877761 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_17ad83fba0994578904672a32ee809a4" } modify_external_catalogs: true
I20260619 19:53:52.877801 1537 raft_consensus.cc:493] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:52.877907 1537 raft_consensus.cc:3060] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.879837 597 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
W20260619 19:53:52.881459 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b7adec89ed984837a8cf3544679ca617 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7adec89ed984837a8cf3544679ca617 already in progress: creating tablet
I20260619 19:53:52.886320 1247 ts_tablet_manager.cc:1950] T c9652b7e593c4c2597a1f9268d67b6d1 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:52.888123 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 68746ca7888e4af891238f79dcfdde10 (table default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]) successfully deleted
W20260619 19:53:52.888443 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 82d2dd6eedd24f44a6a17aceb20e62bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d2dd6eedd24f44a6a17aceb20e62bb already in progress: creating tablet
I20260619 19:53:52.888623 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 3 candidate_status { last_received { term: 2 index: 192 } } ignore_live_leader: false dest_uuid: "2d38b77ff37948e19592b36b6d884fe0" is_pre_election: true
I20260619 19:53:52.888830 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_5023fdbc94ad42d1b931c6efb4e78679 [id=48b2e4a0c57a49ba85be21c915aa9502]) successfully deleted
I20260619 19:53:52.889382 1274 leader_election.cc:304] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff; no voters: 2d38b77ff37948e19592b36b6d884fe0, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:53:52.889900 1509 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:53:52.890756 1542 tablet.cc:1724] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:52.893061 1525 catalog_manager.cc:1294] Loaded cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:53:52.895117 1525 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: loading cluster ID for follower catalog manager: success
I20260619 19:53:52.895062 1537 raft_consensus.cc:515] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.896904 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732a2e073e3442ff873ca00be6106744" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.897195 923 raft_consensus.cc:3060] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.898370 1201 tablet_bootstrap.cc:492] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:52.898568 1201 ts_tablet_manager.cc:1403] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.080s user 0.018s sys 0.021s
I20260619 19:53:52.899541 1201 raft_consensus.cc:359] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.899755 1201 raft_consensus.cc:385] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.899842 1201 raft_consensus.cc:740] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.900107 1201 consensus_queue.cc:260] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.900616 1201 ts_tablet_manager.cc:1434] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:52.900942 1201 tablet_bootstrap.cc:492] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:52.902184 923 raft_consensus.cc:2468] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:52.902824 719 leader_election.cc:304] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:52.903472 1407 raft_consensus.cc:2804] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:52.903642 1407 raft_consensus.cc:697] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:52.903929 1407 consensus_queue.cc:237] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.907349 1201 tablet_bootstrap.cc:654] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.908936 1208 ts_tablet_manager.cc:1434] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.043s user 0.000s sys 0.003s
I20260619 19:53:52.909345 1208 tablet_bootstrap.cc:492] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:52.911733 1208 tablet_bootstrap.cc:654] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:52.912772 1537 leader_election.cc:290] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.912758 1519 raft_consensus.cc:493] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:52.916688 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57381b0a02141459dc582196d0c0095. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:52.918398 996 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: Tablet not RUNNING: STOPPED
W20260619 19:53:52.918876 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 5bae5be1340f4158a0b243415e232ae5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bae5be1340f4158a0b243415e232ae5 already in progress: creating tablet
W20260619 19:53:52.919253 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2d1b7b743e594e2aaeaeedd8613d9789 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1b7b743e594e2aaeaeedd8613d9789 already in progress: creating tablet
W20260619 19:53:52.919548 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 467bb41a4e9f46e497726c6b29ddeb04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 467bb41a4e9f46e497726c6b29ddeb04 already in progress: creating tablet
I20260619 19:53:52.920073 1514 consensus_queue.cc:1048] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:53:52.919849 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 68746ca7888e4af891238f79dcfdde10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68746ca7888e4af891238f79dcfdde10 already in progress: creating tablet
W20260619 19:53:52.921103 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 82d2dd6eedd24f44a6a17aceb20e62bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d2dd6eedd24f44a6a17aceb20e62bb already in progress: creating tablet
W20260619 19:53:52.921417 590 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ea818ec12a3744f5b377a55f2693caed because the tablet was not found. No further retry: Not found: Tablet not found: ea818ec12a3744f5b377a55f2693caed
W20260619 19:53:52.918550 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 53208.5us
I20260619 19:53:52.925618 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.926489 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.927224 1519 raft_consensus.cc:515] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:52.927915 1519 leader_election.cc:290] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.929212 1200 ts_tablet_manager.cc:1434] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.200s user 0.003s sys 0.000s
I20260619 19:53:52.929324 1379 leader_election.cc:290] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.931192 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732a2e073e3442ff873ca00be6106744" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:52.931391 1061 raft_consensus.cc:3060] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:52.933946 1061 raft_consensus.cc:2468] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:53:52.935078 996 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.935252 996 leader_election.cc:304] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:53:52.935942 996 leader_election.cc:343] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.936923 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0afdcf96247b0a16c8f9ac71cc24a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.937898 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0afdcf96247b0a16c8f9ac71cc24a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:52.938489 1519 raft_consensus.cc:2749] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.931098 1530 raft_consensus.cc:515] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:52.939746 996 leader_election.cc:343] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:52.940128 996 leader_election.cc:343] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.940238 996 leader_election.cc:304] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:52.940773 1519 raft_consensus.cc:2749] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:52.941229 1530 leader_election.cc:290] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:52.949182 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b5f1da20614838aac1a0175ad4a67d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:52.950052 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b5f1da20614838aac1a0175ad4a67d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:52.950325 784 raft_consensus.cc:3060] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:52.966846 996 leader_election.cc:343] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.969031 1525 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: acquiring CA information for follower catalog manager: success
I20260619 19:53:52.973332 1525 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 19:53:52.975361 588 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 33935217c1f44ce0ad5b8610d368f2eb (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 33935217c1f44ce0ad5b8610d368f2eb consensus state has no leader
I20260619 19:53:52.983095 604 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:53:52.984513 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fade40bf3e7145f29076821f091677bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:52.987578 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:52.989526 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:52.990262 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 68746ca7888e4af891238f79dcfdde10 with delete_type TABLET_DATA_DELETED (replaced by tablet 3091dd1a525a4f779c68b8b77afa5b26) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.990535 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 707af50da2ef469fb671df04cb72bb81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:52.990903 1201 tablet_bootstrap.cc:492] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:52.990995 1248 tablet_replica.cc:333] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:52.991066 1201 ts_tablet_manager.cc:1403] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.090s user 0.012s sys 0.027s
I20260619 19:53:52.991173 1331 tablet_replica.cc:333] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:52.991250 1248 raft_consensus.cc:2243] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.991436 1248 raft_consensus.cc:2272] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:52.992061 1248 ts_tablet_manager.cc:1916] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:52.992175 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:52.993795 1200 tablet_bootstrap.cc:492] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:52.996206 996 leader_election.cc:343] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:52.997022 1201 raft_consensus.cc:359] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.997252 1201 raft_consensus.cc:385] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:52.998126 1201 raft_consensus.cc:740] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:52.998142 1331 raft_consensus.cc:2243] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:52.998420 1201 consensus_queue.cc:260] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:52.999534 1201 ts_tablet_manager.cc:1434] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:53:53.000283 1201 tablet_bootstrap.cc:492] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.005013 1201 tablet_bootstrap.cc:654] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.009096 996 leader_election.cc:304] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:53.010120 1530 raft_consensus.cc:2749] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:53.010372 1200 tablet_bootstrap.cc:654] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.011965 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.012112 784 raft_consensus.cc:2468] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:53.017148 996 leader_election.cc:304] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:53.017760 1530 raft_consensus.cc:2804] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:53.018042 1530 raft_consensus.cc:697] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
W20260619 19:53:53.018239 590 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 68746ca7888e4af891238f79dcfdde10 because the tablet was not found. No further retry: Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:53:53.018431 1530 consensus_queue.cc:237] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:53.018608 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 1a686826694b49b9bb5bcdefd61c9a15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a686826694b49b9bb5bcdefd61c9a15 already in progress: creating tablet
I20260619 19:53:53.008760 1341 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" instance_seqno: 1781898826474075) as {username='slave'} at 127.0.105.131:60467; Asking this server to re-register.
I20260619 19:53:53.033939 603 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:53.034180 1201 tablet_bootstrap.cc:492] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.034355 1201 ts_tablet_manager.cc:1403] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.006s
I20260619 19:53:53.034938 1108 heartbeater.cc:461] Registering TS with master...
I20260619 19:53:53.035370 1201 raft_consensus.cc:359] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:53.035590 1201 raft_consensus.cc:385] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.035663 1201 raft_consensus.cc:740] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.035938 1201 consensus_queue.cc:260] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:53.036531 1201 ts_tablet_manager.cc:1434] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:53.037019 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:53:53.037997 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.038704 1201 tablet_bootstrap.cc:492] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:53:53.038736 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.039638 598 master_service.cc:960] ReplaceTablet: received request to replace tablet 1d0fe0c67fe84e5b866fd2553ea26d91 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.040241 598 master_service.cc:960] ReplaceTablet: received request to replace tablet 732a2e073e3442ff873ca00be6106744 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.040931 1201 tablet_bootstrap.cc:654] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.040879 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_06fee996690b44c3ad920d2090ceffa6" } modify_external_catalogs: true
I20260619 19:53:53.041072 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_06fee996690b44c3ad920d2090ceffa6" } modify_external_catalogs: true
I20260619 19:53:53.045964 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.045959 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_313c53f0872044b4a83cffd864500c94" } new_table_name: "default.Table_c73a82d38a4545cc8940056415afdc2b" modify_external_catalogs: true
I20260619 19:53:53.047916 1331 raft_consensus.cc:2272] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:53.047869 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7664c5ebb9804f838e732e7afc1b356b" } new_table_name: "default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc" modify_external_catalogs: true
I20260619 19:53:53.049798 1331 ts_tablet_manager.cc:1916] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:53.051692 603 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_30ac9e6bf2a947009c67072b853bcf4e" } modify_external_catalogs: true
I20260619 19:53:53.052071 603 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_30ac9e6bf2a947009c67072b853bcf4e" } modify_external_catalogs: true
I20260619 19:53:53.053133 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.053809 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732a2e073e3442ff873ca00be6106744" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.054692 1059 raft_consensus.cc:2376] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1. Re-sending same reply.
I20260619 19:53:53.056855 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.057809 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.063278 1201 tablet_bootstrap.cc:492] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.063475 1201 ts_tablet_manager.cc:1403] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.001s
W20260619 19:53:53.063891 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9be5cda43d0b4719a82f33a03e2261d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9be5cda43d0b4719a82f33a03e2261d3 already in progress: creating tablet
I20260619 19:53:53.064417 1201 raft_consensus.cc:359] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.065160 1201 raft_consensus.cc:385] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.065286 1201 raft_consensus.cc:740] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.065536 1201 consensus_queue.cc:260] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.066141 1201 ts_tablet_manager.cc:1434] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260619 19:53:53.066462 1201 tablet_bootstrap.cc:492] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.068460 1201 tablet_bootstrap.cc:654] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.075099 1341 ts_manager.cc:194] Registered new tserver with Master: e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.078671 595 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 4 got 0
I20260619 19:53:53.078936 595 catalog_manager.cc:5696] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:53.079355 595 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a6b5f1da20614838aac1a0175ad4a67d (table default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1]). Expected version 1 got 0
I20260619 19:53:53.079694 1200 tablet_bootstrap.cc:492] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.079885 1200 ts_tablet_manager.cc:1403] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.000s
I20260619 19:53:53.081182 1200 raft_consensus.cc:359] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.081293 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 906212dd25ef46f2b381ce6a99c39343
I20260619 19:53:53.081382 1200 raft_consensus.cc:385] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.081454 1200 raft_consensus.cc:740] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.082008 1200 consensus_queue.cc:260] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.082101 596 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_a88e7ac803114a2798fdbbc76e8b41c9" } new_table_name: "default.Table_42bea76dd9e34906994129bb6ccc40d5" modify_external_catalogs: true
I20260619 19:53:53.082706 1200 ts_tablet_manager.cc:1434] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 19:53:53.086035 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.087496 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.084750 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.089170 1200 tablet_bootstrap.cc:492] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.092131 1201 tablet_bootstrap.cc:492] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.092131 1248 ts_tablet_manager.cc:1929] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:53.092301 1248 log.cc:1199] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/707af50da2ef469fb671df04cb72bb81
I20260619 19:53:53.092322 1201 ts_tablet_manager.cc:1403] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260619 19:53:53.092676 1248 ts_tablet_manager.cc:1950] T 707af50da2ef469fb671df04cb72bb81 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:53.093218 1201 raft_consensus.cc:359] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.093461 1201 raft_consensus.cc:385] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.093547 1201 raft_consensus.cc:740] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.094810 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet aafe2a956b844c9998c84bbe52070e5d
I20260619 19:53:53.095816 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f16736fba2ba4317a1b3ae125a277c20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.096402 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f16736fba2ba4317a1b3ae125a277c20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.096544 1200 tablet_bootstrap.cc:654] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.098742 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:53.093317 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 906212dd25ef46f2b381ce6a99c39343 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 906212dd25ef46f2b381ce6a99c39343 already in progress: creating tablet
I20260619 19:53:53.102821 752 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.103468 1208 tablet_bootstrap.cc:492] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.103636 1208 ts_tablet_manager.cc:1403] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.194s user 0.005s sys 0.013s
I20260619 19:53:53.104593 1208 raft_consensus.cc:359] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.106594 1208 raft_consensus.cc:385] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.106719 1208 raft_consensus.cc:740] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.107440 1208 consensus_queue.cc:260] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.108603 1208 ts_tablet_manager.cc:1434] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260619 19:53:53.108978 1208 tablet_bootstrap.cc:492] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:53:53.110780 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fade40bf3e7145f29076821f091677bd consensus state has no leader
I20260619 19:53:53.111249 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_18793f9a9a8d4535bbfff03c8b2bb59f" } new_table_name: "default.Table_4e675d76500a491d93ec8709df95b206" modify_external_catalogs: true
I20260619 19:53:53.117583 1201 consensus_queue.cc:260] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.118129 902 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.118286 1201 ts_tablet_manager.cc:1434] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.026s user 0.002s sys 0.001s
I20260619 19:53:53.118654 1201 tablet_bootstrap.cc:492] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.118651 1200 tablet_bootstrap.cc:492] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.118804 1200 ts_tablet_manager.cc:1403] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260619 19:53:53.120225 1200 raft_consensus.cc:359] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.120466 1200 raft_consensus.cc:385] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.120564 1200 raft_consensus.cc:740] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.120803 1200 consensus_queue.cc:260] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.121064 1201 tablet_bootstrap.cc:654] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:53.121413 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet aafe2a956b844c9998c84bbe52070e5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aafe2a956b844c9998c84bbe52070e5d already in progress: creating tablet
I20260619 19:53:53.125638 1200 ts_tablet_manager.cc:1434] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260619 19:53:53.126972 1200 tablet_bootstrap.cc:492] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.128731 599 master_service.cc:960] ReplaceTablet: received request to replace tablet ecbe466eee2f43359181a1d26d6e761e from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.130353 599 master_service.cc:960] ReplaceTablet: received request to replace tablet 91e43148bb5b47128e08ed7faf8c7c1f from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.132146 1200 tablet_bootstrap.cc:654] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:53.148746 596 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c54b2e4f657245c2aa23d138968b3b0d has no consensus state
I20260619 19:53:53.149263 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_318e69014c974faabdc436cbeec6cbdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.151358 1208 tablet_bootstrap.cc:654] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:53.154603 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_318e69014c974faabdc436cbeec6cbdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.158888 1537 consensus_queue.cc:1048] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.161878 1405 consensus_queue.cc:1048] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.163213 1537 raft_consensus.cc:493] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.163412 1537 raft_consensus.cc:515] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.164233 1537 leader_election.cc:290] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.165385 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:53.166074 719 leader_election.cc:343] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.166779 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.167008 1059 raft_consensus.cc:2468] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.167884 720 leader_election.cc:304] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:53.169196 1407 raft_consensus.cc:2804] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.169325 1407 raft_consensus.cc:493] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.169435 1407 raft_consensus.cc:3060] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.176929 1201 tablet_bootstrap.cc:492] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.177127 1201 ts_tablet_manager.cc:1403] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.010s
I20260619 19:53:53.180909 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 707af50da2ef469fb671df04cb72bb81 (table default.Table_a4356f4b40cc4a4b8fdae91a4e687529 [id=288182d375434231a16e70f31f17f326]) successfully deleted
W20260619 19:53:53.181317 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1a686826694b49b9bb5bcdefd61c9a15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a686826694b49b9bb5bcdefd61c9a15 already in progress: creating tablet
W20260619 19:53:53.183061 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9be5cda43d0b4719a82f33a03e2261d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9be5cda43d0b4719a82f33a03e2261d3 already in progress: creating tablet
W20260619 19:53:53.183503 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 906212dd25ef46f2b381ce6a99c39343 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 906212dd25ef46f2b381ce6a99c39343 already in progress: creating tablet
I20260619 19:53:53.183473 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_e253cf6ca249466ebb47d8d6022e8287"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.188237 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e253cf6ca249466ebb47d8d6022e8287 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.188536 1208 tablet_bootstrap.cc:492] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.188746 1208 ts_tablet_manager.cc:1403] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.003s
I20260619 19:53:53.189604 1208 raft_consensus.cc:359] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.189849 1208 raft_consensus.cc:385] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.189929 1208 raft_consensus.cc:740] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.190171 1208 consensus_queue.cc:260] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:53.190500 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet aafe2a956b844c9998c84bbe52070e5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aafe2a956b844c9998c84bbe52070e5d already in progress: creating tablet
I20260619 19:53:53.195613 1331 ts_tablet_manager.cc:1929] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:53.195827 1331 log.cc:1199] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/da983715197847f18466d61f1eade0f5
I20260619 19:53:53.196349 1331 ts_tablet_manager.cc:1950] T da983715197847f18466d61f1eade0f5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:53.198081 1407 raft_consensus.cc:515] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.200352 1200 tablet_bootstrap.cc:492] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.200538 1200 ts_tablet_manager.cc:1403] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.074s user 0.015s sys 0.017s
I20260619 19:53:53.201689 1200 raft_consensus.cc:359] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.201903 1200 raft_consensus.cc:385] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.201972 1200 raft_consensus.cc:740] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.202232 1200 consensus_queue.cc:260] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:53.203516 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fcb1050f57246feb65f7e8948856c21 has no consensus state
I20260619 19:53:53.203842 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 7cd2fca96ee44cf297eb248b1f3ed00a from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.204492 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5a8d285b403649bda850a2752754753b" } new_table_name: "default.Table_9a70fe99a1294387a1ac81cbd29c2647" modify_external_catalogs: true
I20260619 19:53:53.205451 1201 raft_consensus.cc:359] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.205680 1201 raft_consensus.cc:385] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.206197 1201 raft_consensus.cc:740] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.206525 1201 consensus_queue.cc:260] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.206540 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_06f356714778440cbb5c03887dbb5727"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.207186 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06f356714778440cbb5c03887dbb5727 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.207203 1201 ts_tablet_manager.cc:1434] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260619 19:53:53.207706 1201 tablet_bootstrap.cc:492] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.207942 1200 ts_tablet_manager.cc:1434] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:53:53.209843 1201 tablet_bootstrap.cc:654] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.211455 1200 tablet_bootstrap.cc:492] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.212863 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:53.213392 1200 tablet_bootstrap.cc:654] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:53.213718 719 leader_election.cc:343] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.214310 1407 leader_election.cc:290] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.226485 1201 tablet_bootstrap.cc:492] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.226701 1201 ts_tablet_manager.cc:1403] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.005s
I20260619 19:53:53.227707 1201 raft_consensus.cc:359] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.227980 1201 raft_consensus.cc:385] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.228076 1201 raft_consensus.cc:740] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.228339 1201 consensus_queue.cc:260] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.228904 1201 ts_tablet_manager.cc:1434] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:53.231244 1201 tablet_bootstrap.cc:492] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.233321 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:53.233585 1058 raft_consensus.cc:3060] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.242034 1201 tablet_bootstrap.cc:654] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:53.250845 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 12258d3bcc714f34857d7362c49ee787 consensus state has no leader
I20260619 19:53:53.250773 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e4f08490c62f47249298bc6684dd80bb" } modify_external_catalogs: true
I20260619 19:53:53.250998 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_e4f08490c62f47249298bc6684dd80bb" } modify_external_catalogs: true
I20260619 19:53:53.252179 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6e54fd634fc845d7b9ab428009616c61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.252275 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_813fc3596f604c7a99d0ac0c6c42a5e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.252816 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e54fd634fc845d7b9ab428009616c61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:53.252944 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_813fc3596f604c7a99d0ac0c6c42a5e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.261145 1542 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:53.261458 1540 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:53.264293 1201 tablet_bootstrap.cc:492] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.264473 1201 ts_tablet_manager.cc:1403] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.009s
I20260619 19:53:53.265130 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 157) took 1116 ms. Trace:
I20260619 19:53:53.265511 1201 raft_consensus.cc:359] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.265697 1201 raft_consensus.cc:385] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.265785 1201 raft_consensus.cc:740] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.266033 1201 consensus_queue.cc:260] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.265271 1331 rpcz_store.cc:276] 0619 19:53:52.148724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.149761 (+ 1037us) service_pool.cc:224] Handling call
0619 19:53:52.867988 (+718227us) ts_tablet_manager.cc:1151] Deleting tablet da983715197847f18466d61f1eade0f5
0619 19:53:52.868000 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:53.097700 (+229700us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:53.195496 (+ 97796us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:53.265061 (+ 69565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":718066}
I20260619 19:53:53.266543 1201 ts_tablet_manager.cc:1434] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:53.266578 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 159) took 1117 ms. Trace:
I20260619 19:53:53.266669 1331 rpcz_store.cc:276] 0619 19:53:52.149033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.149948 (+ 915us) service_pool.cc:224] Handling call
0619 19:53:53.266367 (+1116419us) ts_tablet_manager.cc:1151] Deleting tablet 5f25c0378a6f4e9ea1a62d98f27778ee
0619 19:53:53.266377 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:53.266503 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116209}
I20260619 19:53:53.266849 1201 tablet_bootstrap.cc:492] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.267263 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet da983715197847f18466d61f1eade0f5 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]) successfully deleted
W20260619 19:53:53.267606 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5f25c0378a6f4e9ea1a62d98f27778ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f25c0378a6f4e9ea1a62d98f27778ee already in progress: creating tablet
I20260619 19:53:53.268581 1201 tablet_bootstrap.cc:654] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.267078 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 158) took 1118 ms. Trace:
I20260619 19:53:53.269515 1331 rpcz_store.cc:276] 0619 19:53:52.148887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.150175 (+ 1288us) service_pool.cc:224] Handling call
0619 19:53:53.266929 (+1116754us) ts_tablet_manager.cc:1151] Deleting tablet 2a3fa43017fa4c278111c29d0d22f7da
0619 19:53:53.266938 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:53.267021 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116547}
I20260619 19:53:53.269899 1331 tablet_replica.cc:333] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:53.270129 1331 raft_consensus.cc:2243] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:53.270311 1331 raft_consensus.cc:2272] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:53.270937 1331 ts_tablet_manager.cc:1916] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:53.275599 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 2a3fa43017fa4c278111c29d0d22f7da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a3fa43017fa4c278111c29d0d22f7da already in progress: creating tablet
I20260619 19:53:53.277967 1058 raft_consensus.cc:2468] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:53.278422 1200 tablet_bootstrap.cc:492] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.278559 1200 ts_tablet_manager.cc:1403] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.001s
I20260619 19:53:53.278517 720 leader_election.cc:304] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:53.279158 1449 raft_consensus.cc:2804] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:53.279338 1449 raft_consensus.cc:697] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:53.279376 1200 raft_consensus.cc:359] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.279569 1200 raft_consensus.cc:385] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.279645 1208 ts_tablet_manager.cc:1434] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.091s user 0.000s sys 0.003s
I20260619 19:53:53.279662 1200 raft_consensus.cc:740] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.279706 1449 consensus_queue.cc:237] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.280026 1208 tablet_bootstrap.cc:492] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.281926 1208 tablet_bootstrap.cc:654] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.282867 1200 consensus_queue.cc:260] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.284528 1200 ts_tablet_manager.cc:1434] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:53.284825 1200 tablet_bootstrap.cc:492] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.290582 923 raft_consensus.cc:3060] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.294167 923 raft_consensus.cc:1275] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Refusing update from remote peer e78a44e2c8824fe7bce462e9d33f660c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:53.295349 1519 consensus_queue.cc:1048] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.297358 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_dcf53365a32c41d199527fbf3350633f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.298134 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcf53365a32c41d199527fbf3350633f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.298817 1405 raft_consensus.cc:493] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.298988 1405 raft_consensus.cc:515] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.299727 1405 leader_election.cc:290] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:53.301097 859 leader_election.cc:343] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 7cd2fca96ee44cf297eb248b1f3ed00a
I20260619 19:53:53.308326 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_06a592321d9b45b1b878d51b17c448c6" } modify_external_catalogs: true
I20260619 19:53:53.308569 1200 tablet_bootstrap.cc:654] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.308952 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_06a592321d9b45b1b878d51b17c448c6" } modify_external_catalogs: true
I20260619 19:53:53.321983 902 tablet_service.cc:1511] Processing CreateTablet for tablet 11e9d0ae96db4388a39a8b8f9c87187e (DEFAULT_TABLE table=default.Table_30932010f9e54c029a0c57b5c379957e [id=6d7c9506a27b4a70a32958a89c72c202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.322638 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e9d0ae96db4388a39a8b8f9c87187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.290539 782 raft_consensus.cc:1275] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Refusing update from remote peer e78a44e2c8824fe7bce462e9d33f660c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:53:53.329639 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 11e9d0ae96db4388a39a8b8f9c87187e (DEFAULT_TABLE table=default.Table_30932010f9e54c029a0c57b5c379957e [id=6d7c9506a27b4a70a32958a89c72c202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.329912 1519 consensus_queue.cc:1048] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.330281 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e9d0ae96db4388a39a8b8f9c87187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.296592 1537 raft_consensus.cc:493] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.331310 1537 raft_consensus.cc:515] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.332254 1537 leader_election.cc:290] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.339372 1540 tablet.cc:1724] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:53.339632 752 tablet_service.cc:1511] Processing CreateTablet for tablet 11e9d0ae96db4388a39a8b8f9c87187e (DEFAULT_TABLE table=default.Table_30932010f9e54c029a0c57b5c379957e [id=6d7c9506a27b4a70a32958a89c72c202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.340189 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e9d0ae96db4388a39a8b8f9c87187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.344048 1530 raft_consensus.cc:493] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.344254 1530 raft_consensus.cc:515] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.345005 1530 leader_election.cc:290] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.345913 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb8df8d8ac047bfa6ab7a6b533e38fc" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:53.346479 996 leader_election.cc:343] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.347365 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.347585 1058 raft_consensus.cc:2468] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.348184 720 leader_election.cc:304] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.348655 1407 raft_consensus.cc:2804] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.348793 1407 raft_consensus.cc:493] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.348915 1407 raft_consensus.cc:3060] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.349804 1542 tablet.cc:1724] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:53.352722 603 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 184d655694434b0bbfa178fcd3110405
I20260619 19:53:53.353673 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_777693f155b442ecb9b881ee6ce60f67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.354228 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:53.354310 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_777693f155b442ecb9b881ee6ce60f67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.355036 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 2d64ccbb2f2840f4ac51cf8556da4a2c
I20260619 19:53:53.355682 600 master_service.cc:960] ReplaceTablet: received request to replace tablet 184d655694434b0bbfa178fcd3110405 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.356252 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6ce0d03b39e0413b802982083364ec9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.356877 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ce0d03b39e0413b802982083364ec9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.358875 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:53:53.358999 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.359751 596 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f16736fba2ba4317a1b3ae125a277c20" } modify_external_catalogs: true
I20260619 19:53:53.359946 596 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f16736fba2ba4317a1b3ae125a277c20" } modify_external_catalogs: true
I20260619 19:53:53.360339 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.361696 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.361871 602 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_38a961b0cc2946c7b79e57cd66fbe323" } modify_external_catalogs: true
I20260619 19:53:53.362112 602 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_38a961b0cc2946c7b79e57cd66fbe323" } modify_external_catalogs: true
I20260619 19:53:53.363991 1200 tablet_bootstrap.cc:492] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.364166 1200 ts_tablet_manager.cc:1403] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.000s
I20260619 19:53:53.365048 1200 raft_consensus.cc:359] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.365331 1200 raft_consensus.cc:385] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.365409 1200 raft_consensus.cc:740] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.365665 1200 consensus_queue.cc:260] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.366214 1200 ts_tablet_manager.cc:1434] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:53.366575 1200 tablet_bootstrap.cc:492] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.367595 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.369156 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.370236 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.371266 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.371364 1208 tablet_bootstrap.cc:492] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.371546 1208 ts_tablet_manager.cc:1403] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.002s
I20260619 19:53:53.372383 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.372612 1208 raft_consensus.cc:359] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.372844 1208 raft_consensus.cc:385] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.372994 1208 raft_consensus.cc:740] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:53:53.373345 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 184d655694434b0bbfa178fcd3110405 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 184d655694434b0bbfa178fcd3110405 already in progress: creating tablet
W20260619 19:53:53.373649 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64ccbb2f2840f4ac51cf8556da4a2c already in progress: creating tablet
W20260619 19:53:53.373925 590 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 already in progress: creating tablet
W20260619 19:53:53.374150 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 184d655694434b0bbfa178fcd3110405 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 184d655694434b0bbfa178fcd3110405 already in progress: creating tablet
I20260619 19:53:53.373850 1208 consensus_queue.cc:260] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:53.374400 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d64ccbb2f2840f4ac51cf8556da4a2c already in progress: creating tablet
W20260619 19:53:53.374629 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 already in progress: creating tablet
I20260619 19:53:53.374929 1514 raft_consensus.cc:493] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.375114 1514 raft_consensus.cc:515] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:53.375486 1208 ts_tablet_manager.cc:1434] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 19:53:53.375973 1514 leader_election.cc:290] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:52.549340 1363 rpcz_store.cc:276] 0619 19:53:51.176110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:51.176176 (+ 66us) service_pool.cc:224] Handling call
0619 19:53:51.762807 (+586631us) raft_consensus.cc:1471] Updating replica for 186 ops
0619 19:53:51.804928 (+ 42121us) raft_consensus.cc:1534] Early marking committed up to index 6
0619 19:53:52.057109 (+252181us) raft_consensus.cc:1539] Triggering prepare for 186 ops
0619 19:53:52.057600 (+ 491us) write_op.cc:270] Start()
0619 19:53:52.057644 (+ 44us) write_op.cc:276] Timestamp: P: 1781898827717510 usec, L: 0
0619 19:53:52.057984 (+ 340us) write_op.cc:270] Start()
0619 19:53:52.058027 (+ 43us) write_op.cc:276] Timestamp: P: 1781898827718327 usec, L: 0
0619 19:53:52.093526 (+ 35499us) write_op.cc:270] Start()
0619 19:53:52.093563 (+ 37us) write_op.cc:276] Timestamp: P: 1781898827719732 usec, L: 0
0619 19:53:52.093784 (+ 221us) write_op.cc:270] Start()
0619 19:53:52.093813 (+ 29us) write_op.cc:276] Timestamp: P: 1781898827720338 usec, L: 0
0619 19:53:52.094033 (+ 220us) write_op.cc:270] Start()
0619 19:53:52.094057 (+ 24us) write_op.cc:276] Timestamp: P: 1781898827720865 usec, L: 0
0619 19:53:52.094223 (+ 166us) write_op.cc:270] Start()
0619 19:53:52.094250 (+ 27us) write_op.cc:276] Timestamp: P: 1781898827721395 usec, L: 0
0619 19:53:52.094387 (+ 137us) write_op.cc:270] Start()
0619 19:53:52.094431 (+ 44us) write_op.cc:276] Timestamp: P: 1781898827722002 usec, L: 0
0619 19:53:52.097494 (+ 3063us) write_op.cc:270] Start()
0619 19:53:52.097525 (+ 31us) write_op.cc:276] Timestamp: P: 1781898827725941 usec, L: 0
0619 19:53:52.099864 (+ 2339us) write_op.cc:270] Start()
0619 19:53:52.099903 (+ 39us) write_op.cc:276] Timestamp: P: 1781898827735061 usec, L: 0
0619 19:53:52.101025 (+ 1122us) write_op.cc:270] Start()
0619 19:53:52.101053 (+ 28us) write_op.cc:276] Timestamp: P: 1781898827739594 usec, L: 0
0619 19:53:52.108544 (+ 7491us) write_op.cc:270] Start()
0619 19:53:52.108577 (+ 33us) write_op.cc:276] Timestamp: P: 1781898827740418 usec, L: 0
0619 19:53:52.113254 (+ 4677us) write_op.cc:270] Start()
0619 19:53:52.113294 (+ 40us) write_op.cc:276] Timestamp: P: 1781898827741312 usec, L: 0
0619 19:53:52.113514 (+ 220us) write_op.cc:270] Start()
0619 19:53:52.113539 (+ 25us) write_op.cc:276] Timestamp: P: 1781898827741989 usec, L: 0
0619 19:53:52.113676 (+ 137us) write_op.cc:270] Start()
0619 19:53:52.113695 (+ 19us) write_op.cc:276] Timestamp: P: 1781898827742948 usec, L: 0
0619 19:53:52.113820 (+ 125us) write_op.cc:270] Start()
0619 19:53:52.113842 (+ 22us) write_op.cc:276] Timestamp: P: 1781898827743808 usec, L: 0
0619 19:53:52.113977 (+ 135us) write_op.cc:270] Start()
0619 19:53:52.113994 (+ 17us) write_op.cc:276] Timestamp: P: 1781898827746941 usec, L: 0
0619 19:53:52.114135 (+ 141us) write_op.cc:270] Start()
0619 19:53:52.114163 (+ 28us) write_op.cc:276] Timestamp: P: 1781898827751002 usec, L: 0
0619 19:53:52.114317 (+ 154us) write_op.cc:270] Start()
0619 19:53:52.114338 (+ 21us) write_op.cc:276] Timestamp: P: 1781898827758958 usec, L: 0
0619 19:53:52.121944 (+ 7606us) write_op.cc:270] Start()
0619 19:53:52.121992 (+ 48us) write_op.cc:276] Timestamp: P: 1781898827759646 usec, L: 0
0619 19:53:52.122246 (+ 254us) write_op.cc:270] Start()
0619 19:53:52.122286 (+ 40us) write_op.cc:276] Timestamp: P: 1781898827786451 usec, L: 0
0619 19:53:52.122463 (+ 177us) write_op.cc:270] Start()
0619 19:53:52.122520 (+ 57us) write_op.cc:276] Timestamp: P: 1781898827789470 usec, L: 0
0619 19:53:52.122683 (+ 163us) write_op.cc:270] Start()
0619 19:53:52.122703 (+ 20us) write_op.cc:276] Timestamp: P: 1781898827863145 usec, L: 0
0619 19:53:52.122853 (+ 150us) write_op.cc:270] Start()
0619 19:53:52.122874 (+ 21us) write_op.cc:276] Timestamp: P: 1781898827942343 usec, L: 0
0619 19:53:52.123007 (+ 133us) write_op.cc:270] Start()
0619 19:53:52.123026 (+ 19us) write_op.cc:276] Timestamp: P: 1781898827944193 usec, L: 0
0619 19:53:52.123221 (+ 195us) write_op.cc:270] Start()
0619 19:53:52.123244 (+ 23us) write_op.cc:276] Timestamp: P: 1781898827953355 usec, L: 0
0619 19:53:52.123419 (+ 175us) write_op.cc:270] Start()
0619 19:53:52.123444 (+ 25us) write_op.cc:276] Timestamp: P: 1781898827954194 usec, L: 0
0619 19:53:52.127832 (+ 4388us) write_op.cc:270] Start()
0619 19:53:52.127870 (+ 38us) write_op.cc:276] Timestamp: P: 1781898827968051 usec, L: 0
0619 19:53:52.128106 (+ 236us) write_op.cc:270] Start()
0619 19:53:52.128128 (+ 22us) write_op.cc:276] Timestamp: P: 1781898827977387 usec, L: 0
0619 19:53:52.128293 (+ 165us) write_op.cc:270] Start()
0619 19:53:52.128315 (+ 22us) write_op.cc:276] Timestamp: P: 1781898827978487 usec, L: 0
0619 19:53:52.128464 (+ 149us) write_op.cc:270] Start()
0619 19:53:52.128484 (+ 20us) write_op.cc:276] Timestamp: P: 1781898827984813 usec, L: 0
0619 19:53:52.128646 (+ 162us) write_op.cc:270] Start()
0619 19:53:52.128668 (+ 22us) write_op.cc:276] Timestamp: P: 1781898827986476 usec, L: 0
0619 19:53:52.128794 (+ 126us) write_op.cc:270] Start()
0619 19:53:52.128814 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828019725 usec, L: 0
0619 19:53:52.128966 (+ 152us) write_op.cc:270] Start()
0619 19:53:52.128987 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828072127 usec, L: 0
0619 19:53:52.129151 (+ 164us) write_op.cc:270] Start()
0619 19:53:52.129170 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828120626 usec, L: 0
0619 19:53:52.129335 (+ 165us) write_op.cc:270] Start()
0619 19:53:52.129358 (+ 23us) write_op.cc:276] Timestamp: P: 1781898828121527 usec, L: 0
0619 19:53:52.129518 (+ 160us) write_op.cc:270] Start()
0619 19:53:52.145789 (+ 16271us) write_op.cc:276] Timestamp: P: 1781898828131344 usec, L: 0
0619 19:53:52.146080 (+ 291us) write_op.cc:270] Start()
0619 19:53:52.146128 (+ 48us) write_op.cc:276] Timestamp: P: 1781898828181685 usec, L: 0
0619 19:53:52.146352 (+ 224us) write_op.cc:270] Start()
0619 19:53:52.146386 (+ 34us) write_op.cc:276] Timestamp: P: 1781898828214654 usec, L: 0
0619 19:53:52.146550 (+ 164us) write_op.cc:270] Start()
0619 19:53:52.146574 (+ 24us) write_op.cc:276] Timestamp: P: 1781898828221898 usec, L: 0
0619 19:53:52.146736 (+ 162us) write_op.cc:270] Start()
0619 19:53:52.146758 (+ 22us) write_op.cc:276] Timestamp: P: 1781898828257213 usec, L: 0
0619 19:53:52.146900 (+ 142us) write_op.cc:270] Start()
0619 19:53:52.146921 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828283890 usec, L: 0
0619 19:53:52.147091 (+ 170us) write_op.cc:270] Start()
0619 19:53:52.150570 (+ 3479us) write_op.cc:276] Timestamp: P: 1781898828285473 usec, L: 0
0619 19:53:52.159400 (+ 8830us) write_op.cc:270] Start()
0619 19:53:52.159450 (+ 50us) write_op.cc:276] Timestamp: P: 1781898828286276 usec, L: 0
0619 19:53:52.159687 (+ 237us) write_op.cc:270] Start()
0619 19:53:52.159711 (+ 24us) write_op.cc:276] Timestamp: P: 1781898828290283 usec, L: 0
0619 19:53:52.159889 (+ 178us) write_op.cc:270] Start()
0619 19:53:52.159912 (+ 23us) write_op.cc:276] Timestamp: P: 1781898828300439 usec, L: 0
0619 19:53:52.160061 (+ 149us) write_op.cc:270] Start()
0619 19:53:52.160081 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828366615 usec, L: 0
0619 19:53:52.160208 (+ 127us) write_op.cc:270] Start()
0619 19:53:52.160227 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828367935 usec, L: 0
0619 19:53:52.168951 (+ 8724us) write_op.cc:270] Start()
0619 19:53:52.169009 (+ 58us) write_op.cc:276] Timestamp: P: 1781898828368599 usec, L: 0
0619 19:53:52.169346 (+ 337us) write_op.cc:270] Start()
0619 19:53:52.169384 (+ 38us) write_op.cc:276] Timestamp: P: 1781898828369182 usec, L: 0
0619 19:53:52.169638 (+ 254us) write_op.cc:270] Start()
0619 19:53:52.169664 (+ 26us) write_op.cc:276] Timestamp: P: 1781898828369789 usec, L: 0
0619 19:53:52.169803 (+ 139us) write_op.cc:270] Start()
0619 19:53:52.169824 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828370377 usec, L: 0
0619 19:53:52.169958 (+ 134us) write_op.cc:270] Start()
0619 19:53:52.169978 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828406002 usec, L: 0
0619 19:53:52.170124 (+ 146us) write_op.cc:270] Start()
0619 19:53:52.170143 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828457036 usec, L: 0
0619 19:53:52.170261 (+ 118us) write_op.cc:270] Start()
0619 19:53:52.170279 (+ 18us) write_op.cc:276] Timestamp: P: 1781898828459156 usec, L: 0
0619 19:53:52.170423 (+ 144us) write_op.cc:270] Start()
0619 19:53:52.170448 (+ 25us) write_op.cc:276] Timestamp: P: 1781898828460202 usec, L: 0
0619 19:53:52.170581 (+ 133us) write_op.cc:270] Start()
0619 19:53:52.170600 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828464047 usec, L: 0
0619 19:53:52.170715 (+ 115us) write_op.cc:270] Start()
0619 19:53:52.170732 (+ 17us) write_op.cc:276] Timestamp: P: 1781898828550835 usec, L: 0
0619 19:53:52.170878 (+ 146us) write_op.cc:270] Start()
0619 19:53:52.170906 (+ 28us) write_op.cc:276] Timestamp: P: 1781898828552338 usec, L: 0
0619 19:53:52.171051 (+ 145us) write_op.cc:270] Start()
0619 19:53:52.171072 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828552952 usec, L: 0
0619 19:53:52.171296 (+ 224us) write_op.cc:270] Start()
0619 19:53:52.171340 (+ 44us) write_op.cc:276] Timestamp: P: 1781898828553656 usec, L: 0
0619 19:53:52.171491 (+ 151us) write_op.cc:270] Start()
0619 19:53:52.171511 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828554274 usec, L: 0
0619 19:53:52.171640 (+ 129us) write_op.cc:270] Start()
0619 19:53:52.171662 (+ 22us) write_op.cc:276] Timestamp: P: 1781898828572860 usec, L: 0
0619 19:53:52.171812 (+ 150us) write_op.cc:270] Start()
0619 19:53:52.171832 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828605371 usec, L: 0
0619 19:53:52.171973 (+ 141us) write_op.cc:270] Start()
0619 19:53:52.171994 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828608052 usec, L: 0
0619 19:53:52.172137 (+ 143us) write_op.cc:270] Start()
0619 19:53:52.172156 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828609683 usec, L: 0
0619 19:53:52.172309 (+ 153us) write_op.cc:270] Start()
0619 19:53:52.172329 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828620243 usec, L: 0
0619 19:53:52.172475 (+ 146us) write_op.cc:270] Start()
0619 19:53:52.172496 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828646285 usec, L: 0
0619 19:53:52.172642 (+ 146us) write_op.cc:270] Start()
0619 19:53:52.172662 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828662961 usec, L: 0
0619 19:53:52.172823 (+ 161us) write_op.cc:270] Start()
0619 19:53:52.172843 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828665579 usec, L: 0
0619 19:53:52.172967 (+ 124us) write_op.cc:270] Start()
0619 19:53:52.173000 (+ 33us) write_op.cc:276] Timestamp: P: 1781898828667004 usec, L: 0
0619 19:53:52.173293 (+ 293us) write_op.cc:270] Start()
0619 19:53:52.173318 (+ 25us) write_op.cc:276] Timestamp: P: 1781898828668287 usec, L: 0
0619 19:53:52.173492 (+ 174us) write_op.cc:270] Start()
0619 19:53:52.173518 (+ 26us) write_op.cc:276] Timestamp: P: 1781898828685396 usec, L: 0
0619 19:53:52.173656 (+ 138us) write_op.cc:270] Start()
0619 19:53:52.173678 (+ 22us) write_op.cc:276] Timestamp: P: 1781898828687145 usec, L: 0
0619 19:53:52.173831 (+ 153us) write_op.cc:270] Start()
0619 19:53:52.173855 (+ 24us) write_op.cc:276] Timestamp: P: 1781898828688171 usec, L: 0
0619 19:53:52.173990 (+ 135us) write_op.cc:270] Start()
0619 19:53:52.174011 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828693016 usec, L: 0
0619 19:53:52.174166 (+ 155us) write_op.cc:270] Start()
0619 19:53:52.174187 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828694013 usec, L: 0
0619 19:53:52.174370 (+ 183us) write_op.cc:270] Start()
0619 19:53:52.174394 (+ 24us) write_op.cc:276] Timestamp: P: 1781898828694928 usec, L: 0
0619 19:53:52.174552 (+ 158us) write_op.cc:270] Start()
0619 19:53:52.174573 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828711349 usec, L: 0
0619 19:53:52.174716 (+ 143us) write_op.cc:270] Start()
0619 19:53:52.174754 (+ 38us) write_op.cc:276] Timestamp: P: 1781898828733245 usec, L: 0
0619 19:53:52.174904 (+ 150us) write_op.cc:270] Start()
0619 19:53:52.174926 (+ 22us) write_op.cc:276] Timestamp: P: 1781898828741699 usec, L: 0
0619 19:53:52.175035 (+ 109us) write_op.cc:270] Start()
0619 19:53:52.175054 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828783249 usec, L: 0
0619 19:53:52.220054 (+ 45000us) write_op.cc:270] Start()
0619 19:53:52.220103 (+ 49us) write_op.cc:276] Timestamp: P: 1781898828802439 usec, L: 0
0619 19:53:52.220321 (+ 218us) write_op.cc:270] Start()
0619 19:53:52.220344 (+ 23us) write_op.cc:276] Timestamp: P: 1781898828814383 usec, L: 0
0619 19:53:52.220526 (+ 182us) write_op.cc:270] Start()
0619 19:53:52.220547 (+ 21us) write_op.cc:276] Timestamp: P: 1781898828830385 usec, L: 0
0619 19:53:52.220740 (+ 193us) write_op.cc:270] Start()
0619 19:53:52.220762 (+ 22us) write_op.cc:276] Timestamp: P: 1781898828848723 usec, L: 0
0619 19:53:52.220904 (+ 142us) write_op.cc:270] Start()
0619 19:53:52.220923 (+ 19us) write_op.cc:276] Timestamp: P: 1781898828865666 usec, L: 0
0619 19:53:52.221060 (+ 137us) write_op.cc:270] Start()
0619 19:53:52.221080 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828887183 usec, L: 0
0619 19:53:52.223868 (+ 2788us) write_op.cc:270] Start()
0619 19:53:52.223911 (+ 43us) write_op.cc:276] Timestamp: P: 1781898828924500 usec, L: 0
0619 19:53:52.224146 (+ 235us) write_op.cc:270] Start()
0619 19:53:52.224172 (+ 26us) write_op.cc:276] Timestamp: P: 1781898828949782 usec, L: 0
0619 19:53:52.224345 (+ 173us) write_op.cc:270] Start()
0619 19:53:52.224367 (+ 22us) write_op.cc:276] Timestamp: P: 1781898828963051 usec, L: 0
0619 19:53:52.224504 (+ 137us) write_op.cc:270] Start()
0619 19:53:52.224529 (+ 25us) write_op.cc:276] Timestamp: P: 1781898828974644 usec, L: 0
0619 19:53:52.224673 (+ 144us) write_op.cc:270] Start()
0619 19:53:52.224709 (+ 36us) write_op.cc:276] Timestamp: P: 1781898828986827 usec, L: 0
0619 19:53:52.224860 (+ 151us) write_op.cc:270] Start()
0619 19:53:52.224880 (+ 20us) write_op.cc:276] Timestamp: P: 1781898828994300 usec, L: 0
0619 19:53:52.225004 (+ 124us) write_op.cc:270] Start()
0619 19:53:52.225021 (+ 17us) write_op.cc:276] Timestamp: P: 1781898829000260 usec, L: 0
0619 19:53:52.225142 (+ 121us) write_op.cc:270] Start()
0619 19:53:52.225158 (+ 16us) write_op.cc:276] Timestamp: P: 1781898829004413 usec, L: 0
0619 19:53:52.225298 (+ 140us) write_op.cc:270] Start()
0619 19:53:52.225324 (+ 26us) write_op.cc:276] Timestamp: P: 1781898829008257 usec, L: 0
0619 19:53:52.225455 (+ 131us) write_op.cc:270] Start()
0619 19:53:52.225472 (+ 17us) write_op.cc:276] Timestamp: P: 1781898829031369 usec, L: 0
0619 19:53:52.225595 (+ 123us) write_op.cc:270] Start()
0619 19:53:52.225616 (+ 21us) write_op.cc:276] Timestamp: P: 1781898829032287 usec, L: 0
0619 19:53:52.267452 (+ 41836us) write_op.cc:270] Start()
0619 19:53:52.267501 (+ 49us) write_op.cc:276] Timestamp: P: 1781898829041009 usec, L: 0
0619 19:53:52.267933 (+ 432us) write_op.cc:270] Start()
0619 19:53:52.267973 (+ 40us) write_op.cc:276] Timestamp: P: 1781898829048853 usec, L: 0
0619 19:53:52.268237 (+ 264us) write_op.cc:270] Start()
0619 19:53:52.268264 (+ 27us) write_op.cc:276] Timestamp: P: 1781898829068532 usec, L: 0
0619 19:53:52.268419 (+ 155us) write_op.cc:270] Start()
0619 19:53:52.268439 (+ 20us) write_op.cc:276] Timestamp: P: 1781898829104542 usec, L: 0
0619 19:53:52.268578 (+ 139us) write_op.cc:270] Start()
0619 19:53:52.268604 (+ 26us) write_op.cc:276] Timestamp: P: 1781898829108534 usec, L: 0
0619 19:53:52.268758 (+ 154us) write_op.cc:270] Start()
0619 19:53:52.268780 (+ 22us) write_op.cc:276] Timestamp: P: 1781898829109988 usec, L: 0
0619 19:53:52.268904 (+ 124us) write_op.cc:270] Start()
0619 19:53:52.268923 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829203466 usec, L: 0
0619 19:53:52.271640 (+ 2717us) write_op.cc:270] Start()
0619 19:53:52.271672 (+ 32us) write_op.cc:276] Timestamp: P: 1781898829277947 usec, L: 0
0619 19:53:52.271872 (+ 200us) write_op.cc:270] Start()
0619 19:53:52.271899 (+ 27us) write_op.cc:276] Timestamp: P: 1781898829297513 usec, L: 0
0619 19:53:52.272042 (+ 143us) write_op.cc:270] Start()
0619 19:53:52.272063 (+ 21us) write_op.cc:276] Timestamp: P: 1781898829298155 usec, L: 0
0619 19:53:52.272196 (+ 133us) write_op.cc:270] Start()
0619 19:53:52.272218 (+ 22us) write_op.cc:276] Timestamp: P: 1781898829298710 usec, L: 0
0619 19:53:52.272356 (+ 138us) write_op.cc:270] Start()
0619 19:53:52.272391 (+ 35us) write_op.cc:276] Timestamp: P: 1781898829302623 usec, L: 0
0619 19:53:52.272534 (+ 143us) write_op.cc:270] Start()
0619 19:53:52.272556 (+ 22us) write_op.cc:276] Timestamp: P: 1781898829319929 usec, L: 0
0619 19:53:52.272698 (+ 142us) write_op.cc:270] Start()
0619 19:53:52.272725 (+ 27us) write_op.cc:276] Timestamp: P: 1781898829323238 usec, L: 0
0619 19:53:52.272863 (+ 138us) write_op.cc:270] Start()
0619 19:53:52.272882 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829331338 usec, L: 0
0619 19:53:52.273045 (+ 163us) write_op.cc:270] Start()
0619 19:53:52.273065 (+ 20us) write_op.cc:276] Timestamp: P: 1781898829332005 usec, L: 0
0619 19:53:52.273219 (+ 154us) write_op.cc:270] Start()
0619 19:53:52.273238 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829341306 usec, L: 0
0619 19:53:52.273365 (+ 127us) write_op.cc:270] Start()
0619 19:53:52.273396 (+ 31us) write_op.cc:276] Timestamp: P: 1781898829341975 usec, L: 0
0619 19:53:52.273587 (+ 191us) write_op.cc:270] Start()
0619 19:53:52.273614 (+ 27us) write_op.cc:276] Timestamp: P: 1781898829349503 usec, L: 0
0619 19:53:52.273725 (+ 111us) write_op.cc:270] Start()
0619 19:53:52.273743 (+ 18us) write_op.cc:276] Timestamp: P: 1781898829364326 usec, L: 0
0619 19:53:52.273872 (+ 129us) write_op.cc:270] Start()
0619 19:53:52.273892 (+ 20us) write_op.cc:276] Timestamp: P: 1781898829384260 usec, L: 0
0619 19:53:52.274046 (+ 154us) write_op.cc:270] Start()
0619 19:53:52.274067 (+ 21us) write_op.cc:276] Timestamp: P: 1781898829391268 usec, L: 0
0619 19:53:52.274207 (+ 140us) write_op.cc:270] Start()
0619 19:53:52.274224 (+ 17us) write_op.cc:276] Timestamp: P: 1781898829436510 usec, L: 0
0619 19:53:52.274359 (+ 135us) write_op.cc:270] Start()
0619 19:53:52.274395 (+ 36us) write_op.cc:276] Timestamp: P: 1781898829459239 usec, L: 0
0619 19:53:52.274545 (+ 150us) write_op.cc:270] Start()
0619 19:53:52.274565 (+ 20us) write_op.cc:276] Timestamp: P: 1781898829540049 usec, L: 0
0619 19:53:52.274716 (+ 151us) write_op.cc:270] Start()
0619 19:53:52.274742 (+ 26us) write_op.cc:276] Timestamp: P: 1781898829550218 usec, L: 0
0619 19:53:52.295489 (+ 20747us) write_op.cc:270] Start()
0619 19:53:52.295532 (+ 43us) write_op.cc:276] Timestamp: P: 1781898829557915 usec, L: 0
0619 19:53:52.295743 (+ 211us) write_op.cc:270] Start()
0619 19:53:52.295772 (+ 29us) write_op.cc:276] Timestamp: P: 1781898829578416 usec, L: 0
0619 19:53:52.295947 (+ 175us) write_op.cc:270] Start()
0619 19:53:52.295972 (+ 25us) write_op.cc:276] Timestamp: P: 1781898829857674 usec, L: 0
0619 19:53:52.297261 (+ 1289us) write_op.cc:270] Start()
0619 19:53:52.297297 (+ 36us) write_op.cc:276] Timestamp: P: 1781898829858995 usec, L: 0
0619 19:53:52.297534 (+ 237us) write_op.cc:270] Start()
0619 19:53:52.297555 (+ 21us) write_op.cc:276] Timestamp: P: 1781898829861184 usec, L: 0
0619 19:53:52.297720 (+ 165us) write_op.cc:270] Start()
0619 19:53:52.297742 (+ 22us) write_op.cc:276] Timestamp: P: 1781898829861768 usec, L: 0
0619 19:53:52.297872 (+ 130us) write_op.cc:270] Start()
0619 19:53:52.297913 (+ 41us) write_op.cc:276] Timestamp: P: 1781898829866457 usec, L: 0
0619 19:53:52.298034 (+ 121us) write_op.cc:270] Start()
0619 19:53:52.298051 (+ 17us) write_op.cc:276] Timestamp: P: 1781898829869804 usec, L: 0
0619 19:53:52.298210 (+ 159us) write_op.cc:270] Start()
0619 19:53:52.298241 (+ 31us) write_op.cc:276] Timestamp: P: 1781898829870680 usec, L: 0
0619 19:53:52.298375 (+ 134us) write_op.cc:270] Start()
0619 19:53:52.298394 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829893767 usec, L: 0
0619 19:53:52.298535 (+ 141us) write_op.cc:270] Start()
0619 19:53:52.298554 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829921988 usec, L: 0
0619 19:53:52.298720 (+ 166us) write_op.cc:270] Start()
0619 19:53:52.298740 (+ 20us) write_op.cc:276] Timestamp: P: 1781898829922688 usec, L: 0
0619 19:53:52.298860 (+ 120us) write_op.cc:270] Start()
0619 19:53:52.298878 (+ 18us) write_op.cc:276] Timestamp: P: 1781898829923757 usec, L: 0
0619 19:53:52.299019 (+ 141us) write_op.cc:270] Start()
0619 19:53:52.299040 (+ 21us) write_op.cc:276] Timestamp: P: 1781898829975715 usec, L: 0
0619 19:53:52.299203 (+ 163us) write_op.cc:270] Start()
0619 19:53:52.299225 (+ 22us) write_op.cc:276] Timestamp: P: 1781898829976549 usec, L: 0
0619 19:53:52.299381 (+ 156us) write_op.cc:270] Start()
0619 19:53:52.299401 (+ 20us) write_op.cc:276] Timestamp: P: 1781898829980170 usec, L: 0
0619 19:53:52.299529 (+ 128us) write_op.cc:270] Start()
0619 19:53:52.299548 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829988146 usec, L: 0
0619 19:53:52.299675 (+ 127us) write_op.cc:270] Start()
0619 19:53:52.299694 (+ 19us) write_op.cc:276] Timestamp: P: 1781898829988706 usec, L: 0
0619 19:53:52.299823 (+ 129us) write_op.cc:270] Start()
0619 19:53:52.299842 (+ 19us) write_op.cc:276] Timestamp: P: 1781898830094399 usec, L: 0
0619 19:53:52.299968 (+ 126us) write_op.cc:270] Start()
0619 19:53:52.299989 (+ 21us) write_op.cc:276] Timestamp: P: 1781898830095355 usec, L: 0
0619 19:53:52.300108 (+ 119us) write_op.cc:270] Start()
0619 19:53:52.300130 (+ 22us) write_op.cc:276] Timestamp: P: 1781898830126001 usec, L: 0
0619 19:53:52.300300 (+ 170us) write_op.cc:270] Start()
0619 19:53:52.300324 (+ 24us) write_op.cc:276] Timestamp: P: 1781898830127957 usec, L: 0
0619 19:53:52.300474 (+ 150us) write_op.cc:270] Start()
0619 19:53:52.300493 (+ 19us) write_op.cc:276] Timestamp: P: 1781898830177019 usec, L: 0
0619 19:53:52.300666 (+ 173us) write_op.cc:270] Start()
0619 19:53:52.300687 (+ 21us) write_op.cc:276] Timestamp: P: 1781898830186266 usec, L: 0
0619 19:53:52.300864 (+ 177us) write_op.cc:270] Start()
0619 19:53:52.300890 (+ 26us) write_op.cc:276] Timestamp: P: 1781898830188875 usec, L: 0
0619 19:53:52.301031 (+ 141us) write_op.cc:270] Start()
0619 19:53:52.301070 (+ 39us) write_op.cc:276] Timestamp: P: 1781898830190989 usec, L: 0
0619 19:53:52.301208 (+ 138us) write_op.cc:270] Start()
0619 19:53:52.301226 (+ 18us) write_op.cc:276] Timestamp: P: 1781898830192541 usec, L: 0
0619 19:53:52.301400 (+ 174us) write_op.cc:270] Start()
0619 19:53:52.301422 (+ 22us) write_op.cc:276] Timestamp: P: 1781898830200091 usec, L: 0
0619 19:53:52.301604 (+ 182us) write_op.cc:270] Start()
0619 19:53:52.301625 (+ 21us) write_op.cc:276] Timestamp: P: 1781898830221331 usec, L: 0
0619 19:53:52.301774 (+ 149us) write_op.cc:270] Start()
0619 19:53:52.301795 (+ 21us) write_op.cc:276] Timestamp: P: 1781898830246591 usec, L: 0
0619 19:53:52.301959 (+ 164us) write_op.cc:270] Start()
0619 19:53:52.301982 (+ 23us) write_op.cc:276] Timestamp: P: 1781898830253027 usec, L: 0
0619 19:53:52.302118 (+ 136us) write_op.cc:270] Start()
0619 19:53:52.302138 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830283266 usec, L: 0
0619 19:53:52.302299 (+ 161us) write_op.cc:270] Start()
0619 19:53:52.302319 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830300437 usec, L: 0
0619 19:53:52.302437 (+ 118us) write_op.cc:270] Start()
0619 19:53:52.302455 (+ 18us) write_op.cc:276] Timestamp: P: 1781898830318575 usec, L: 0
0619 19:53:52.302589 (+ 134us) write_op.cc:270] Start()
0619 19:53:52.302606 (+ 17us) write_op.cc:276] Timestamp: P: 1781898830339290 usec, L: 0
0619 19:53:52.302757 (+ 151us) write_op.cc:270] Start()
0619 19:53:52.302777 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830354608 usec, L: 0
0619 19:53:52.302956 (+ 179us) write_op.cc:270] Start()
0619 19:53:52.302976 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830365923 usec, L: 0
0619 19:53:52.323653 (+ 20677us) write_op.cc:270] Start()
0619 19:53:52.323692 (+ 39us) write_op.cc:276] Timestamp: P: 1781898830415006 usec, L: 0
0619 19:53:52.323955 (+ 263us) write_op.cc:270] Start()
0619 19:53:52.323984 (+ 29us) write_op.cc:276] Timestamp: P: 1781898830421348 usec, L: 0
0619 19:53:52.324144 (+ 160us) write_op.cc:270] Start()
0619 19:53:52.324164 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830449432 usec, L: 0
0619 19:53:52.324393 (+ 229us) write_op.cc:270] Start()
0619 19:53:52.324416 (+ 23us) write_op.cc:276] Timestamp: P: 1781898830453785 usec, L: 0
0619 19:53:52.324568 (+ 152us) write_op.cc:270] Start()
0619 19:53:52.324593 (+ 25us) write_op.cc:276] Timestamp: P: 1781898830484597 usec, L: 0
0619 19:53:52.324754 (+ 161us) write_op.cc:270] Start()
0619 19:53:52.324823 (+ 69us) write_op.cc:276] Timestamp: P: 1781898830490106 usec, L: 0
0619 19:53:52.325013 (+ 190us) write_op.cc:270] Start()
0619 19:53:52.325043 (+ 30us) write_op.cc:276] Timestamp: P: 1781898830523670 usec, L: 0
0619 19:53:52.325196 (+ 153us) write_op.cc:270] Start()
0619 19:53:52.325216 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830537884 usec, L: 0
0619 19:53:52.325383 (+ 167us) write_op.cc:270] Start()
0619 19:53:52.325403 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830545072 usec, L: 0
0619 19:53:52.325540 (+ 137us) write_op.cc:270] Start()
0619 19:53:52.325560 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830548356 usec, L: 0
0619 19:53:52.325697 (+ 137us) write_op.cc:270] Start()
0619 19:53:52.325717 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830579903 usec, L: 0
0619 19:53:52.325929 (+ 212us) write_op.cc:270] Start()
0619 19:53:52.325952 (+ 23us) write_op.cc:276] Timestamp: P: 1781898830580625 usec, L: 0
0619 19:53:52.326102 (+ 150us) write_op.cc:270] Start()
0619 19:53:52.326130 (+ 28us) write_op.cc:276] Timestamp: P: 1781898830581326 usec, L: 0
0619 19:53:52.326283 (+ 153us) write_op.cc:270] Start()
0619 19:53:52.326306 (+ 23us) write_op.cc:276] Timestamp: P: 1781898830581954 usec, L: 0
0619 19:53:52.326439 (+ 133us) write_op.cc:270] Start()
0619 19:53:52.326462 (+ 23us) write_op.cc:276] Timestamp: P: 1781898830582502 usec, L: 0
0619 19:53:52.326598 (+ 136us) write_op.cc:270] Start()
0619 19:53:52.326622 (+ 24us) write_op.cc:276] Timestamp: P: 1781898830612457 usec, L: 0
0619 19:53:52.326789 (+ 167us) write_op.cc:270] Start()
0619 19:53:52.326809 (+ 20us) write_op.cc:276] Timestamp: P: 1781898830936455 usec, L: 0
0619 19:53:52.326937 (+ 128us) write_op.cc:270] Start()
0619 19:53:52.326953 (+ 16us) write_op.cc:276] Timestamp: P: 1781898830937155 usec, L: 0
0619 19:53:52.327064 (+ 111us) write_op.cc:270] Start()
0619 19:53:52.327080 (+ 16us) write_op.cc:276] Timestamp: P: 1781898830938514 usec, L: 0
0619 19:53:52.327210 (+ 130us) write_op.cc:270] Start()
0619 19:53:52.327227 (+ 17us) write_op.cc:276] Timestamp: P: 1781898830942925 usec, L: 0
0619 19:53:52.327369 (+ 142us) write_op.cc:270] Start()
0619 19:53:52.327389 (+ 20us) write_op.cc:276] Timestamp: P: 1781898831003675 usec, L: 0
0619 19:53:52.327508 (+ 119us) write_op.cc:270] Start()
0619 19:53:52.327527 (+ 19us) write_op.cc:276] Timestamp: P: 1781898831006455 usec, L: 0
0619 19:53:52.327666 (+ 139us) write_op.cc:270] Start()
0619 19:53:52.327690 (+ 24us) write_op.cc:276] Timestamp: P: 1781898831011473 usec, L: 0
0619 19:53:52.327822 (+ 132us) write_op.cc:270] Start()
0619 19:53:52.327842 (+ 20us) write_op.cc:276] Timestamp: P: 1781898831075562 usec, L: 0
0619 19:53:52.378034 (+ 50192us) log.cc:844] Serialized 112253 byte log entry
0619 19:53:52.383730 (+ 5696us) raft_consensus.cc:1645] Marking committed up to 192
0619 19:53:52.383921 (+ 191us) log.cc:844] Serialized 14 byte log entry
0619 19:53:52.400355 (+ 16434us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.400361 (+ 6us) write_op.cc:454] Released schema lock
0619 19:53:52.402247 (+ 1886us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.402252 (+ 5us) write_op.cc:454] Released schema lock
0619 19:53:52.403710 (+ 1458us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.403714 (+ 4us) write_op.cc:454] Released schema lock
0619 19:53:52.407693 (+ 3979us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.407700 (+ 7us) write_op.cc:454] Released schema lock
0619 19:53:52.409050 (+ 1350us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.409055 (+ 5us) write_op.cc:454] Released schema lock
0619 19:53:52.410231 (+ 1176us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.410237 (+ 6us) write_op.cc:454] Released schema lock
0619 19:53:52.411368 (+ 1131us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.411385 (+ 17us) write_op.cc:454] Released schema lock
0619 19:53:52.412927 (+ 1542us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.412932 (+ 5us) write_op.cc:454] Released schema lock
0619 19:53:52.413889 (+ 957us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:52.413899 (+ 10us) write_op.cc:454] Released schema lock
0619 19:53:52.419548 (+ 5649us) write_op.cc:489] Releasing partition, row a
W20260619 19:53:53.380066 859 leader_election.cc:343] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: da983715197847f18466d61f1eade0f5
I20260619 19:53:53.380586 1576 tablet.cc:1724] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:53.375873 1208 tablet_bootstrap.cc:492] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.382885 1208 tablet_bootstrap.cc:654] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.397116 1542 tablet.cc:1724] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:53:53.398087 1540 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:53:53.406160 1523 raft_consensus.cc:493] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.406366 1523 raft_consensus.cc:515] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.407348 1523 leader_election.cc:290] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.408366 1200 tablet_bootstrap.cc:654] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.408456 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e1eed89f54b809ac52efe2226dc35" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:53.409473 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e1eed89f54b809ac52efe2226dc35" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:53.408648 1540 tablet.cc:1724] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260619 19:53:53.409147 996 leader_election.cc:343] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:53.416603 996 leader_election.cc:343] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.416819 996 leader_election.cc:304] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:53.417111 1523 raft_consensus.cc:2749] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:53.418838 1436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2d38b77ff37948e19592b36b6d884fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:53.419097 1436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:53.420677 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb8df8d8ac047bfa6ab7a6b533e38fc" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:53.421720 996 leader_election.cc:343] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.421911 996 leader_election.cc:304] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:53.422652 1523 raft_consensus.cc:2749] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:53.426245 1576 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:53:53.431536 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 91e43148bb5b47128e08ed7faf8c7c1f
I20260619 19:53:53.432225 599 catalog_manager.cc:6784] ReplaceTablet: tablet 91e43148bb5b47128e08ed7faf8c7c1f deleted and replaced by tablet 7e3a8c4b651545c9ad620be798c63b53
I20260619 19:53:53.432686 599 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_44549b66c4e94538a73089d9d7ebb012" } new_table_name: "default.Table_d23a54ae1ba943d39d8bee350a57ff40" modify_external_catalogs: true
I20260619 19:53:53.433022 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.433825 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.434103 1200 tablet_bootstrap.cc:492] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.434262 1200 ts_tablet_manager.cc:1403] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.003s
I20260619 19:53:53.434384 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 732a2e073e3442ff873ca00be6106744
I20260619 19:53:53.434901 598 catalog_manager.cc:6784] ReplaceTablet: tablet 732a2e073e3442ff873ca00be6106744 deleted and replaced by tablet d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:53:53.435309 598 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_73c7fd0a90bd417bbeec5f8f4d751d91" } new_table_name: "default.Table_ec6d85adf799497db51a92f71faf281a" modify_external_catalogs: true
I20260619 19:53:53.437398 601 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_313c53f0872044b4a83cffd864500c94 [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 1 got 0
I20260619 19:53:53.437799 601 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a6b5f1da20614838aac1a0175ad4a67d (table default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1]). Expected version 1 got 0
I20260619 19:53:53.438023 601 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]). Expected version 1 got 0
I20260619 19:53:53.439246 597 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb] alter complete (version 2)
I20260619 19:53:53.439885 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_42bea76dd9e34906994129bb6ccc40d5" } new_table_name: "default.Table_7ae6ef4dc2a74b9babb2925078822313" modify_external_catalogs: true
I20260619 19:53:53.440172 1537 raft_consensus.cc:493] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.440441 1537 raft_consensus.cc:515] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.441322 1537 leader_election.cc:290] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.441934 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_cb217bdd772449f1be66750ef07f063b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.442420 1208 tablet_bootstrap.cc:492] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
W20260619 19:53:53.442534 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb217bdd772449f1be66750ef07f063b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.442596 1208 ts_tablet_manager.cc:1403] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.001s
I20260619 19:53:53.439077 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_cdaa064b7d3c46a9842fd5a4ac38f619"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.443732 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 732a2e073e3442ff873ca00be6106744 with delete_type TABLET_DATA_DELETED (replaced by tablet d0a9c96d9c034a4a8a4d05d8518ebcec) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:53.443881 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.445848 1200 raft_consensus.cc:359] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.446064 1200 raft_consensus.cc:385] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.446098 596 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 48998cebcc844a60901799b25be4fb69
I20260619 19:53:53.446161 1200 raft_consensus.cc:740] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.446414 1200 consensus_queue.cc:260] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.446975 1200 ts_tablet_manager.cc:1434] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20260619 19:53:53.450552 1208 raft_consensus.cc:359] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.454005 1208 raft_consensus.cc:385] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.455318 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 550297c4d14f4d679d11fded97b671ae
I20260619 19:53:53.456760 1208 raft_consensus.cc:740] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.457129 1208 consensus_queue.cc:260] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.457882 1208 ts_tablet_manager.cc:1434] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260619 19:53:53.458374 1208 tablet_bootstrap.cc:492] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.459360 596 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_c73a82d38a4545cc8940056415afdc2b [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 2 got 1
I20260619 19:53:53.459714 596 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 304e1eed89f54b809ac52efe2226dc35 (table default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]). Expected version 1 got 0
I20260619 19:53:53.461458 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.461833 1058 raft_consensus.cc:2468] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.462421 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5e5e821d9bce47c3afd7e90f90ecbc7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.462548 720 leader_election.cc:304] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.463145 1537 raft_consensus.cc:2804] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.463382 1537 raft_consensus.cc:493] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.463581 1537 raft_consensus.cc:3060] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:53.463843 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e5e821d9bce47c3afd7e90f90ecbc7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.464277 1200 tablet_bootstrap.cc:492] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.465524 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_632006bb13d74ee3aa918786f1448683" } new_table_name: "default.Table_55cb53e830ed49f388e2fcf9f9bfff1d" modify_external_catalogs: true
I20260619 19:53:53.466148 1200 tablet_bootstrap.cc:654] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.468107 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_c8c43c1f76624e4d8d4429389c71c3e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.468549 920 raft_consensus.cc:3060] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:53.468881 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8c43c1f76624e4d8d4429389c71c3e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.469270 1567 raft_consensus.cc:493] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.469483 1567 raft_consensus.cc:515] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.470407 1567 leader_election.cc:290] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.471030 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.471405 1523 raft_consensus.cc:493] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.471642 1523 raft_consensus.cc:515] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.472479 1523 leader_election.cc:290] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.473117 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.473383 1058 raft_consensus.cc:2468] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.473853 720 leader_election.cc:304] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.473960 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:53.474303 1567 raft_consensus.cc:2804] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.474426 1567 raft_consensus.cc:493] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.474519 1567 raft_consensus.cc:3060] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:53.474795 996 leader_election.cc:343] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.475345 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:53.476397 996 leader_election.cc:343] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.476649 996 leader_election.cc:304] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:53.477279 1523 raft_consensus.cc:2749] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:53.477478 1567 raft_consensus.cc:515] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.478070 1537 raft_consensus.cc:515] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.478226 1567 leader_election.cc:290] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.479095 1537 leader_election.cc:290] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.479357 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:53.479736 1059 raft_consensus.cc:3060] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.480492 1208 tablet_bootstrap.cc:654] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.480937 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 7e3a8c4b651545c9ad620be798c63b53) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:53.480993 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:53.481300 1061 raft_consensus.cc:3060] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:53.482784 590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 54120.4us
I20260619 19:53:53.485050 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 7e3a8c4b651545c9ad620be798c63b53) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.486562 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 732a2e073e3442ff873ca00be6106744 with delete_type TABLET_DATA_DELETED (replaced by tablet d0a9c96d9c034a4a8a4d05d8518ebcec) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.486912 1248 tablet_replica.cc:333] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:53.487110 1248 raft_consensus.cc:2243] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:53.487452 1248 pending_rounds.cc:70] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:53:53.487527 1248 pending_rounds.cc:77] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657619576975360 op_type: NO_OP noop_request { }
I20260619 19:53:53.487674 1248 raft_consensus.cc:2889] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:53.487769 1248 raft_consensus.cc:2272] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:53.488590 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 732a2e073e3442ff873ca00be6106744 with delete_type TABLET_DATA_DELETED (replaced by tablet d0a9c96d9c034a4a8a4d05d8518ebcec) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.488879 1247 tablet_replica.cc:333] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:53.489094 1247 raft_consensus.cc:2243] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:53.489250 1247 raft_consensus.cc:2272] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:53.490518 1247 ts_tablet_manager.cc:1916] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:53.492367 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 70716f209500400cae29b20ee1cb4882 with delete_type TABLET_DATA_DELETED (replaced by tablet d4771739543f4b4189b7d603f76325f0) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.493608 1248 ts_tablet_manager.cc:1916] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:53.494807 1405 raft_consensus.cc:493] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.495031 1405 raft_consensus.cc:515] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.496162 1405 leader_election.cc:290] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.497735 764 tablet_service.cc:1558] Processing DeleteTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.498415 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:53.499073 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.499761 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.500560 1060 raft_consensus.cc:2393] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:53.507922 1248 ts_tablet_manager.cc:1929] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:53.511435 1059 raft_consensus.cc:2468] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:53.513068 1061 raft_consensus.cc:2468] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:53:53.513464 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 91e43148bb5b47128e08ed7faf8c7c1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91e43148bb5b47128e08ed7faf8c7c1f already in progress: creating tablet
I20260619 19:53:53.516847 1523 consensus_queue.cc:1048] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.512574 720 leader_election.cc:304] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.515014 1567 raft_consensus.cc:493] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.519649 1567 raft_consensus.cc:515] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.520390 1567 leader_election.cc:290] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.521319 1567 raft_consensus.cc:2804] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:53.521270 1542 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:53.521562 1567 raft_consensus.cc:697] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:53.521827 1567 consensus_queue.cc:237] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.525122 1247 ts_tablet_manager.cc:1929] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:53.525281 1247 log.cc:1199] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/732a2e073e3442ff873ca00be6106744
I20260619 19:53:53.525684 1247 ts_tablet_manager.cc:1950] T 732a2e073e3442ff873ca00be6106744 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:53.525879 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 7e3a8c4b651545c9ad620be798c63b53) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:53.528138 1248 log.cc:1199] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/732a2e073e3442ff873ca00be6106744
I20260619 19:53:53.528638 1248 ts_tablet_manager.cc:1950] T 732a2e073e3442ff873ca00be6106744 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:53:53.529311 719 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 217291us
I20260619 19:53:53.529918 1248 tablet_replica.cc:333] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:53.531194 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:53.533605 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 732a2e073e3442ff873ca00be6106744 (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
I20260619 19:53:53.534044 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 732a2e073e3442ff873ca00be6106744 (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
I20260619 19:53:53.535732 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:53.532063 1449 consensus_queue.cc:1048] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.528288 1407 raft_consensus.cc:515] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.538321 1407 leader_election.cc:290] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.539510 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:53.540508 1248 raft_consensus.cc:2243] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:53.541082 1248 raft_consensus.cc:2272] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:53.541821 1248 ts_tablet_manager.cc:1916] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:53.543463 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:53.545302 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:53.552835 1540 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:53:53.555687 599 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30e606b958d940c6a353a09a2eb627ee consensus state has no leader
I20260619 19:53:53.557328 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_698d85f35094447cb80bcdb59119c41d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.558363 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_698d85f35094447cb80bcdb59119c41d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:53.559636 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c54b2e4f657245c2aa23d138968b3b0d has no consensus state
I20260619 19:53:53.560075 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f499d3b7eac649a7b6f05c64db213152"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.560513 598 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79f8635b919a44a8a1e5fe48420ca4b7 consensus state has no leader
W20260619 19:53:53.560739 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f499d3b7eac649a7b6f05c64db213152 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.561388 599 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_c73a82d38a4545cc8940056415afdc2b [id=394d8c70bca54b0eb32990278e06cd91]). Expected version 2 got 1
I20260619 19:53:53.561915 599 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]). Expected version 4 got 0
I20260619 19:53:53.562332 599 catalog_manager.cc:5696] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:53.562877 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0afdcf96247b0a16c8f9ac71cc24a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.562901 599 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]). Expected version 1 got 0
I20260619 19:53:53.563107 1061 raft_consensus.cc:2468] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.564253 598 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9a70fe99a1294387a1ac81cbd29c2647" } modify_external_catalogs: true
I20260619 19:53:53.564383 595 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_03e300273881446b96748d3f1700e660" } modify_external_catalogs: true
I20260619 19:53:53.564469 598 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9a70fe99a1294387a1ac81cbd29c2647" } modify_external_catalogs: true
I20260619 19:53:53.564560 595 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_03e300273881446b96748d3f1700e660" } modify_external_catalogs: true
I20260619 19:53:53.566977 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:53.567231 1061 raft_consensus.cc:3060] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.568005 603 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7d551806d81544f7ad830cb1c7c9f6c6" } modify_external_catalogs: true
I20260619 19:53:53.568202 603 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_7d551806d81544f7ad830cb1c7c9f6c6" } modify_external_catalogs: true
I20260619 19:53:53.570598 1061 raft_consensus.cc:2468] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:53.575008 720 leader_election.cc:304] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.575371 1208 tablet_bootstrap.cc:492] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.577158 1208 ts_tablet_manager.cc:1403] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.002s
I20260619 19:53:53.584343 1523 raft_consensus.cc:493] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.584811 1523 raft_consensus.cc:515] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.585944 1523 leader_election.cc:290] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.588107 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9c959792fa48e89b669520f7332b26" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:53.588477 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5397e7b4951344259694a66e18f7fd6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.589249 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5397e7b4951344259694a66e18f7fd6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.575778 1584 raft_consensus.cc:2804] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:53:53.592105 996 leader_election.cc:343] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.592344 1584 raft_consensus.cc:697] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:53.593104 1208 raft_consensus.cc:359] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.593276 1208 raft_consensus.cc:385] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.593371 1208 raft_consensus.cc:740] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.592790 1584 consensus_queue.cc:237] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.594436 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0afdcf96247b0a16c8f9ac71cc24a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:53.575601 720 leader_election.cc:304] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.594810 921 raft_consensus.cc:2468] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.595177 720 leader_election.cc:304] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:53.595472 720 raft_consensus.cc:2686] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:53:53.595755 1566 raft_consensus.cc:2804] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.596403 1566 raft_consensus.cc:493] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.597590 890 tablet_service.cc:1511] Processing CreateTablet for tablet cbec819571854db8a46daae15b9127bd (DEFAULT_TABLE table=default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.598044 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbec819571854db8a46daae15b9127bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.599521 1247 tablet_replica.cc:333] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:53.599740 1247 raft_consensus.cc:2243] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:53.599962 1247 raft_consensus.cc:2272] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:53.600521 1247 ts_tablet_manager.cc:1916] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:53.603511 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8c3aef303b94d58aaa24917399ac240 has no consensus state
I20260619 19:53:53.603838 600 master_service.cc:960] ReplaceTablet: received request to replace tablet 2d37d6f54a96471fad26a342cab984ef from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.602408 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd2fca96ee44cf297eb248b1f3ed00a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:53.604449 784 raft_consensus.cc:2468] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:53.605289 1566 raft_consensus.cc:3060] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.606890 1200 tablet_bootstrap.cc:492] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.607647 1200 ts_tablet_manager.cc:1403] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.160s user 0.006s sys 0.003s
I20260619 19:53:53.605713 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e9d98ec1084b2ea9c087238686ed38" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:53.608565 1200 raft_consensus.cc:359] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.608598 1577 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:53.608835 1200 raft_consensus.cc:385] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.608923 1200 raft_consensus.cc:740] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.609194 1200 consensus_queue.cc:260] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.610193 752 tablet_service.cc:1511] Processing CreateTablet for tablet cbec819571854db8a46daae15b9127bd (DEFAULT_TABLE table=default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.587666 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9c959792fa48e89b669520f7332b26" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:53.610690 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbec819571854db8a46daae15b9127bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.612396 1208 consensus_queue.cc:260] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:53.621166 996 leader_election.cc:343] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.621377 996 leader_election.cc:304] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:53.623581 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd210e843db4f58a976af5c28dabc9c (DEFAULT_TABLE table=default.Table_fa6e27c7a16c411e91a2913fda307afb [id=2daa177012434787b804b7721c3f91d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.623807 1041 tablet_service.cc:1511] Processing CreateTablet for tablet cbec819571854db8a46daae15b9127bd (DEFAULT_TABLE table=default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.624850 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 550297c4d14f4d679d11fded97b671ae (DEFAULT_TABLE table=default.Table_38a961b0cc2946c7b79e57cd66fbe323 [id=99ef9345e27d4380b7312b1cc8dc8b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.619913 1208 ts_tablet_manager.cc:1434] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260619 19:53:53.625208 1523 raft_consensus.cc:2749] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:53.624902 902 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd210e843db4f58a976af5c28dabc9c (DEFAULT_TABLE table=default.Table_fa6e27c7a16c411e91a2913fda307afb [id=2daa177012434787b804b7721c3f91d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.625478 1208 tablet_bootstrap.cc:492] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.625945 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd210e843db4f58a976af5c28dabc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.627436 1208 tablet_bootstrap.cc:654] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.627499 1566 raft_consensus.cc:515] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.628386 1566 leader_election.cc:290] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.629868 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0afdcf96247b0a16c8f9ac71cc24a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:53.630118 1061 raft_consensus.cc:3060] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.630199 1201 tablet_bootstrap.cc:492] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.630383 1201 ts_tablet_manager.cc:1403] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.364s user 0.103s sys 0.131s
I20260619 19:53:53.631315 1201 raft_consensus.cc:359] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.631529 1201 raft_consensus.cc:385] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.631613 1201 raft_consensus.cc:740] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.631910 1201 consensus_queue.cc:260] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.632469 1201 ts_tablet_manager.cc:1434] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:53.632822 1201 tablet_bootstrap.cc:492] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.633531 1061 raft_consensus.cc:2468] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:53.634438 1523 consensus_queue.cc:1048] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:53.638144 720 leader_election.cc:304] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.641367 1040 tablet_service.cc:1511] Processing CreateTablet for tablet e151dc97ad13456ba35708d50c9d7b26 (DEFAULT_TABLE table=default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.642282 1031 tablet_service.cc:1511] Processing CreateTablet for tablet bb56767231db42bebb75a45b5d512de3 (DEFAULT_TABLE table=default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.643038 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d27342783a5641d7a324e71183269308 (DEFAULT_TABLE table=default.Table_64306ac3336a496b97becea891be9344 [id=592df24d0a274aa7a92b1f1952627c0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.643803 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc (DEFAULT_TABLE table=default.Table_f2b7aed4e720476cb97127ea1b58db50 [id=0178c0c89c424890aeaa1e2bd32ed94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.644436 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 74f39941c13847d79e2b2c3ddd176533 (DEFAULT_TABLE table=default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.635124 1201 tablet_bootstrap.cc:654] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.648856 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:53:53.648928 858 leader_election.cc:343] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: da983715197847f18466d61f1eade0f5
I20260619 19:53:53.649125 858 leader_election.cc:304] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:53.649812 1514 raft_consensus.cc:2749] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:53.650501 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550297c4d14f4d679d11fded97b671ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.651744 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f39941c13847d79e2b2c3ddd176533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.652238 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c0ffb4629a46349ccfe473cc20cdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.652638 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27342783a5641d7a324e71183269308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.653378 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb56767231db42bebb75a45b5d512de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.653796 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e151dc97ad13456ba35708d50c9d7b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.654251 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd210e843db4f58a976af5c28dabc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.656982 1201 tablet_bootstrap.cc:492] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.657164 1201 ts_tablet_manager.cc:1403] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260619 19:53:53.658062 1201 raft_consensus.cc:359] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.658267 1201 raft_consensus.cc:385] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.658371 1201 raft_consensus.cc:740] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.658766 1201 consensus_queue.cc:260] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.659178 1200 ts_tablet_manager.cc:1434] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:53.659399 1201 ts_tablet_manager.cc:1434] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260619 19:53:53.659685 1201 tablet_bootstrap.cc:492] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.659778 1200 tablet_bootstrap.cc:492] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.661463 1201 tablet_bootstrap.cc:654] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.662578 1200 tablet_bootstrap.cc:654] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.665812 1405 raft_consensus.cc:493] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.666095 1405 raft_consensus.cc:515] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:53.666961 1405 leader_election.cc:290] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.672950 1038 tablet_service.cc:1511] Processing CreateTablet for tablet bb547965fc7e4aa29d427b1acc7d6e51 (DEFAULT_TABLE table=default.Table_66ddb27484c049a4a1043b72dd77d477 [id=1a15a941edb54adab68b83f9c30a77f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.673373 1248 ts_tablet_manager.cc:1929] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:53.673557 1248 log.cc:1199] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:53:53.673489 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 (DEFAULT_TABLE table=default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.673975 1248 ts_tablet_manager.cc:1950] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:53.683523 1566 raft_consensus.cc:2804] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:53.684414 1566 raft_consensus.cc:697] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:53.685185 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 19d6333b0c8940b2802307d0da8a57ac (DEFAULT_TABLE table=default.Table_62d0e0d461a74b99bac5c2251f7f7f63 [id=73d986c5f5974ea790e236843abdf930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.685309 1566 consensus_queue.cc:237] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.690107 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbec819571854db8a46daae15b9127bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.702610 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 (DEFAULT_TABLE table=default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.707412 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd210e843db4f58a976af5c28dabc9c (DEFAULT_TABLE table=default.Table_fa6e27c7a16c411e91a2913fda307afb [id=2daa177012434787b804b7721c3f91d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.708022 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd210e843db4f58a976af5c28dabc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.715317 858 leader_election.cc:304] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:53.715847 1405 raft_consensus.cc:2804] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.715974 1405 raft_consensus.cc:493] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.716050 1405 raft_consensus.cc:3060] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.718976 1405 raft_consensus.cc:515] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.720367 1405 leader_election.cc:290] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.720525 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d6333b0c8940b2802307d0da8a57ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.734248 596 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea] alter complete (version 4)
I20260619 19:53:53.755033 1201 tablet_bootstrap.cc:492] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.755281 1201 ts_tablet_manager.cc:1403] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.096s user 0.019s sys 0.015s
I20260619 19:53:53.755450 1208 tablet_bootstrap.cc:492] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.755700 1208 ts_tablet_manager.cc:1403] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.130s user 0.024s sys 0.020s
I20260619 19:53:53.756237 1201 raft_consensus.cc:359] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.756474 1201 raft_consensus.cc:385] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.756561 1201 raft_consensus.cc:740] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.756889 1201 consensus_queue.cc:260] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.757477 1201 ts_tablet_manager.cc:1434] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:53.756942 1208 raft_consensus.cc:359] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.757824 1208 raft_consensus.cc:385] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.757870 1201 tablet_bootstrap.cc:492] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.757989 1208 raft_consensus.cc:740] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.758419 1208 consensus_queue.cc:260] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.759073 1208 ts_tablet_manager.cc:1434] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:53.759687 1208 tablet_bootstrap.cc:492] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.760090 1201 tablet_bootstrap.cc:654] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.761651 1208 tablet_bootstrap.cc:654] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.764945 890 tablet_service.cc:1511] Processing CreateTablet for tablet 550297c4d14f4d679d11fded97b671ae (DEFAULT_TABLE table=default.Table_38a961b0cc2946c7b79e57cd66fbe323 [id=99ef9345e27d4380b7312b1cc8dc8b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.765509 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550297c4d14f4d679d11fded97b671ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.771021 1201 tablet_bootstrap.cc:492] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.771224 1201 ts_tablet_manager.cc:1403] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260619 19:53:53.772122 1201 raft_consensus.cc:359] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.772321 1201 raft_consensus.cc:385] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.772415 1201 raft_consensus.cc:740] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.772713 1201 consensus_queue.cc:260] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.773252 1201 ts_tablet_manager.cc:1434] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:53.773566 1201 tablet_bootstrap.cc:492] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.775455 1201 tablet_bootstrap.cc:654] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.777108 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 369cb2f2b599469680eed94a221c2f27 (DEFAULT_TABLE table=default.Table_c2dbeec92873437ab12eedf151dbd3ad [id=0030f2fdb14a4d4d850c1f61d7135a21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.777238 1331 ts_tablet_manager.cc:1929] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:53.777527 1331 log.cc:1199] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d29506dab4c84850ad79b8b7a0340987
I20260619 19:53:53.777596 1030 tablet_service.cc:1511] Processing CreateTablet for tablet a33cb04fdb8944e8817d51bd56806665 (DEFAULT_TABLE table=default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.778062 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8522f562665540ce99490ab90e02d801 (DEFAULT_TABLE table=default.Table_faa9be975d4742bf90dcee0feb53cc93 [id=b66ad69a759847bebf46963c43c5af2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.778395 1331 ts_tablet_manager.cc:1950] T d29506dab4c84850ad79b8b7a0340987 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:53.778908 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 08ef46cfced54742832fd3c01f952a9d (DEFAULT_TABLE table=default.Table_8d50f1b1ec814e8d85b077e1eb08a18c [id=c128b2a4a40748dabd196e9703c43254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.781140 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 160) took 1612 ms. Trace:
I20260619 19:53:53.783654 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb547965fc7e4aa29d427b1acc7d6e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.784508 1201 tablet_bootstrap.cc:492] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.784713 1201 ts_tablet_manager.cc:1403] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260619 19:53:53.784957 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (DEFAULT_TABLE table=default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.785370 1025 tablet_service.cc:1511] Processing CreateTablet for tablet fbc952b283d94035be1f86f3b90382b6 (DEFAULT_TABLE table=default.Table_03e300273881446b96748d3f1700e660 [id=54877119611f4e15a110f1c502001db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.785607 1201 raft_consensus.cc:359] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.785828 1201 raft_consensus.cc:385] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.785903 1201 raft_consensus.cc:740] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.786131 1201 consensus_queue.cc:260] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.786638 1201 ts_tablet_manager.cc:1434] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:53.786979 1201 tablet_bootstrap.cc:492] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.789198 1201 tablet_bootstrap.cc:654] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.791139 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (DEFAULT_TABLE table=default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.791509 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 6c396a42add84c62acecb9bbb5d57f1d (DEFAULT_TABLE table=default.Table_5315cb7e69284c01ab36267884d6abf5 [id=b9dc702105844f9a8864d15332e30313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.792075 1208 tablet_bootstrap.cc:492] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.792335 1208 ts_tablet_manager.cc:1403] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.003s
I20260619 19:53:53.793277 1208 raft_consensus.cc:359] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.793563 1208 raft_consensus.cc:385] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.793709 1208 raft_consensus.cc:740] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.794050 1208 consensus_queue.cc:260] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.797830 1208 ts_tablet_manager.cc:1434] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:53:53.798327 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3091dd1a525a4f779c68b8b77afa5b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.800000 1208 tablet_bootstrap.cc:492] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.801177 1200 tablet_bootstrap.cc:492] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:53.801316 1201 tablet_bootstrap.cc:492] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.801473 1201 ts_tablet_manager.cc:1403] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
I20260619 19:53:53.801493 1200 ts_tablet_manager.cc:1403] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.142s user 0.011s sys 0.003s
I20260619 19:53:53.801808 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8522f562665540ce99490ab90e02d801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.802217 1208 tablet_bootstrap.cc:654] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.802404 1201 raft_consensus.cc:359] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.802613 1201 raft_consensus.cc:385] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.802723 1201 raft_consensus.cc:740] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.802968 1201 consensus_queue.cc:260] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.803555 1201 ts_tablet_manager.cc:1434] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:53.803913 1201 tablet_bootstrap.cc:492] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.804247 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 983faf8557814093bc427291711f3fce (DEFAULT_TABLE table=default.Table_873b6850a58041da8c91101a792a1c80 [id=daffb1c409b74c799628ced1c9be2520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.805636 1201 tablet_bootstrap.cc:654] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:53.807474 859 leader_election.cc:343] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 60324f7edaac45ed919be7e2368a4fd5
I20260619 19:53:53.808719 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33cb04fdb8944e8817d51bd56806665. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:53.809046 859 leader_election.cc:343] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 7cd2fca96ee44cf297eb248b1f3ed00a
I20260619 19:53:53.810510 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c396a42add84c62acecb9bbb5d57f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.811702 1200 raft_consensus.cc:359] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.812191 1200 raft_consensus.cc:385] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.815106 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcb1050f57246feb65f7e8948856c21 (DEFAULT_TABLE table=default.Table_4e675d76500a491d93ec8709df95b206 [id=f6eb09cc59154cc7946ae43dc9e8a277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.815356 1460 mvcc.cc:204] Tried to move back new op lower bound from 7298657612085501952 to 7298657596390899712. Current Snapshot: MvccSnapshot[applied={T|T < 7298657612085501952 or (T in {7298657612085501952})}]
I20260619 19:53:53.815660 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c335fc5ca4885b5482c6b749f76f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.815935 1201 tablet_bootstrap.cc:492] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.816130 1201 ts_tablet_manager.cc:1403] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
I20260619 19:53:53.817090 1201 raft_consensus.cc:359] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.817310 1201 raft_consensus.cc:385] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.817391 1201 raft_consensus.cc:740] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.817448 1566 raft_consensus.cc:493] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.817624 1566 raft_consensus.cc:515] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.817642 1201 consensus_queue.cc:260] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.818215 1201 ts_tablet_manager.cc:1434] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:53.818329 1566 leader_election.cc:290] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:53.818584 1201 tablet_bootstrap.cc:492] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.820287 1201 tablet_bootstrap.cc:654] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.829046 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb8df8d8ac047bfa6ab7a6b533e38fc" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:53.829314 1061 raft_consensus.cc:2468] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:53.829993 720 leader_election.cc:304] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:53.830391 1566 raft_consensus.cc:2804] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:53.830504 1566 raft_consensus.cc:493] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:53.830585 1566 raft_consensus.cc:3060] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.835939 1566 raft_consensus.cc:515] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.837262 1200 raft_consensus.cc:740] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.837320 1566 leader_election.cc:290] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:53.840883 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 (DEFAULT_TABLE table=default.Table_baef1a6b19f94884934f0c54a4dda5d0 [id=d69648d0cdb042a3a4e487ef0cf0088b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.847709 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 91e43148bb5b47128e08ed7faf8c7c1f from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.847759 598 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 12258d3bcc714f34857d7362c49ee787
I20260619 19:53:53.848328 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 2d64ccbb2f2840f4ac51cf8556da4a2c from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.848775 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_bb4bd2ce8e5644659edd4c386859b4fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:53.848939 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_faa9be975d4742bf90dcee0feb53cc93" } new_table_name: "default.Table_377571595e3f44ee8f2df88f6a261499" modify_external_catalogs: true
W20260619 19:53:53.849596 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb4bd2ce8e5644659edd4c386859b4fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.850796 597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6597096e540440bb848c3ee8f9c3d828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.851375 597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6597096e540440bb848c3ee8f9c3d828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.851693 1201 tablet_bootstrap.cc:492] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.852305 1201 ts_tablet_manager.cc:1403] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.005s
I20260619 19:53:53.852540 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet fbc952b283d94035be1f86f3b90382b6
I20260619 19:53:53.853250 595 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_ecfc3772c4c647cebd6135fa76d00708" } modify_external_catalogs: true
I20260619 19:53:53.853252 1201 raft_consensus.cc:359] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.853461 1201 raft_consensus.cc:385] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.853438 595 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_ecfc3772c4c647cebd6135fa76d00708" } modify_external_catalogs: true
I20260619 19:53:53.853566 1201 raft_consensus.cc:740] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.853813 1201 consensus_queue.cc:260] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.854224 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_add3279cce4944a1a6e56b997e6093e7" } modify_external_catalogs: true
I20260619 19:53:53.854333 1201 ts_tablet_manager.cc:1434] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:53:53.854399 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_add3279cce4944a1a6e56b997e6093e7" } modify_external_catalogs: true
I20260619 19:53:53.854641 1201 tablet_bootstrap.cc:492] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.855342 603 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 45043b957f18446fa6b4a8ae22628ebd
I20260619 19:53:53.855611 603 master_service.cc:960] ReplaceTablet: received request to replace tablet 376dfca0b54d4c689c96242566869717 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.856081 601 master_service.cc:960] ReplaceTablet: received request to replace tablet c2c0afdcf96247b0a16c8f9ac71cc24a from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:53.856489 1201 tablet_bootstrap.cc:654] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.856626 601 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_cb217bdd772449f1be66750ef07f063b" } new_table_name: "default.Table_5768d3c75855417f86920d5378cce7de" modify_external_catalogs: true
I20260619 19:53:53.857895 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 2d37d6f54a96471fad26a342cab984ef
I20260619 19:53:53.858389 600 catalog_manager.cc:6784] ReplaceTablet: tablet 2d37d6f54a96471fad26a342cab984ef deleted and replaced by tablet 6b9cdbff79734eb7ac6590bdd40eadf0
I20260619 19:53:53.858683 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_4e675d76500a491d93ec8709df95b206" } new_table_name: "default.Table_d05b8e456c3d4318ae7e18b74c902408" modify_external_catalogs: true
I20260619 19:53:53.860054 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb8df8d8ac047bfa6ab7a6b533e38fc" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:53.860363 1061 raft_consensus.cc:3060] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:53.861299 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b0e811cf2a4bf4a23351f9ba5b6173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.863389 596 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1] alter complete (version 1)
I20260619 19:53:53.863539 1201 tablet_bootstrap.cc:492] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.863776 1201 ts_tablet_manager.cc:1403] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260619 19:53:53.864599 1201 raft_consensus.cc:359] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.864960 1201 raft_consensus.cc:385] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.865056 1201 raft_consensus.cc:740] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.865331 1201 consensus_queue.cc:260] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.865911 1201 ts_tablet_manager.cc:1434] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:53.866258 1201 tablet_bootstrap.cc:492] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.867189 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 991c877feeae43c580d9471c25c4424c (DEFAULT_TABLE table=default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.868072 1201 tablet_bootstrap.cc:654] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.870532 1201 tablet_bootstrap.cc:492] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:53.870683 1201 ts_tablet_manager.cc:1403] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260619 19:53:53.871826 1208 tablet_bootstrap.cc:492] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.872035 1208 ts_tablet_manager.cc:1403] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.004s
I20260619 19:53:53.872890 1208 raft_consensus.cc:359] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.873287 1208 raft_consensus.cc:385] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.873391 1208 raft_consensus.cc:740] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.873824 1208 consensus_queue.cc:260] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.874513 1208 ts_tablet_manager.cc:1434] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:53.874923 1208 tablet_bootstrap.cc:492] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:53.874553 1200 consensus_queue.cc:260] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.880677 1208 tablet_bootstrap.cc:654] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.881448 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ef46cfced54742832fd3c01f952a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.881999 1201 raft_consensus.cc:359] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.882436 1201 raft_consensus.cc:385] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.882653 1201 raft_consensus.cc:740] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.883483 1405 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.883610 1405 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.884596 1405 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.892302 1201 consensus_queue.cc:260] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.892992 1201 ts_tablet_manager.cc:1434] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260619 19:53:53.893332 1201 tablet_bootstrap.cc:492] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:53.895591 1201 tablet_bootstrap.cc:654] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.897819 752 tablet_service.cc:1511] Processing CreateTablet for tablet 550297c4d14f4d679d11fded97b671ae (DEFAULT_TABLE table=default.Table_38a961b0cc2946c7b79e57cd66fbe323 [id=99ef9345e27d4380b7312b1cc8dc8b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.898217 903 tablet_service.cc:1511] Processing CreateTablet for tablet e151dc97ad13456ba35708d50c9d7b26 (DEFAULT_TABLE table=default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.898471 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550297c4d14f4d679d11fded97b671ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.898648 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e151dc97ad13456ba35708d50c9d7b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.900094 1208 tablet_bootstrap.cc:492] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:53.900287 1208 ts_tablet_manager.cc:1403] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260619 19:53:53.901248 1208 raft_consensus.cc:359] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.902336 1208 raft_consensus.cc:385] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:53.902477 1208 raft_consensus.cc:740] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:53.902870 1208 consensus_queue.cc:260] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.903520 1208 ts_tablet_manager.cc:1434] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260619 19:53:53.904433 859 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:53:53.904665 1208 tablet_bootstrap.cc:492] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:53:53.910645 719 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:53.913924 1208 tablet_bootstrap.cc:654] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:53.919122 1566 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.919349 1566 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.920241 1566 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.921078 1405 raft_consensus.cc:493] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.921309 1405 raft_consensus.cc:515] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.921770 764 tablet_service.cc:1511] Processing CreateTablet for tablet e151dc97ad13456ba35708d50c9d7b26 (DEFAULT_TABLE table=default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.922295 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e151dc97ad13456ba35708d50c9d7b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.922518 1405 leader_election.cc:290] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:53.928042 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8522f562665540ce99490ab90e02d801 consensus state has no leader
I20260619 19:53:53.928485 602 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_66ddb27484c049a4a1043b72dd77d477" } new_table_name: "default.Table_9d38a479e3ed4d649131e8582f437265" modify_external_catalogs: true
I20260619 19:53:53.929805 596 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3] alter complete (version 4)
I20260619 19:53:53.931349 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_a918fc9dd9df4b9d928067cbd4dd0756"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.931882 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a918fc9dd9df4b9d928067cbd4dd0756 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:53.933307 601 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f33c2c00b414fbebf1965510e1e2b96 has no consensus state
I20260619 19:53:53.933712 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_7fce2193633d4d80b56750d4df0c8e90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.934227 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fce2193633d4d80b56750d4df0c8e90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:53.935547 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fcb1050f57246feb65f7e8948856c21 consensus state has no leader
I20260619 19:53:53.935899 600 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_4f97c7f3371b4cd9bf5b12bd61a73e1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.936403 600 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f97c7f3371b4cd9bf5b12bd61a73e1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.941191 604 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 7e3a8c4b651545c9ad620be798c63b53
I20260619 19:53:53.941594 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_621d668c6fc94dd3a19c02f225892fe2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:53.943161 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_621d668c6fc94dd3a19c02f225892fe2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:53.944849 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5ef20cd46a1d47c69c65a8a9aba25edf" } new_table_name: "default.Table_30d978ee7d9b4a67bf40b0ccb4858574" modify_external_catalogs: true
I20260619 19:53:53.945464 1405 raft_consensus.cc:493] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:53.945631 1405 raft_consensus.cc:515] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.947006 1405 leader_election.cc:290] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:53.964749 903 tablet_service.cc:1511] Processing CreateTablet for tablet bb56767231db42bebb75a45b5d512de3 (DEFAULT_TABLE table=default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.965327 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb56767231db42bebb75a45b5d512de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.976836 752 tablet_service.cc:1511] Processing CreateTablet for tablet bb56767231db42bebb75a45b5d512de3 (DEFAULT_TABLE table=default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.976963 899 tablet_service.cc:1511] Processing CreateTablet for tablet d27342783a5641d7a324e71183269308 (DEFAULT_TABLE table=default.Table_64306ac3336a496b97becea891be9344 [id=592df24d0a274aa7a92b1f1952627c0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.977491 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27342783a5641d7a324e71183269308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.977516 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb56767231db42bebb75a45b5d512de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.980335 1566 raft_consensus.cc:493] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:53.980612 589 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_5768d3c75855417f86920d5378cce7de [id=873b5cd9ab3549b482db039d3920caee], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9f33c2c00b414fbebf1965510e1e2b96 has no consensus state
I20260619 19:53:53.981138 1566 raft_consensus.cc:515] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:53.982070 1566 leader_election.cc:290] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:53.986544 1200 ts_tablet_manager.cc:1434] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.185s user 0.001s sys 0.002s
I20260619 19:53:53.986996 1200 tablet_bootstrap.cc:492] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:53.990134 1061 raft_consensus.cc:2468] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:53.994107 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 59123a56731645e1bbfcc94b2a46b1d6 (DEFAULT_TABLE table=default.Table_e170513f38a14ffcaceccb5ee9052c80 [id=8eedaa1e27904cadb0b52ab19f4c43ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.997391 899 tablet_service.cc:1511] Processing CreateTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc (DEFAULT_TABLE table=default.Table_f2b7aed4e720476cb97127ea1b58db50 [id=0178c0c89c424890aeaa1e2bd32ed94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:53.997929 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c0ffb4629a46349ccfe473cc20cdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.002521 764 tablet_service.cc:1511] Processing CreateTablet for tablet d27342783a5641d7a324e71183269308 (DEFAULT_TABLE table=default.Table_64306ac3336a496b97becea891be9344 [id=592df24d0a274aa7a92b1f1952627c0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.003418 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27342783a5641d7a324e71183269308. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:54.008927 719 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.019349 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f25c0378a6f4e9ea1a62d98f27778ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.019356 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9c959792fa48e89b669520f7332b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.019696 1059 raft_consensus.cc:2468] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.020830 859 leader_election.cc:304] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.021982 759 tablet_service.cc:1511] Processing CreateTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc (DEFAULT_TABLE table=default.Table_f2b7aed4e720476cb97127ea1b58db50 [id=0178c0c89c424890aeaa1e2bd32ed94e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.021988 900 tablet_service.cc:1511] Processing CreateTablet for tablet 74f39941c13847d79e2b2c3ddd176533 (DEFAULT_TABLE table=default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.022454 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f39941c13847d79e2b2c3ddd176533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.022475 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c0ffb4629a46349ccfe473cc20cdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.028457 765 tablet_service.cc:1511] Processing CreateTablet for tablet 74f39941c13847d79e2b2c3ddd176533 (DEFAULT_TABLE table=default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.028930 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f39941c13847d79e2b2c3ddd176533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.028986 1514 raft_consensus.cc:2804] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.029135 1514 raft_consensus.cc:493] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.029237 1514 raft_consensus.cc:3060] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.031507 762 tablet_service.cc:1511] Processing CreateTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 (DEFAULT_TABLE table=default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.031986 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365c0bb1e9ac480e96e7f4d604048663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.032717 1514 raft_consensus.cc:515] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.033907 1514 leader_election.cc:290] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.035269 1609 tablet.cc:1724] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:53:54.036800 893 tablet_service.cc:1511] Processing CreateTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 (DEFAULT_TABLE table=default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.037389 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365c0bb1e9ac480e96e7f4d604048663. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:54.053411 719 leader_election.cc:343] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:54.055790 719 leader_election.cc:343] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.058166 901 tablet_service.cc:1511] Processing CreateTablet for tablet bb547965fc7e4aa29d427b1acc7d6e51 (DEFAULT_TABLE table=default.Table_66ddb27484c049a4a1043b72dd77d477 [id=1a15a941edb54adab68b83f9c30a77f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.058674 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb547965fc7e4aa29d427b1acc7d6e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.059937 1208 tablet_bootstrap.cc:492] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:54.060119 1208 ts_tablet_manager.cc:1403] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.156s user 0.016s sys 0.011s
I20260619 19:53:54.061039 1208 raft_consensus.cc:359] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.061290 1208 raft_consensus.cc:385] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.061378 1208 raft_consensus.cc:740] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.061851 1208 consensus_queue.cc:260] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.062566 1208 ts_tablet_manager.cc:1434] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:54.062901 1208 tablet_bootstrap.cc:492] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:54.064857 1208 tablet_bootstrap.cc:654] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.067942 762 tablet_service.cc:1511] Processing CreateTablet for tablet bb547965fc7e4aa29d427b1acc7d6e51 (DEFAULT_TABLE table=default.Table_66ddb27484c049a4a1043b72dd77d477 [id=1a15a941edb54adab68b83f9c30a77f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.068892 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb547965fc7e4aa29d427b1acc7d6e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.071547 891 tablet_service.cc:1511] Processing CreateTablet for tablet 19d6333b0c8940b2802307d0da8a57ac (DEFAULT_TABLE table=default.Table_62d0e0d461a74b99bac5c2251f7f7f63 [id=73d986c5f5974ea790e236843abdf930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.072170 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d6333b0c8940b2802307d0da8a57ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.080827 1201 tablet_bootstrap.cc:492] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:54.081053 1201 ts_tablet_manager.cc:1403] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.188s user 0.008s sys 0.020s
I20260619 19:53:54.081409 1514 raft_consensus.cc:493] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.081686 1514 raft_consensus.cc:515] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.082012 1201 raft_consensus.cc:359] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.082230 1201 raft_consensus.cc:385] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.082304 1201 raft_consensus.cc:740] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.082554 1201 consensus_queue.cc:260] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.083084 1201 ts_tablet_manager.cc:1434] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:54.083257 1514 leader_election.cc:290] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.086069 720 leader_election.cc:304] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.086470 1566 raft_consensus.cc:2804] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:53:54.086510 720 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:53:54.086634 1566 raft_consensus.cc:697] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:54.086951 1566 consensus_queue.cc:237] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.087581 1514 raft_consensus.cc:493] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.087921 1514 raft_consensus.cc:515] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.089570 1514 leader_election.cc:290] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.091217 754 tablet_service.cc:1511] Processing CreateTablet for tablet 19d6333b0c8940b2802307d0da8a57ac (DEFAULT_TABLE table=default.Table_62d0e0d461a74b99bac5c2251f7f7f63 [id=73d986c5f5974ea790e236843abdf930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.091538 896 tablet_service.cc:1511] Processing CreateTablet for tablet a33cb04fdb8944e8817d51bd56806665 (DEFAULT_TABLE table=default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.091771 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19d6333b0c8940b2802307d0da8a57ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.092023 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33cb04fdb8944e8817d51bd56806665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:53.781605 1331 rpcz_store.cc:276] 0619 19:53:52.168725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.168778 (+ 53us) service_pool.cc:224] Handling call
0619 19:53:53.269805 (+1101027us) ts_tablet_manager.cc:1151] Deleting tablet d29506dab4c84850ad79b8b7a0340987
0619 19:53:53.269816 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:53.293989 (+ 24173us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:53.707021 (+413032us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:53.780998 (+ 73977us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094492}
I20260619 19:53:54.081416 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc952b283d94035be1f86f3b90382b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.112216 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d29506dab4c84850ad79b8b7a0340987 (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]) successfully deleted
W20260619 19:53:54.116124 602 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb547965fc7e4aa29d427b1acc7d6e51 consensus state has no leader
W20260619 19:53:54.117750 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32665a93ee5b4f8290c79e2a1d4b1db1 consensus state has no leader
I20260619 19:53:54.124997 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59123a56731645e1bbfcc94b2a46b1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.125072 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f25c0378a6f4e9ea1a62d98f27778ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:54.126133 1061 raft_consensus.cc:2468] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.139423 1201 tablet_bootstrap.cc:492] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:54.140056 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8522f562665540ce99490ab90e02d801 (DEFAULT_TABLE table=default.Table_faa9be975d4742bf90dcee0feb53cc93 [id=b66ad69a759847bebf46963c43c5af2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.141088 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8522f562665540ce99490ab90e02d801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.141137 759 tablet_service.cc:1511] Processing CreateTablet for tablet a33cb04fdb8944e8817d51bd56806665 (DEFAULT_TABLE table=default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.141873 1201 tablet_bootstrap.cc:654] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.145598 763 tablet_service.cc:1511] Processing CreateTablet for tablet 369cb2f2b599469680eed94a221c2f27 (DEFAULT_TABLE table=default.Table_c2dbeec92873437ab12eedf151dbd3ad [id=0030f2fdb14a4d4d850c1f61d7135a21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.149297 901 tablet_service.cc:1511] Processing CreateTablet for tablet 08ef46cfced54742832fd3c01f952a9d (DEFAULT_TABLE table=default.Table_8d50f1b1ec814e8d85b077e1eb08a18c [id=c128b2a4a40748dabd196e9703c43254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.151327 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ef46cfced54742832fd3c01f952a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.155743 1201 tablet_bootstrap.cc:492] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:54.155053 1612 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d38b77ff37948e19592b36b6d884fe0)
I20260619 19:53:54.156177 1201 ts_tablet_manager.cc:1403] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.006s
I20260619 19:53:54.157517 1612 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:54.158634 1201 raft_consensus.cc:359] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.159966 1201 raft_consensus.cc:385] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.161545 1201 raft_consensus.cc:740] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:53:54.167835 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 76607.3us
I20260619 19:53:54.165171 1201 consensus_queue.cc:260] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.167943 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8522f562665540ce99490ab90e02d801 (DEFAULT_TABLE table=default.Table_faa9be975d4742bf90dcee0feb53cc93 [id=b66ad69a759847bebf46963c43c5af2c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.168349 719 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.168810 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33cb04fdb8944e8817d51bd56806665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.169219 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369cb2f2b599469680eed94a221c2f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.169533 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8522f562665540ce99490ab90e02d801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.179224 890 tablet_service.cc:1511] Processing CreateTablet for tablet 369cb2f2b599469680eed94a221c2f27 (DEFAULT_TABLE table=default.Table_c2dbeec92873437ab12eedf151dbd3ad [id=0030f2fdb14a4d4d850c1f61d7135a21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.179766 1201 ts_tablet_manager.cc:1434] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.023s user 0.003s sys 0.001s
W20260619 19:53:54.180503 588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:46791, user_credentials={real_user=slave}} blocked reactor thread for 69806.2us
I20260619 19:53:54.181766 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_28205fd1dd524e6b8aa7a105f1a9638f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.182431 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28205fd1dd524e6b8aa7a105f1a9638f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.185739 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_698d85f35094447cb80bcdb59119c41d" } modify_external_catalogs: true
I20260619 19:53:54.186017 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_698d85f35094447cb80bcdb59119c41d" } modify_external_catalogs: true
I20260619 19:53:54.187575 1208 tablet_bootstrap.cc:492] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:54.187865 1208 ts_tablet_manager.cc:1403] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.011s
I20260619 19:53:54.189167 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_bb4bd2ce8e5644659edd4c386859b4fd" } modify_external_catalogs: true
I20260619 19:53:54.189378 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_bb4bd2ce8e5644659edd4c386859b4fd" } modify_external_catalogs: true
I20260619 19:53:54.190618 1208 raft_consensus.cc:359] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.191948 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97025f1e0634720bc68d0a6196bd20b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.191618 1208 raft_consensus.cc:385] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.193161 1208 raft_consensus.cc:740] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.194043 1208 consensus_queue.cc:260] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.195415 1201 tablet_bootstrap.cc:492] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:54.197212 1208 ts_tablet_manager.cc:1434] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260619 19:53:54.198573 1208 tablet_bootstrap.cc:492] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:54.201412 1405 raft_consensus.cc:493] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.204500 1612 leader_election.cc:290] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:54.204802 765 tablet_service.cc:1511] Processing CreateTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 (DEFAULT_TABLE table=default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.206049 1405 raft_consensus.cc:515] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.206810 1577 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:53:54.206933 1405 leader_election.cc:290] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.207301 1058 raft_consensus.cc:3060] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.208765 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3091dd1a525a4f779c68b8b77afa5b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.209729 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 161) took 1918 ms. Trace:
I20260619 19:53:54.210134 1060 raft_consensus.cc:2468] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:54.210799 720 leader_election.cc:304] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.210909 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_24d96d4b01f94727832aaf2c7fc13576" } modify_external_catalogs: true
I20260619 19:53:54.211113 1566 raft_consensus.cc:2804] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.211174 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_24d96d4b01f94727832aaf2c7fc13576" } modify_external_catalogs: true
I20260619 19:53:54.212726 1405 raft_consensus.cc:493] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.212914 1405 raft_consensus.cc:515] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.213157 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.213440 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.213641 1405 leader_election.cc:290] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.214094 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d37d6f54a96471fad26a342cab984ef with delete_type TABLET_DATA_DELETED (replaced by tablet 6b9cdbff79734eb7ac6590bdd40eadf0) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.214380 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:54.206524 719 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.215796 1566 raft_consensus.cc:493] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.215982 1566 raft_consensus.cc:3060] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.179814 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369cb2f2b599469680eed94a221c2f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.216872 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.217746 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365c0bb1e9ac480e96e7f4d604048663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.206018 903 tablet_service.cc:1511] Processing CreateTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 (DEFAULT_TABLE table=default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.218607 1405 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.218788 1405 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.219936 1405 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.222285 1201 tablet_bootstrap.cc:654] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.222880 1566 raft_consensus.cc:515] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.224064 1566 leader_election.cc:290] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:54.224746 764 tablet_service.cc:1511] Processing CreateTablet for tablet fbc952b283d94035be1f86f3b90382b6 (DEFAULT_TABLE table=default.Table_03e300273881446b96748d3f1700e660 [id=54877119611f4e15a110f1c502001db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.224982 752 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (DEFAULT_TABLE table=default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.225252 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc952b283d94035be1f86f3b90382b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.225716 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c335fc5ca4885b5482c6b749f76f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.225910 896 tablet_service.cc:1511] Processing CreateTablet for tablet fbc952b283d94035be1f86f3b90382b6 (DEFAULT_TABLE table=default.Table_03e300273881446b96748d3f1700e660 [id=54877119611f4e15a110f1c502001db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.226028 1208 tablet_bootstrap.cc:654] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.227020 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (DEFAULT_TABLE table=default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.227649 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c335fc5ca4885b5482c6b749f76f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.233256 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.233851 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.234202 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_6fd994ad984e43798d665d87cf37c8f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.234907 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fd994ad984e43798d665d87cf37c8f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.235018 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983faf8557814093bc427291711f3fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.235586 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 55684b109a03488a88efd45a067159a0 (DEFAULT_TABLE table=default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.236150 1379 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.236670 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97025f1e0634720bc68d0a6196bd20b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:54.238425 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 74949d09466f42e2852389e10192989d (DEFAULT_TABLE table=default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.238448 602 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:54.237730 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e1eed89f54b809ac52efe2226dc35" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.238754 1057 raft_consensus.cc:2468] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:53:54.239034 602 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.239940 1379 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.236793 1331 rpcz_store.cc:276] 0619 19:53:52.288177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.288234 (+ 57us) service_pool.cc:224] Handling call
0619 19:53:54.106482 (+1818248us) ts_tablet_manager.cc:1151] Deleting tablet ecbe466eee2f43359181a1d26d6e761e
0619 19:53:54.127748 (+ 21266us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.206138 (+ 78390us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817816}
I20260619 19:53:54.241168 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0b55debc1b064192a56d2453364ba260 (DEFAULT_TABLE table=default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.237969 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3091dd1a525a4f779c68b8b77afa5b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.242094 1058 raft_consensus.cc:2468] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.242712 1060 raft_consensus.cc:3060] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:54.243402 859 leader_election.cc:343] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d29506dab4c84850ad79b8b7a0340987
I20260619 19:53:54.243634 859 leader_election.cc:304] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.244871 1405 raft_consensus.cc:2804] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.244982 1405 raft_consensus.cc:493] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.245087 1405 raft_consensus.cc:3060] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.245886 613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 326 } } ignore_live_leader: false dest_uuid: "2d38b77ff37948e19592b36b6d884fe0" is_pre_election: true
I20260619 19:53:54.247529 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcb1050f57246feb65f7e8948856c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.247815 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55684b109a03488a88efd45a067159a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.248057 1379 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.248288 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 1202fe45d0964d368989f969e95f880d (DEFAULT_TABLE table=default.Table_813fc3596f604c7a99d0ac0c6c42a5e0 [id=41f6ba3e85b04574878f66c6f98d60ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.248730 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 162) took 1902 ms. Trace:
I20260619 19:53:54.248829 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74949d09466f42e2852389e10192989d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.249217 1331 rpcz_store.cc:276] 0619 19:53:52.339565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.339623 (+ 58us) service_pool.cc:224] Handling call
0619 19:53:54.240767 (+1901144us) ts_tablet_manager.cc:1151] Deleting tablet a75baa585102481fa0ea01e87e394e32
0619 19:53:54.240778 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.241923 (+ 1145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1898913}
I20260619 19:53:54.246790 1247 ts_tablet_manager.cc:1929] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:54.250439 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 163) took 1850 ms. Trace:
I20260619 19:53:54.251076 1331 rpcz_store.cc:276] 0619 19:53:52.399556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.399614 (+ 58us) service_pool.cc:224] Handling call
0619 19:53:54.249687 (+1850073us) ts_tablet_manager.cc:1151] Deleting tablet 620f3a56e57e49b7b520012857e71187
0619 19:53:54.249698 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.249888 (+ 190us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1849828}
I20260619 19:53:54.251638 1331 tablet_replica.cc:333] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:54.252156 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:54.252388 921 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:54.252660 1331 raft_consensus.cc:2243] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:54.253022 996 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.253379 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b55debc1b064192a56d2453364ba260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.253942 1379 raft_consensus.cc:2804] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.254005 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 991c877feeae43c580d9471c25c4424c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.253942 1405 raft_consensus.cc:515] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.254056 1379 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.252779 1247 log.cc:1199] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/70716f209500400cae29b20ee1cb4882
I20260619 19:53:54.255120 1405 leader_election.cc:290] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.255555 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc952b283d94035be1f86f3b90382b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.256021 1331 raft_consensus.cc:2272] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:54.258965 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f (DEFAULT_TABLE table=default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.258883 1247 ts_tablet_manager.cc:1950] T 70716f209500400cae29b20ee1cb4882 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:54.259905 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369cb2f2b599469680eed94a221c2f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.264441 893 tablet_service.cc:1511] Processing CreateTablet for tablet 6c396a42add84c62acecb9bbb5d57f1d (DEFAULT_TABLE table=default.Table_5315cb7e69284c01ab36267884d6abf5 [id=b9dc702105844f9a8864d15332e30313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.265064 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c396a42add84c62acecb9bbb5d57f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.265609 761 tablet_service.cc:1511] Processing CreateTablet for tablet 08ef46cfced54742832fd3c01f952a9d (DEFAULT_TABLE table=default.Table_8d50f1b1ec814e8d85b077e1eb08a18c [id=c128b2a4a40748dabd196e9703c43254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.266076 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ef46cfced54742832fd3c01f952a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.268709 1379 raft_consensus.cc:3060] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.275619 899 tablet_service.cc:1511] Processing CreateTablet for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (DEFAULT_TABLE table=default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.276623 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b0e811cf2a4bf4a23351f9ba5b6173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.280170 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1202fe45d0964d368989f969e95f880d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.281057 1331 ts_tablet_manager.cc:1916] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:54.282337 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.282593 782 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:54.283308 757 tablet_service.cc:1511] Processing CreateTablet for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (DEFAULT_TABLE table=default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.286020 900 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcb1050f57246feb65f7e8948856c21 (DEFAULT_TABLE table=default.Table_4e675d76500a491d93ec8709df95b206 [id=f6eb09cc59154cc7946ae43dc9e8a277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.286423 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcb1050f57246feb65f7e8948856c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.287252 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9c959792fa48e89b669520f7332b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:53:54.289043 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ecbe466eee2f43359181a1d26d6e761e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecbe466eee2f43359181a1d26d6e761e already in progress: creating tablet
I20260619 19:53:54.290061 1363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 326 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:54.290555 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f32e1c7a27941ca9377901b19b32af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.291162 516 leader_election.cc:304] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc90ee2d59d4dddae6790dd92b20cb5; no voters: 031619d60e724837bd292c5ce23d0aff, 2d38b77ff37948e19592b36b6d884fe0
I20260619 19:53:54.291348 859 leader_election.cc:304] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.291664 1612 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:53:54.291687 859 leader_election.cc:304] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:54.292111 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a75baa585102481fa0ea01e87e394e32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75baa585102481fa0ea01e87e394e32 already in progress: creating tablet
I20260619 19:53:54.292284 1514 raft_consensus.cc:2804] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.292369 1514 raft_consensus.cc:493] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.292470 1514 raft_consensus.cc:3060] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:54.288194 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 75473.6us
I20260619 19:53:54.295234 1514 raft_consensus.cc:515] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.296541 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b0e811cf2a4bf4a23351f9ba5b6173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.296923 1514 leader_election.cc:290] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.297186 753 tablet_service.cc:1511] Processing CreateTablet for tablet 983faf8557814093bc427291711f3fce (DEFAULT_TABLE table=default.Table_873b6850a58041da8c91101a792a1c80 [id=daffb1c409b74c799628ced1c9be2520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.298086 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983faf8557814093bc427291711f3fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.298123 758 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcb1050f57246feb65f7e8948856c21 (DEFAULT_TABLE table=default.Table_4e675d76500a491d93ec8709df95b206 [id=f6eb09cc59154cc7946ae43dc9e8a277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.298496 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcb1050f57246feb65f7e8948856c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.298635 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6c396a42add84c62acecb9bbb5d57f1d (DEFAULT_TABLE table=default.Table_5315cb7e69284c01ab36267884d6abf5 [id=b9dc702105844f9a8864d15332e30313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.298998 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c396a42add84c62acecb9bbb5d57f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.300839 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa466f30c2460697217f526fc4617f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.301069 781 raft_consensus.cc:2468] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.301492 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9c959792fa48e89b669520f7332b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.301671 781 raft_consensus.cc:2468] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.302090 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f25c0378a6f4e9ea1a62d98f27778ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.302261 781 raft_consensus.cc:2468] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.299886 858 leader_election.cc:304] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.303552 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb8df8d8ac047bfa6ab7a6b533e38fc" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:54.305668 920 raft_consensus.cc:2468] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:54.303890 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb8df8d8ac047bfa6ab7a6b533e38fc" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:54.305891 923 raft_consensus.cc:3060] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.308481 923 raft_consensus.cc:2468] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:54.304298 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97025f1e0634720bc68d0a6196bd20b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:54.308724 919 raft_consensus.cc:2468] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:54.304677 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa466f30c2460697217f526fc4617f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:54.308883 922 raft_consensus.cc:2468] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:54.304834 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97025f1e0634720bc68d0a6196bd20b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:54.309033 918 raft_consensus.cc:3060] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.311764 918 raft_consensus.cc:2468] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:54.305105 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0afdcf96247b0a16c8f9ac71cc24a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:54.313439 921 raft_consensus.cc:3060] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.315698 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cd2fca96ee44cf297eb248b1f3ed00a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:54.315927 784 raft_consensus.cc:3060] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.318835 921 raft_consensus.cc:2468] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:54.321662 784 raft_consensus.cc:2468] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:53:54.324618 591 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 620f3a56e57e49b7b520012857e71187 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 620f3a56e57e49b7b520012857e71187 already in progress: creating tablet
I20260619 19:53:54.332734 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997cd0b5a8d24b56a2d5b95ab877d95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.333343 1200 tablet_bootstrap.cc:654] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:54.326606 859 leader_election.cc:343] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 707af50da2ef469fb671df04cb72bb81
I20260619 19:53:54.334024 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.305298 1405 raft_consensus.cc:2804] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:54.336500 1061 raft_consensus.cc:3060] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.339156 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.339730 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 29e73d38af8241b29b8d47a5f9db1834 (DEFAULT_TABLE table=default.Table_318e69014c974faabdc436cbeec6cbdc [id=7ebab8e3fd93430aa6d2a429f2dca4f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.340226 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e73d38af8241b29b8d47a5f9db1834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.341229 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e1eed89f54b809ac52efe2226dc35" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:54.341475 1059 raft_consensus.cc:3060] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.342907 1514 raft_consensus.cc:3060] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.343393 1058 raft_consensus.cc:2393] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:54.344499 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29506dab4c84850ad79b8b7a0340987" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.345288 785 raft_consensus.cc:2468] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.345389 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e1eed89f54b809ac52efe2226dc35" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.345564 781 raft_consensus.cc:2468] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.344368 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f25c0378a6f4e9ea1a62d98f27778ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:54.345793 784 raft_consensus.cc:3060] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.345795 1514 raft_consensus.cc:2749] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:54.346962 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa5d1df8d84fcd938349af6d2d0af0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.347576 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.347764 781 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:54.348198 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9c959792fa48e89b669520f7332b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:54.348373 781 raft_consensus.cc:3060] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.350930 590 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a868706c23e948e5ba3320ceb4a19cf8 (table default.Table_2e44172c64aa41b6aabeefb64c938a21 [id=f0136eccfb674a15bb48064b19eef96e]) successfully deleted
I20260619 19:53:54.351962 894 tablet_service.cc:1511] Processing CreateTablet for tablet 59123a56731645e1bbfcc94b2a46b1d6 (DEFAULT_TABLE table=default.Table_e170513f38a14ffcaceccb5ee9052c80 [id=8eedaa1e27904cadb0b52ab19f4c43ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.352185 781 raft_consensus.cc:2468] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.352555 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59123a56731645e1bbfcc94b2a46b1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.352939 755 tablet_service.cc:1511] Processing CreateTablet for tablet 55684b109a03488a88efd45a067159a0 (DEFAULT_TABLE table=default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.353390 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55684b109a03488a88efd45a067159a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.355500 761 tablet_service.cc:1511] Processing CreateTablet for tablet 59123a56731645e1bbfcc94b2a46b1d6 (DEFAULT_TABLE table=default.Table_e170513f38a14ffcaceccb5ee9052c80 [id=8eedaa1e27904cadb0b52ab19f4c43ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.355952 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59123a56731645e1bbfcc94b2a46b1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.359470 759 tablet_service.cc:1511] Processing CreateTablet for tablet 991c877feeae43c580d9471c25c4424c (DEFAULT_TABLE table=default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.359982 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 991c877feeae43c580d9471c25c4424c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.361003 900 tablet_service.cc:1511] Processing CreateTablet for tablet 991c877feeae43c580d9471c25c4424c (DEFAULT_TABLE table=default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.361488 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 991c877feeae43c580d9471c25c4424c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.362547 784 raft_consensus.cc:2468] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.363983 894 tablet_service.cc:1511] Processing CreateTablet for tablet 55684b109a03488a88efd45a067159a0 (DEFAULT_TABLE table=default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.364490 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55684b109a03488a88efd45a067159a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.366912 765 tablet_service.cc:1511] Processing CreateTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 (DEFAULT_TABLE table=default.Table_baef1a6b19f94884934f0c54a4dda5d0 [id=d69648d0cdb042a3a4e487ef0cf0088b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.367463 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f32e1c7a27941ca9377901b19b32af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.370298 1208 tablet_bootstrap.cc:492] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:54.370494 1208 ts_tablet_manager.cc:1403] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.172s user 0.000s sys 0.008s
I20260619 19:53:54.371018 1201 tablet_bootstrap.cc:492] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:54.371229 1201 ts_tablet_manager.cc:1403] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.190s user 0.004s sys 0.000s
I20260619 19:53:54.344156 1060 raft_consensus.cc:2468] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:54.371881 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e1eed89f54b809ac52efe2226dc35" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:54.372113 784 raft_consensus.cc:3060] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.372138 720 leader_election.cc:304] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.372551 1566 raft_consensus.cc:2804] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:54.373085 1566 raft_consensus.cc:697] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:54.373425 1566 consensus_queue.cc:237] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.376580 1208 raft_consensus.cc:359] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.376896 1208 raft_consensus.cc:385] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.376973 1208 raft_consensus.cc:740] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.377334 1208 consensus_queue.cc:260] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.378080 1208 ts_tablet_manager.cc:1434] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260619 19:53:54.378476 1208 tablet_bootstrap.cc:492] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:54.379518 1201 raft_consensus.cc:359] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.379830 1201 raft_consensus.cc:385] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.379930 1201 raft_consensus.cc:740] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.380241 1201 consensus_queue.cc:260] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.380851 1201 ts_tablet_manager.cc:1434] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260619 19:53:54.381264 1201 tablet_bootstrap.cc:492] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:54.376767 719 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.385393 1405 raft_consensus.cc:697] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:54.385644 1038 tablet_service.cc:1511] Processing CreateTablet for tablet fde2b5d12ab7465791f26d214c2dc2f5 (DEFAULT_TABLE table=default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae [id=dbf8a7ab6063477b9e3bd2bd051116bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.386173 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde2b5d12ab7465791f26d214c2dc2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.389961 1024 tablet_service.cc:1511] Processing CreateTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 (DEFAULT_TABLE table=default.Table_24d96d4b01f94727832aaf2c7fc13576 [id=b6c966d7d56a46cfb4fa632aad28d7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.390471 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d651c8fb8ff244a5a09dd9ea593ecb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.391049 1405 consensus_queue.cc:237] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:54.391674 590 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 550297c4d14f4d679d11fded97b671ae because the tablet was not found. No further retry: Not found: Tablet not found: 550297c4d14f4d679d11fded97b671ae
I20260619 19:53:54.386634 893 tablet_service.cc:1511] Processing CreateTablet for tablet 983faf8557814093bc427291711f3fce (DEFAULT_TABLE table=default.Table_873b6850a58041da8c91101a792a1c80 [id=daffb1c409b74c799628ced1c9be2520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.396025 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983faf8557814093bc427291711f3fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.399195 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.399858 903 tablet_service.cc:1511] Processing CreateTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 (DEFAULT_TABLE table=default.Table_baef1a6b19f94884934f0c54a4dda5d0 [id=d69648d0cdb042a3a4e487ef0cf0088b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.407153 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f32e1c7a27941ca9377901b19b32af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.406937 1037 tablet_service.cc:1511] Processing CreateTablet for tablet ca6d7f30c5a84106bebebc42eedee654 (DEFAULT_TABLE table=default.Table_5ba1b89a3b684c4f9927a1cefb74588d [id=cb0dfc15d9414ae3b63638e94c05c0a5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.409009 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 109127us
I20260619 19:53:54.409413 858 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:54.409835 858 leader_election.cc:343] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 60324f7edaac45ed919be7e2368a4fd5
I20260619 19:53:54.409965 858 leader_election.cc:304] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.410266 1621 raft_consensus.cc:2804] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.410390 1621 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.410509 1621 raft_consensus.cc:3060] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.413843 1621 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.414516 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6d7f30c5a84106bebebc42eedee654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.414685 1621 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.414881 1621 raft_consensus.cc:2749] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:54.415364 1567 raft_consensus.cc:2804] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.415501 1567 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.415482 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 46dcf2293e2d461ca1be171069867d1f (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.415943 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dcf2293e2d461ca1be171069867d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.420567 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.421546 603 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 376dfca0b54d4c689c96242566869717
I20260619 19:53:54.422106 603 catalog_manager.cc:6784] ReplaceTablet: tablet 376dfca0b54d4c689c96242566869717 deleted and replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:53:54.425014 603 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]). Expected version 1 got 0
I20260619 19:53:54.427412 595 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 69fa5d1df8d84fcd938349af6d2d0af0
I20260619 19:53:54.428306 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_1e665d03a8764d998282ef50afaa6b12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.428947 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e665d03a8764d998282ef50afaa6b12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.430737 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 (DEFAULT_TABLE table=default.Table_5e5e821d9bce47c3afd7e90f90ecbc7a [id=5f5c0c7e04dc4074a0f02a592ac590ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.431265 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ba47943b9d4123985ea6ca1478cd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.432299 1616 raft_consensus.cc:493] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:54.432297 599 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:49559 (request call id 33) took 933 ms (client timeout 1000 ms). Trace:
I20260619 19:53:54.432502 1616 raft_consensus.cc:515] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:54.432439 599 rpcz_store.cc:269] 0619 19:53:53.498798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.556095 (+ 57297us) service_pool.cc:224] Handling call
0619 19:53:54.432228 (+876133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:53.632609 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:53:53.632740 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:53:53.632747 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:53:53.632750 (+ 3us) tablet.cc:662] Decoding operations
0619 19:53:53.632871 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:53:53.632959 (+ 88us) write_op.cc:641] Partition lock acquired for write op
0619 19:53:53.632966 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:53:53.633042 (+ 76us) tablet.cc:701] Row locks acquired
0619 19:53:53.633045 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:53:53.633087 (+ 42us) write_op.cc:270] Start()
0619 19:53:53.633124 (+ 37us) write_op.cc:276] Timestamp: P: 1781898833633033 usec, L: 0
0619 19:53:53.633128 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:53:53.633376 (+ 248us) log.cc:844] Serialized 533 byte log entry
0619 19:53:53.844422 (+211046us) op_driver.cc:464] REPLICATION: finished
0619 19:53:53.845154 (+ 732us) write_op.cc:301] APPLY: starting
0619 19:53:53.845167 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0619 19:53:53.845195 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0619 19:53:53.845215 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:53:53.845254 (+ 39us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:53:53.845280 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:53:53.845286 (+ 6us) write_op.cc:312] APPLY: finished
0619 19:53:53.845341 (+ 55us) log.cc:844] Serialized 23 byte log entry
0619 19:53:53.845411 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:53.845424 (+ 13us) write_op.cc:454] Released schema lock
0619 19:53:53.845430 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0619 19:53:53.845506 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:53.845510 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":695,"apply.run_cpu_time_us":347,"apply.run_wall_time_us":347,"num_ops":1,"prepare.queue_time_us":68726,"prepare.run_cpu_time_us":799,"prepare.run_wall_time_us":1243,"replication_time_us":211273,"spinlock_wait_cycles":25856}]]}
I20260619 19:53:54.434147 599 master_service.cc:960] ReplaceTablet: received request to replace tablet 33935217c1f44ce0ad5b8610d368f2eb from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:54.437016 601 master_service.cc:960] ReplaceTablet: received request to replace tablet 304e1eed89f54b809ac52efe2226dc35 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:54.437417 597 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 97d4a02dcab845fab5b2743294e04a2d
I20260619 19:53:54.437731 597 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5768d3c75855417f86920d5378cce7de" } new_table_name: "default.Table_bc1fc8567cd045b1bd6b1e4679853fd3" modify_external_catalogs: true
I20260619 19:53:54.438473 604 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 9b201699b80d4f91a2373ec493a3313c
I20260619 19:53:54.438481 1061 raft_consensus.cc:2468] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.438757 604 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_873b6850a58041da8c91101a792a1c80" } new_table_name: "default.Table_7810442fe18f4992bc31a9edf87d2438" modify_external_catalogs: true
I20260619 19:53:54.439234 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:53:54.439935 600 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_5e5e821d9bce47c3afd7e90f90ecbc7a" } new_table_name: "default.Table_046de0d4671a46d8a07dec6be2d5a520" modify_external_catalogs: true
I20260619 19:53:54.440493 596 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ef20e35c612400bbbf1c707a36ced8c from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:54.440532 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fe14a1f35cf14ca480221ee412c087da (DEFAULT_TABLE table=default.Table_777693f155b442ecb9b881ee6ce60f67 [id=d0f3320ba06b47b38830db7ad44b766c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.440953 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe14a1f35cf14ca480221ee412c087da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.441037 602 master_service.cc:960] ReplaceTablet: received request to replace tablet 12258d3bcc714f34857d7362c49ee787 from {username='slave'} at 127.0.0.1:51756
I20260619 19:53:54.442056 598 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: default.Table_c73a82d38a4545cc8940056415afdc2b [id=394d8c70bca54b0eb32990278e06cd91] alter complete (version 2)
I20260619 19:53:54.442337 1567 raft_consensus.cc:3060] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.447647 602 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f2b7aed4e720476cb97127ea1b58db50" } modify_external_catalogs: true
I20260619 19:53:54.447925 602 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_f2b7aed4e720476cb97127ea1b58db50" } modify_external_catalogs: true
I20260619 19:53:54.449509 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_20dc9175b4c84bc6ac2546afae733eca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.450163 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20dc9175b4c84bc6ac2546afae733eca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.450182 1628 raft_consensus.cc:493] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.450405 1628 raft_consensus.cc:515] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.450656 603 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_13a373b0df95461581e1325a78c25c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.451284 603 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13a373b0df95461581e1325a78c25c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.453478 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 (DEFAULT_TABLE table=default.Table_5768d3c75855417f86920d5378cce7de [id=873b5cd9ab3549b482db039d3920caee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.457198 1200 tablet_bootstrap.cc:492] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:54.490063 595 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_777693f155b442ecb9b881ee6ce60f67" } new_table_name: "default.Table_747e9c8819a64b7fae8a5ece57035907" modify_external_catalogs: true
I20260619 19:53:54.490468 1379 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:54.491734 604 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 983faf8557814093bc427291711f3fce consensus state has no leader
I20260619 19:53:54.492115 1200 ts_tablet_manager.cc:1403] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.471s user 0.007s sys 0.018s
I20260619 19:53:54.492246 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_33d4ef8901924ac38b9500db539f2257"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:54.492689 1057 raft_consensus.cc:2393] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
W20260619 19:53:54.492931 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33d4ef8901924ac38b9500db539f2257 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.494065 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f33c2c00b414fbebf1965510e1e2b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.494393 596 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 6ef20e35c612400bbbf1c707a36ced8c
W20260619 19:53:54.495347 600 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56ba47943b9d4123985ea6ca1478cd93 consensus state has no leader
I20260619 19:53:54.495975 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d37d6f54a96471fad26a342cab984ef with delete_type TABLET_DATA_DELETED (replaced by tablet 6b9cdbff79734eb7ac6590bdd40eadf0) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.496160 596 catalog_manager.cc:6784] ReplaceTablet: tablet 6ef20e35c612400bbbf1c707a36ced8c deleted and replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:53:54.496423 756 tablet_service.cc:1511] Processing CreateTablet for tablet fde2b5d12ab7465791f26d214c2dc2f5 (DEFAULT_TABLE table=default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae [id=dbf8a7ab6063477b9e3bd2bd051116bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.496538 597 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f33c2c00b414fbebf1965510e1e2b96 consensus state has no leader
I20260619 19:53:54.496677 754 tablet_service.cc:1511] Processing CreateTablet for tablet 29e73d38af8241b29b8d47a5f9db1834 (DEFAULT_TABLE table=default.Table_318e69014c974faabdc436cbeec6cbdc [id=7ebab8e3fd93430aa6d2a429f2dca4f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.495442 757 tablet_service.cc:1511] Processing CreateTablet for tablet 74949d09466f42e2852389e10192989d (DEFAULT_TABLE table=default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.495273 763 tablet_service.cc:1511] Processing CreateTablet for tablet 0b55debc1b064192a56d2453364ba260 (DEFAULT_TABLE table=default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.499184 764 tablet_service.cc:1511] Processing CreateTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f (DEFAULT_TABLE table=default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.499934 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1202fe45d0964d368989f969e95f880d (DEFAULT_TABLE table=default.Table_813fc3596f604c7a99d0ac0c6c42a5e0 [id=41f6ba3e85b04574878f66c6f98d60ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.502391 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.503386 1616 leader_election.cc:290] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.509207 1567 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.510576 1025 tablet_service.cc:1511] Processing CreateTablet for tablet ed9d1bd98764451990e7e8e1b6fbcb0b (DEFAULT_TABLE table=default.Table_6e54fd634fc845d7b9ab428009616c61 [id=23b39c02806142d4b0a5c7c0d898b8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.511051 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e8c3aef303b94d58aaa24917399ac240 (DEFAULT_TABLE table=default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.511166 720 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:53:54.511498 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c3aef303b94d58aaa24917399ac240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.512650 760 tablet_service.cc:1511] Processing CreateTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 (DEFAULT_TABLE table=default.Table_24d96d4b01f94727832aaf2c7fc13576 [id=b6c966d7d56a46cfb4fa632aad28d7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.513110 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde2b5d12ab7465791f26d214c2dc2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.508767 1628 leader_election.cc:290] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.515681 1059 raft_consensus.cc:2468] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.516083 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (DEFAULT_TABLE table=default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.516601 1379 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.517804 1031 tablet_service.cc:1511] Processing CreateTablet for tablet dc5235127fb54d3dba90c9f9f8c134b4 (DEFAULT_TABLE table=default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.519876 1023 tablet_service.cc:1511] Processing CreateTablet for tablet c54b2e4f657245c2aa23d138968b3b0d (DEFAULT_TABLE table=default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.521497 1200 raft_consensus.cc:359] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.522989 1200 raft_consensus.cc:385] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.523121 1200 raft_consensus.cc:740] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.524500 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9d1bd98764451990e7e8e1b6fbcb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.527079 590 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 70716f209500400cae29b20ee1cb4882 (table default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]) successfully deleted
I20260619 19:53:54.528481 1567 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:54.529965 761 tablet_service.cc:1511] Processing CreateTablet for tablet ca6d7f30c5a84106bebebc42eedee654 (DEFAULT_TABLE table=default.Table_5ba1b89a3b684c4f9927a1cefb74588d [id=cb0dfc15d9414ae3b63638e94c05c0a5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.530560 595 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe14a1f35cf14ca480221ee412c087da consensus state has no leader
W20260619 19:53:54.533782 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 550297c4d14f4d679d11fded97b671ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 550297c4d14f4d679d11fded97b671ae already in progress: creating tablet
W20260619 19:53:54.534384 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 12258d3bcc714f34857d7362c49ee787 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12258d3bcc714f34857d7362c49ee787 already in progress: creating tablet
I20260619 19:53:54.535004 753 tablet_service.cc:1511] Processing CreateTablet for tablet 46dcf2293e2d461ca1be171069867d1f (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.542223 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a9c96d9c034a4a8a4d05d8518ebcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.544205 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54b2e4f657245c2aa23d138968b3b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.545189 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 376dfca0b54d4c689c96242566869717 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.545302 758 tablet_service.cc:1511] Processing CreateTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 (DEFAULT_TABLE table=default.Table_5e5e821d9bce47c3afd7e90f90ecbc7a [id=5f5c0c7e04dc4074a0f02a592ac590ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.545929 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e73d38af8241b29b8d47a5f9db1834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.547848 859 leader_election.cc:304] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.547915 1514 raft_consensus.cc:493] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.551757 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d895be304fcf445e9a4d2d8242becdd5 (DEFAULT_TABLE table=default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.548887 1200 consensus_queue.cc:260] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.552585 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5235127fb54d3dba90c9f9f8c134b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.553130 762 tablet_service.cc:1511] Processing CreateTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 (DEFAULT_TABLE table=default.Table_5768d3c75855417f86920d5378cce7de [id=873b5cd9ab3549b482db039d3920caee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.553726 755 tablet_service.cc:1511] Processing CreateTablet for tablet fe14a1f35cf14ca480221ee412c087da (DEFAULT_TABLE table=default.Table_777693f155b442ecb9b881ee6ce60f67 [id=d0f3320ba06b47b38830db7ad44b766c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.555403 1201 tablet_bootstrap.cc:654] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.556067 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dcf2293e2d461ca1be171069867d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.561416 901 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.560643 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:54.562877 896 tablet_service.cc:1511] Processing CreateTablet for tablet 74949d09466f42e2852389e10192989d (DEFAULT_TABLE table=default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.564339 1514 raft_consensus.cc:515] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.564620 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f33c2c00b414fbebf1965510e1e2b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.565012 1514 leader_election.cc:290] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.565230 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe14a1f35cf14ca480221ee412c087da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.565752 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.568629 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d37d6f54a96471fad26a342cab984ef with delete_type TABLET_DATA_DELETED (replaced by tablet 6b9cdbff79734eb7ac6590bdd40eadf0) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.568549 892 tablet_service.cc:1511] Processing CreateTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f (DEFAULT_TABLE table=default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.569424 1200 ts_tablet_manager.cc:1434] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.070s user 0.000s sys 0.003s
I20260619 19:53:54.560935 751 tablet_service.cc:1511] Processing CreateTablet for tablet dc5235127fb54d3dba90c9f9f8c134b4 (DEFAULT_TABLE table=default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.570765 1618 raft_consensus.cc:2804] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:54.570930 1618 raft_consensus.cc:697] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:54.571226 1618 consensus_queue.cc:237] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.572331 895 tablet_service.cc:1511] Processing CreateTablet for tablet 1202fe45d0964d368989f969e95f880d (DEFAULT_TABLE table=default.Table_813fc3596f604c7a99d0ac0c6c42a5e0 [id=41f6ba3e85b04574878f66c6f98d60ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.572558 898 tablet_service.cc:1511] Processing CreateTablet for tablet 0b55debc1b064192a56d2453364ba260 (DEFAULT_TABLE table=default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.572737 897 tablet_service.cc:1511] Processing CreateTablet for tablet 29e73d38af8241b29b8d47a5f9db1834 (DEFAULT_TABLE table=default.Table_318e69014c974faabdc436cbeec6cbdc [id=7ebab8e3fd93430aa6d2a429f2dca4f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.566414 784 raft_consensus.cc:2468] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.577657 750 tablet_service.cc:1511] Processing CreateTablet for tablet e8c3aef303b94d58aaa24917399ac240 (DEFAULT_TABLE table=default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.580257 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 69fa5d1df8d84fcd938349af6d2d0af0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.580806 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.580849 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 37393d7c16594032bf2a69abb0ab5931 with delete_type TABLET_DATA_DELETED (replaced by tablet a75baa585102481fa0ea01e87e394e32) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.582787 1247 tablet_replica.cc:333] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:54.583982 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74949d09466f42e2852389e10192989d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.584256 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b55debc1b064192a56d2453364ba260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.584144 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 90b8468df4a449d088f47b3b150ce54a (DEFAULT_TABLE table=default.Table_6354f0bf977c438d9ffcf548901ac7af [id=56ee4af476f74b9ab373fb2bfc1c315e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.584498 859 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:53:54.586416 891 tablet_service.cc:1511] Processing CreateTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 (DEFAULT_TABLE table=default.Table_5e5e821d9bce47c3afd7e90f90ecbc7a [id=5f5c0c7e04dc4074a0f02a592ac590ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.578770 749 tablet_service.cc:1511] Processing CreateTablet for tablet ed9d1bd98764451990e7e8e1b6fbcb0b (DEFAULT_TABLE table=default.Table_6e54fd634fc845d7b9ab428009616c61 [id=23b39c02806142d4b0a5c7c0d898b8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.586876 859 leader_election.cc:304] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.566207 1619 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:53:54.592262 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ba47943b9d4123985ea6ca1478cd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.592552 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5235127fb54d3dba90c9f9f8c134b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.592764 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997cd0b5a8d24b56a2d5b95ab877d95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.592978 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c3aef303b94d58aaa24917399ac240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.597275 604 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_442f268fdee346aca6c6696de3acecc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.597959 604 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_442f268fdee346aca6c6696de3acecc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.602725 595 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.603345 595 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.603724 603 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_9d38a479e3ed4d649131e8582f437265" } new_table_name: "default.Table_5e75d9e9320b476995a29d678ae6be45" modify_external_catalogs: true
I20260619 19:53:54.592262 1208 tablet_bootstrap.cc:654] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.606879 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:54.607056 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1202fe45d0964d368989f969e95f880d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.613404 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a868706c23e948e5ba3320ceb4a19cf8" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:54.613461 996 leader_election.cc:343] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.614439 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d895be304fcf445e9a4d2d8242becdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.615835 1247 raft_consensus.cc:2243] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:54.616068 1247 raft_consensus.cc:2272] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:54.618809 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.621075 598 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_5ab0c5d77506466ebc58898ec783e478"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:54.621322 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b8468df4a449d088f47b3b150ce54a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:54.621769 598 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ab0c5d77506466ebc58898ec783e478 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.624014 748 tablet_service.cc:1511] Processing CreateTablet for tablet c54b2e4f657245c2aa23d138968b3b0d (DEFAULT_TABLE table=default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.628963 1200 tablet_bootstrap.cc:492] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:54.628927 996 consensus_peers.cc:597] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:54.629733 901 tablet_service.cc:1511] Processing CreateTablet for tablet fe14a1f35cf14ca480221ee412c087da (DEFAULT_TABLE table=default.Table_777693f155b442ecb9b881ee6ce60f67 [id=d0f3320ba06b47b38830db7ad44b766c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.632938 1059 raft_consensus.cc:2393] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:54.634754 1514 raft_consensus.cc:2804] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:54.635043 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997cd0b5a8d24b56a2d5b95ab877d95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.636773 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e73d38af8241b29b8d47a5f9db1834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.637941 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1202fe45d0964d368989f969e95f880d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.638324 918 raft_consensus.cc:3060] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.639158 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ba47943b9d4123985ea6ca1478cd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.639343 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37393d7c16594032bf2a69abb0ab5931" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:54.641811 996 leader_election.cc:343] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.642125 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe14a1f35cf14ca480221ee412c087da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.648034 1331 ts_tablet_manager.cc:1929] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260619 19:53:54.648685 1331 log.cc:1199] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/c9652b7e593c4c2597a1f9268d67b6d1
I20260619 19:53:54.649119 1331 ts_tablet_manager.cc:1950] T c9652b7e593c4c2597a1f9268d67b6d1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:54.650650 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 164) took 2238 ms. Trace:
I20260619 19:53:54.650843 1331 rpcz_store.cc:276] 0619 19:53:52.411470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.411552 (+ 82us) service_pool.cc:224] Handling call
0619 19:53:54.251524 (+1839972us) ts_tablet_manager.cc:1151] Deleting tablet c9652b7e593c4c2597a1f9268d67b6d1
0619 19:53:54.251556 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.487029 (+235473us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:54.647962 (+160933us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:54.650095 (+ 2133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1839697}
I20260619 19:53:54.653053 1200 tablet_bootstrap.cc:654] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.655551 1247 ts_tablet_manager.cc:1916] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:54.638034 888 tablet_service.cc:1511] Processing CreateTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 (DEFAULT_TABLE table=default.Table_24d96d4b01f94727832aaf2c7fc13576 [id=b6c966d7d56a46cfb4fa632aad28d7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.638146 887 tablet_service.cc:1511] Processing CreateTablet for tablet ca6d7f30c5a84106bebebc42eedee654 (DEFAULT_TABLE table=default.Table_5ba1b89a3b684c4f9927a1cefb74588d [id=cb0dfc15d9414ae3b63638e94c05c0a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.638235 886 tablet_service.cc:1511] Processing CreateTablet for tablet 46dcf2293e2d461ca1be171069867d1f (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:54.661031 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 242889us
I20260619 19:53:54.661725 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6d7f30c5a84106bebebc42eedee654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.662201 858 leader_election.cc:304] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.663345 1405 raft_consensus.cc:2804] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:54.664119 1405 raft_consensus.cc:697] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:54.667009 1331 tablet_replica.cc:333] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:54.669101 890 tablet_service.cc:1511] Processing CreateTablet for tablet e8c3aef303b94d58aaa24917399ac240 (DEFAULT_TABLE table=default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.668927 858 leader_election.cc:304] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.669778 1621 raft_consensus.cc:2804] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.669900 1621 raft_consensus.cc:493] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.669999 1621 raft_consensus.cc:3060] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.672505 1405 consensus_queue.cc:237] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.675263 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c7454e0f284d4da3b90876e9c49da830" } modify_external_catalogs: true
I20260619 19:53:54.675530 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c7454e0f284d4da3b90876e9c49da830" } modify_external_catalogs: true
I20260619 19:53:54.675633 596 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_89e0d67d36c34443a92db1e8c7031834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.676224 596 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89e0d67d36c34443a92db1e8c7031834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.680444 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d651c8fb8ff244a5a09dd9ea593ecb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.682372 1331 raft_consensus.cc:2243] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:54.682664 1331 raft_consensus.cc:2272] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:54.639370 885 tablet_service.cc:1511] Processing CreateTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 (DEFAULT_TABLE table=default.Table_5768d3c75855417f86920d5378cce7de [id=873b5cd9ab3549b482db039d3920caee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.639215 889 tablet_service.cc:1511] Processing CreateTablet for tablet fde2b5d12ab7465791f26d214c2dc2f5 (DEFAULT_TABLE table=default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae [id=dbf8a7ab6063477b9e3bd2bd051116bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.683401 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9d1bd98764451990e7e8e1b6fbcb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.683938 1331 ts_tablet_manager.cc:1916] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:54.685014 600 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_62d0e0d461a74b99bac5c2251f7f7f63" } modify_external_catalogs: true
I20260619 19:53:54.685225 600 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_62d0e0d461a74b99bac5c2251f7f7f63" } modify_external_catalogs: true
I20260619 19:53:54.685971 1200 tablet_bootstrap.cc:492] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:54.686117 1200 ts_tablet_manager.cc:1403] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.000s
I20260619 19:53:54.669066 884 tablet_service.cc:1511] Processing CreateTablet for tablet dc5235127fb54d3dba90c9f9f8c134b4 (DEFAULT_TABLE table=default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.686913 1200 raft_consensus.cc:359] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.687090 1200 raft_consensus.cc:385] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.687209 1200 raft_consensus.cc:740] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.687446 1200 consensus_queue.cc:260] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.688180 1200 ts_tablet_manager.cc:1434] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:54.690176 759 tablet_service.cc:1511] Processing CreateTablet for tablet d895be304fcf445e9a4d2d8242becdd5 (DEFAULT_TABLE table=default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.691781 604 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_baef1a6b19f94884934f0c54a4dda5d0" } modify_external_catalogs: true
I20260619 19:53:54.692015 604 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_baef1a6b19f94884934f0c54a4dda5d0" } modify_external_catalogs: true
I20260619 19:53:54.694476 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet c9652b7e593c4c2597a1f9268d67b6d1 (table default.Table_5023fdbc94ad42d1b931c6efb4e78679 [id=48b2e4a0c57a49ba85be21c915aa9502]) successfully deleted
I20260619 19:53:54.695910 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d651c8fb8ff244a5a09dd9ea593ecb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.696806 747 tablet_service.cc:1511] Processing CreateTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (DEFAULT_TABLE table=default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.699278 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d895be304fcf445e9a4d2d8242becdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.703289 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c3aef303b94d58aaa24917399ac240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.705722 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dcf2293e2d461ca1be171069867d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.705920 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37393d7c16594032bf2a69abb0ab5931" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.707492 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b55debc1b064192a56d2453364ba260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.708055 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.709364 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54b2e4f657245c2aa23d138968b3b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.719566 898 tablet_service.cc:1511] Processing CreateTablet for tablet c54b2e4f657245c2aa23d138968b3b0d (DEFAULT_TABLE table=default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.720964 1200 tablet_bootstrap.cc:492] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:54.720392 858 leader_election.cc:343] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 707af50da2ef469fb671df04cb72bb81
I20260619 19:53:54.720631 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde2b5d12ab7465791f26d214c2dc2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.702167 902 tablet_service.cc:1511] Processing CreateTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (DEFAULT_TABLE table=default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.731536 918 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:54.732189 996 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.732596 1628 raft_consensus.cc:2804] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:54.732779 1628 raft_consensus.cc:697] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:54.733047 1628 consensus_queue.cc:237] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.733527 1627 tablet_replica.cc:333] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:54.735437 1627 raft_consensus.cc:2243] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:54.737844 1627 raft_consensus.cc:2272] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:54.746316 599 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 33935217c1f44ce0ad5b8610d368f2eb
I20260619 19:53:54.746376 1627 ts_tablet_manager.cc:1916] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:54.746948 601 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 304e1eed89f54b809ac52efe2226dc35
I20260619 19:53:54.747574 1200 tablet_bootstrap.cc:654] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.747964 597 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 131ccb73ea1f4a7b8781c093ea2995d1
I20260619 19:53:54.748594 602 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:53:54.753057 599 catalog_manager.cc:6784] ReplaceTablet: tablet 33935217c1f44ce0ad5b8610d368f2eb deleted and replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919
I20260619 19:53:54.753923 601 catalog_manager.cc:6784] ReplaceTablet: tablet 304e1eed89f54b809ac52efe2226dc35 deleted and replaced by tablet f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:53:54.754737 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:54.755340 603 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb547965fc7e4aa29d427b1acc7d6e51 consensus state has no leader
I20260619 19:53:54.755684 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5235127fb54d3dba90c9f9f8c134b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.756947 600 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Sending DeleteTablet for 3 replicas of tablet 19d6333b0c8940b2802307d0da8a57ac
I20260619 19:53:54.758258 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6d7f30c5a84106bebebc42eedee654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.759337 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:54.760478 996 leader_election.cc:343] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.760663 996 leader_election.cc:304] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:54.761250 601 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_2dc810dbe0264b59aed3d2f2186ea1dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.761925 601 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dc810dbe0264b59aed3d2f2186ea1dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.763495 599 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51756:
name: "default.Table_1b1eebd6048a4df78f905c5f2d1959c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:54.764094 599 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b1eebd6048a4df78f905c5f2d1959c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:54.765530 1628 raft_consensus.cc:2749] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:54.765921 597 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c89d6514dbcb43c0b65132772e18e5ee" } modify_external_catalogs: true
I20260619 19:53:54.766095 597 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51756:
table { table_name: "default.Table_c89d6514dbcb43c0b65132772e18e5ee" } modify_external_catalogs: true
W20260619 19:53:54.766170 996 leader_election.cc:343] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:54.766381 996 leader_election.cc:304] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:54.766980 1628 raft_consensus.cc:2749] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:54.769619 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:55584
W20260619 19:53:54.770838 590 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet fbc952b283d94035be1f86f3b90382b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbc952b283d94035be1f86f3b90382b6 already in progress: creating tablet
I20260619 19:53:54.766175 1200 tablet_bootstrap.cc:492] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:54.772917 783 raft_consensus.cc:3060] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.777166 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74949d09466f42e2852389e10192989d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.777379 903 tablet_service.cc:1511] Processing CreateTablet for tablet ed9d1bd98764451990e7e8e1b6fbcb0b (DEFAULT_TABLE table=default.Table_6e54fd634fc845d7b9ab428009616c61 [id=23b39c02806142d4b0a5c7c0d898b8dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.746167 858 leader_election.cc:304] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.779412 1200 ts_tablet_manager.cc:1403] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.001s
W20260619 19:53:54.783890 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 101236us
I20260619 19:53:54.787006 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.787827 1566 consensus_queue.cc:1048] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260619 19:53:54.789597 602 catalog_manager.cc:5696] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:54.789759 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 131ccb73ea1f4a7b8781c093ea2995d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.794644 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task38CK2r/build/asan/bin/kudu pid 569
I20260619 19:53:54.796927 634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 19:53:54.794713 1200 raft_consensus.cc:359] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.798158 1200 raft_consensus.cc:385] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.799155 1200 raft_consensus.cc:740] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.800966 1200 consensus_queue.cc:260] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.805310 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a9c96d9c034a4a8a4d05d8518ebcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.806255 783 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:54.807344 1200 ts_tablet_manager.cc:1434] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.027s user 0.002s sys 0.001s
I20260619 19:53:54.811882 1200 tablet_bootstrap.cc:492] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:54.814721 1618 raft_consensus.cc:493] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.815223 1208 tablet_bootstrap.cc:492] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:54.815747 1200 tablet_bootstrap.cc:654] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.813995 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.813580 1630 consensus_queue.cc:1048] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260619 19:53:54.819142 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 131ccb73ea1f4a7b8781c093ea2995d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.821457 765 tablet_service.cc:1511] Processing CreateTablet for tablet 90b8468df4a449d088f47b3b150ce54a (DEFAULT_TABLE table=default.Table_6354f0bf977c438d9ffcf548901ac7af [id=56ee4af476f74b9ab373fb2bfc1c315e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.824440 1208 ts_tablet_manager.cc:1403] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.440s user 0.000s sys 0.006s
I20260619 19:53:54.826942 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 69fa5d1df8d84fcd938349af6d2d0af0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.828500 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 376dfca0b54d4c689c96242566869717 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.829838 1025 tablet_service.cc:1511] Processing CreateTablet for tablet dff07e4afabc4e21a74ed0aa68c9026f (DEFAULT_TABLE table=default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.834431 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff07e4afabc4e21a74ed0aa68c9026f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.834826 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.830020 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.839239 1331 ts_tablet_manager.cc:1929] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:54.839380 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.839632 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6baa466f30c2460697217f526fc4617f with delete_type TABLET_DATA_DELETED (replaced by tablet 33cfbae501de432cbcb34d2a6365f806) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.839781 1566 raft_consensus.cc:493] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.840206 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b8468df4a449d088f47b3b150ce54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.841053 1632 consensus_queue.cc:1048] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260619 19:53:54.843242 921 raft_consensus.cc:3060] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.843528 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa466f30c2460697217f526fc4617f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:54.841480 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.844339 758 tablet_service.cc:1511] Processing CreateTablet for tablet 26355bc6b5c147a88c14a9f053b4e1f3 (DEFAULT_TABLE table=default.Table_5397e7b4951344259694a66e18f7fd6f [id=173145ae0ed048a08221a123efe05b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.847265 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26355bc6b5c147a88c14a9f053b4e1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.848239 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.848198 1631 consensus_queue.cc:1048] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260619 19:53:54.848832 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 304e1eed89f54b809ac52efe2226dc35 with delete_type TABLET_DATA_DELETED (replaced by tablet f6c6ad82f0c94e27b2eb4dbf185fab66) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.850477 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:49744
I20260619 19:53:54.851240 1566 raft_consensus.cc:515] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.861812 1208 raft_consensus.cc:359] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.862170 1208 raft_consensus.cc:385] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.862337 1208 raft_consensus.cc:740] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.862721 1208 consensus_queue.cc:260] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.839542 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 304e1eed89f54b809ac52efe2226dc35 with delete_type TABLET_DATA_DELETED (replaced by tablet f6c6ad82f0c94e27b2eb4dbf185fab66) from {username='slave'} at 127.0.0.1:55584
I20260619 19:53:54.860129 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.863288 1060 raft_consensus.cc:2468] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:54.863343 1331 log.cc:1199] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d97025f1e0634720bc68d0a6196bd20b
I20260619 19:53:54.863862 1331 ts_tablet_manager.cc:1950] T d97025f1e0634720bc68d0a6196bd20b P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:54.865911 720 leader_election.cc:304] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:54.868801 1626 raft_consensus.cc:2749] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:54.869253 1634 log.cc:927] Time spent T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260619 19:53:54.870899 1621 raft_consensus.cc:515] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.873524 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 166) took 2382 ms. Trace:
I20260619 19:53:54.873670 1331 rpcz_store.cc:276] 0619 19:53:52.490927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.491001 (+ 74us) service_pool.cc:224] Handling call
0619 19:53:54.651537 (+2160536us) ts_tablet_manager.cc:1151] Deleting tablet d97025f1e0634720bc68d0a6196bd20b
0619 19:53:54.651551 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.756383 (+104832us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:54.839083 (+ 82700us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:54.873478 (+ 34395us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2160234}
I20260619 19:53:54.874218 591 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d97025f1e0634720bc68d0a6196bd20b (table default.Table_31acb6e850e140b09225f0905b1a5d8c [id=d6c6c699115c4d7c8edbc8a1131ab5c9]) successfully deleted
I20260619 19:53:54.875458 858 leader_election.cc:304] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.876909 918 raft_consensus.cc:2393] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:54.877892 1631 raft_consensus.cc:2804] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:54.879204 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54b2e4f657245c2aa23d138968b3b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.880512 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 168) took 2285 ms. Trace:
I20260619 19:53:54.880640 1331 rpcz_store.cc:276] 0619 19:53:52.595402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.595473 (+ 71us) service_pool.cc:224] Handling call
0619 19:53:54.880352 (+2284879us) ts_tablet_manager.cc:1151] Deleting tablet 2d1b7b743e594e2aaeaeedd8613d9789
0619 19:53:54.880363 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.880474 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2225288}
I20260619 19:53:54.883886 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 169) took 2288 ms. Trace:
I20260619 19:53:54.884424 1618 raft_consensus.cc:515] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.884904 1331 rpcz_store.cc:276] 0619 19:53:52.595627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.595706 (+ 79us) service_pool.cc:224] Handling call
0619 19:53:54.883685 (+2287979us) ts_tablet_manager.cc:1151] Deleting tablet 5bae5be1340f4158a0b243415e232ae5
0619 19:53:54.883697 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.883850 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228383}
W20260619 19:53:54.885571 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 91388.8us
I20260619 19:53:54.887748 1631 raft_consensus.cc:493] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:54.887883 1631 raft_consensus.cc:3060] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.888079 719 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.865234 746 tablet_service.cc:1511] Processing CreateTablet for tablet dff07e4afabc4e21a74ed0aa68c9026f (DEFAULT_TABLE table=default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.899791 1630 raft_consensus.cc:2749] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:53:54.901108 1566 leader_election.cc:290] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:54.908409 901 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.911398 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 707af50da2ef469fb671df04cb72bb81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.919617 1331 tablet_replica.cc:333] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:54.919950 1331 raft_consensus.cc:2243] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:54.906857 1200 tablet_bootstrap.cc:492] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:54.920675 1200 ts_tablet_manager.cc:1403] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.002s
I20260619 19:53:54.921633 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff07e4afabc4e21a74ed0aa68c9026f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.921599 1200 raft_consensus.cc:359] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.921773 1200 raft_consensus.cc:385] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:54.921913 1200 raft_consensus.cc:740] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:54.922271 1200 consensus_queue.cc:260] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.922981 1200 ts_tablet_manager.cc:1434] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:54.925516 1200 tablet_bootstrap.cc:492] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:54.926522 859 leader_election.cc:343] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d29506dab4c84850ad79b8b7a0340987
W20260619 19:53:54.927292 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 49056.8us
I20260619 19:53:54.927433 1200 tablet_bootstrap.cc:654] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:54.927657 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f33c2c00b414fbebf1965510e1e2b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:54.929284 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 69fa5d1df8d84fcd938349af6d2d0af0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.930095 1331 raft_consensus.cc:2272] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:54.930492 894 tablet_service.cc:1511] Processing CreateTablet for tablet 90b8468df4a449d088f47b3b150ce54a (DEFAULT_TABLE table=default.Table_6354f0bf977c438d9ffcf548901ac7af [id=56ee4af476f74b9ab373fb2bfc1c315e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.931874 1201 tablet_bootstrap.cc:492] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:54.934520 1201 ts_tablet_manager.cc:1403] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.551s user 0.009s sys 0.007s
I20260619 19:53:54.935595 919 raft_consensus.cc:3060] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.935946 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cd2fca96ee44cf297eb248b1f3ed00a with delete_type TABLET_DATA_DELETED (replaced by tablet 1a686826694b49b9bb5bcdefd61c9a15) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.936153 900 tablet_service.cc:1511] Processing CreateTablet for tablet d895be304fcf445e9a4d2d8242becdd5 (DEFAULT_TABLE table=default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.931113 1331 ts_tablet_manager.cc:1916] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:54.937482 1566 consensus_queue.cc:1048] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260619 19:53:54.943387 1514 raft_consensus.cc:697] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:54.946820 1631 raft_consensus.cc:515] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.944898 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 732a2e073e3442ff873ca00be6106744 with delete_type TABLET_DATA_DELETED (replaced by tablet d0a9c96d9c034a4a8a4d05d8518ebcec) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.945982 1621 leader_election.cc:290] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.950596 858 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.954422 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6baa466f30c2460697217f526fc4617f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:54.954668 783 raft_consensus.cc:2393] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:54.955428 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:54.932394 1656 tablet.cc:1724] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:54.956048 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29506dab4c84850ad79b8b7a0340987" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:54.956207 784 raft_consensus.cc:3060] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:54.957693 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 376dfca0b54d4c689c96242566869717 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.957993 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.959050 891 tablet_service.cc:1558] Processing DeleteTablet for tablet da983715197847f18466d61f1eade0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet a33cb04fdb8944e8817d51bd56806665) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.959960 784 raft_consensus.cc:2468] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:54.961056 858 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:54.962095 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950b8e74d12f46a68ba5eae3186c87a9" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:54.964236 1621 raft_consensus.cc:2764] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260619 19:53:54.967324 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.970520 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 131ccb73ea1f4a7b8781c093ea2995d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.973747 1631 leader_election.cc:290] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:54.977449 901 tablet_service.cc:1511] Processing CreateTablet for tablet dff07e4afabc4e21a74ed0aa68c9026f (DEFAULT_TABLE table=default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:54.981809 1208 ts_tablet_manager.cc:1434] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.053s user 0.004s sys 0.000s
W20260619 19:53:54.989099 996 consensus_peers.cc:597] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:54.989369 1628 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:54.989503 1628 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:54.990162 1628 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:54.991019 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:54.991910 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.992158 886 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.992326 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 60324f7edaac45ed919be7e2368a4fd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:49 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:54.996991 1626 raft_consensus.cc:2749] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:54.997560 1626 raft_consensus.cc:2749] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.009850 1200 tablet_bootstrap.cc:492] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.010071 1200 ts_tablet_manager.cc:1403] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.085s user 0.001s sys 0.002s
I20260619 19:53:55.013643 1514 consensus_queue.cc:237] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.018725 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:55.019636 996 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.021610 1200 raft_consensus.cc:359] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.021828 1200 raft_consensus.cc:385] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.021905 1200 raft_consensus.cc:740] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.022559 1201 raft_consensus.cc:359] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.022985 1201 raft_consensus.cc:385] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.023186 1201 raft_consensus.cc:740] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.023947 1201 consensus_queue.cc:260] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.025683 1200 consensus_queue.cc:260] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.026233 1200 ts_tablet_manager.cc:1434] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260619 19:53:55.027050 1201 ts_tablet_manager.cc:1434] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.091s user 0.000s sys 0.003s
I20260619 19:53:55.027174 1200 tablet_bootstrap.cc:492] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.027690 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a9c96d9c034a4a8a4d05d8518ebcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:55.028003 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b8468df4a449d088f47b3b150ce54a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:55.028075 858 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:53:55.028237 858 leader_election.cc:304] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:55.028652 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 67153.1us
I20260619 19:53:55.028921 858 leader_election.cc:304] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.029065 1626 raft_consensus.cc:3060] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.029575 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff07e4afabc4e21a74ed0aa68c9026f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:55.030625 1200 tablet_bootstrap.cc:654] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.033008 1621 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.033190 1621 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.033922 1621 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.034077 1621 raft_consensus.cc:2804] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.034204 1621 raft_consensus.cc:697] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:55.034464 1621 consensus_queue.cc:237] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.035061 922 raft_consensus.cc:2468] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:55.035728 1628 raft_consensus.cc:493] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.035900 1628 raft_consensus.cc:515] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.036077 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:55.036487 1628 leader_election.cc:290] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.036553 897 tablet_service.cc:1511] Processing CreateTablet for tablet 26355bc6b5c147a88c14a9f053b4e1f3 (DEFAULT_TABLE table=default.Table_5397e7b4951344259694a66e18f7fd6f [id=173145ae0ed048a08221a123efe05b12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:55.037030 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26355bc6b5c147a88c14a9f053b4e1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:55.037092 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.037281 1059 raft_consensus.cc:2468] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:55.037526 996 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.039477 1628 raft_consensus.cc:2804] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.039605 1628 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.039734 1628 raft_consensus.cc:3060] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.040975 1331 ts_tablet_manager.cc:1929] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.041141 1331 log.cc:1199] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/68746ca7888e4af891238f79dcfdde10
I20260619 19:53:55.041538 1331 ts_tablet_manager.cc:1950] T 68746ca7888e4af891238f79dcfdde10 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:54.944329 1618 leader_election.cc:290] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.042548 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 174) took 2320 ms. Trace:
I20260619 19:53:55.042650 1331 rpcz_store.cc:276] 0619 19:53:52.721988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.722041 (+ 53us) service_pool.cc:224] Handling call
0619 19:53:54.919527 (+2197486us) ts_tablet_manager.cc:1151] Deleting tablet 68746ca7888e4af891238f79dcfdde10
0619 19:53:54.919539 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:54.940132 (+ 20593us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.040883 (+100751us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.042486 (+ 1603us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197255}
I20260619 19:53:55.045174 1208 tablet_bootstrap.cc:492] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.048959 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f7be0f6e9f4fc6ba7bde011a9bbf60" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:55.050716 1619 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.441s user 0.003s sys 0.009s
I20260619 19:53:55.054973 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 304e1eed89f54b809ac52efe2226dc35 with delete_type TABLET_DATA_DELETED (replaced by tablet f6c6ad82f0c94e27b2eb4dbf185fab66) from {username='slave'} at 127.0.0.1:32994
I20260619 19:53:55.055255 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d895be304fcf445e9a4d2d8242becdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:55.055864 1637 raft_consensus.cc:493] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.056216 1201 tablet_bootstrap.cc:492] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.056592 858 leader_election.cc:304] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.056566 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f7be0f6e9f4fc6ba7bde011a9bbf60" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.057516 1208 tablet_bootstrap.cc:654] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.058040 1618 raft_consensus.cc:2749] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.057904 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.066985 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.067744 859 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:55.069310 858 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.070571 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9d1bd98764451990e7e8e1b6fbcb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:55.070868 1637 raft_consensus.cc:515] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.075956 1247 ts_tablet_manager.cc:1929] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.076305 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.043006 1628 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.078466 1637 leader_election.cc:290] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.078526 1628 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:55.049644 996 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.069878 1200 tablet_bootstrap.cc:492] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.078827 1200 ts_tablet_manager.cc:1403] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.016s
W20260619 19:53:55.079098 996 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.079504 996 leader_election.cc:304] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.079756 1200 raft_consensus.cc:359] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.079954 1628 raft_consensus.cc:2749] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.079937 1200 raft_consensus.cc:385] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.080240 1200 raft_consensus.cc:740] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.080494 1200 consensus_queue.cc:260] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:55.080633 859 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:53:55.080724 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 173) took 2360 ms. Trace:
I20260619 19:53:55.080827 1331 rpcz_store.cc:276] 0619 19:53:52.720075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.721061 (+ 986us) service_pool.cc:224] Handling call
0619 19:53:55.080507 (+2359446us) ts_tablet_manager.cc:1151] Deleting tablet 467bb41a4e9f46e497726c6b29ddeb04
0619 19:53:55.080519 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.080634 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2313009}
I20260619 19:53:55.083323 1200 ts_tablet_manager.cc:1434] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:55.085512 1514 raft_consensus.cc:2804] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.092832 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 175) took 2327 ms. Trace:
I20260619 19:53:55.092954 1200 tablet_bootstrap.cc:492] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.092998 1331 rpcz_store.cc:276] 0619 19:53:52.765790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.765958 (+ 168us) service_pool.cc:224] Handling call
0619 19:53:55.081227 (+2315269us) ts_tablet_manager.cc:1151] Deleting tablet 82d2dd6eedd24f44a6a17aceb20e62bb
0619 19:53:55.087281 (+ 6054us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.092756 (+ 5475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2269341}
I20260619 19:53:55.093688 1331 tablet_replica.cc:333] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.093973 1331 raft_consensus.cc:2243] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.094142 1247 log.cc:1199] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/2d37d6f54a96471fad26a342cab984ef
I20260619 19:53:55.094209 1331 raft_consensus.cc:2272] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.094750 1247 ts_tablet_manager.cc:1950] T 2d37d6f54a96471fad26a342cab984ef P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.094812 1200 tablet_bootstrap.cc:654] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.094856 1331 ts_tablet_manager.cc:1916] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.096060 1247 tablet_replica.cc:333] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.096293 1247 raft_consensus.cc:2243] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.096504 1247 raft_consensus.cc:2272] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.097056 1247 ts_tablet_manager.cc:1916] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.102881 1631 consensus_queue.cc:1048] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 19:53:55.102941 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.107573 1200 tablet_bootstrap.cc:492] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.107756 1200 ts_tablet_manager.cc:1403] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260619 19:53:55.108717 1200 raft_consensus.cc:359] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.109011 1200 raft_consensus.cc:385] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.109081 1200 raft_consensus.cc:740] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.109416 1200 consensus_queue.cc:260] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.110054 1200 ts_tablet_manager.cc:1434] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:55.110443 1200 tablet_bootstrap.cc:492] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.112457 1200 tablet_bootstrap.cc:654] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:55.117041 719 leader_election.cc:343] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.117157 1631 consensus_queue.cc:1048] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.117769 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:55.118597 996 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.120524 1200 tablet_bootstrap.cc:492] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.120724 1200 ts_tablet_manager.cc:1403] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260619 19:53:55.122014 1200 raft_consensus.cc:359] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.122241 1200 raft_consensus.cc:385] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.122354 1200 raft_consensus.cc:740] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.122622 1200 consensus_queue.cc:260] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:55.124873 719 leader_election.cc:343] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.125423 1200 ts_tablet_manager.cc:1434] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260619 19:53:55.126633 858 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:53:55.126780 858 leader_election.cc:304] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.126686 1631 consensus_queue.cc:1048] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 19:53:55.127194 1631 consensus_queue.cc:1048] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.129168 1200 tablet_bootstrap.cc:492] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.131920 1514 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.132476 1626 raft_consensus.cc:2749] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:55.134352 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 202042us
I20260619 19:53:55.135462 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.135676 1057 raft_consensus.cc:3060] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.139992 1057 raft_consensus.cc:2468] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.142952 1200 tablet_bootstrap.cc:654] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.145401 1630 raft_consensus.cc:493] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.145620 1630 raft_consensus.cc:515] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.146844 1630 leader_election.cc:290] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:55.147960 720 leader_election.cc:304] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:55.148276 1659 consensus_queue.cc:1048] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.148816 1659 raft_consensus.cc:2804] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.148970 1659 raft_consensus.cc:697] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:55.149245 1659 consensus_queue.cc:237] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.154500 1514 raft_consensus.cc:3060] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.156390 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5cda43d0b4719a82f33a03e2261d3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.156792 917 raft_consensus.cc:2468] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.157503 719 leader_election.cc:304] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.158281 1659 raft_consensus.cc:2804] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.158433 1659 raft_consensus.cc:493] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.158587 1659 raft_consensus.cc:3060] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.162189 1659 raft_consensus.cc:515] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.162890 1659 leader_election.cc:290] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:55.167879 1652 raft_consensus.cc:2749] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.169073 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5cda43d0b4719a82f33a03e2261d3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.171597 917 raft_consensus.cc:3060] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:55.171641 1662 log.cc:927] Time spent T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260619 19:53:55.171860 1619 tablet.cc:1724] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:55.174980 1208 tablet_bootstrap.cc:492] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.175239 1208 ts_tablet_manager.cc:1403] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.193s user 0.009s sys 0.010s
I20260619 19:53:55.176252 1208 raft_consensus.cc:359] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.176503 1208 raft_consensus.cc:385] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.176622 1208 raft_consensus.cc:740] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.177386 1208 consensus_queue.cc:260] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.189467 1201 tablet_bootstrap.cc:654] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.194195 917 raft_consensus.cc:2468] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.195708 719 leader_election.cc:304] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.198210 1659 raft_consensus.cc:2804] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.199268 1659 raft_consensus.cc:697] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:55.200014 1659 consensus_queue.cc:237] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.209482 1514 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.211489 922 raft_consensus.cc:2393] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:55.212380 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.218040 1514 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.224526 1247 ts_tablet_manager.cc:1929] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.225317 1201 tablet_bootstrap.cc:492] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.225747 1201 ts_tablet_manager.cc:1403] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.179s user 0.009s sys 0.006s
I20260619 19:53:55.226843 1201 raft_consensus.cc:359] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.225587 1247 log.cc:1199] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/707af50da2ef469fb671df04cb72bb81
I20260619 19:53:55.227259 1201 raft_consensus.cc:385] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.227380 1201 raft_consensus.cc:740] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.227855 1679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d38b77ff37948e19592b36b6d884fe0)
I20260619 19:53:55.228009 1201 consensus_queue.cc:260] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.228084 1679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:55.229019 1201 ts_tablet_manager.cc:1434] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:53:55.229405 1679 leader_election.cc:290] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:55.229611 1208 ts_tablet_manager.cc:1434] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260619 19:53:55.230427 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 3 candidate_status { last_received { term: 2 index: 379 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:55.232846 1201 tablet_bootstrap.cc:492] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.225273 1676 tablet.cc:1724] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:55.234059 1247 ts_tablet_manager.cc:1950] T 707af50da2ef469fb671df04cb72bb81 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.238509 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:55.239343 1201 tablet_bootstrap.cc:654] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:55.240208 858 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.242502 1247 tablet_replica.cc:333] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.242851 1247 raft_consensus.cc:2243] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.245940 1247 raft_consensus.cc:2272] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.247946 1201 tablet_bootstrap.cc:492] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.247982 1247 ts_tablet_manager.cc:1916] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.248178 1201 ts_tablet_manager.cc:1403] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260619 19:53:55.250591 1627 ts_tablet_manager.cc:1929] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.250769 1627 log.cc:1199] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/2d37d6f54a96471fad26a342cab984ef
I20260619 19:53:55.251278 1627 ts_tablet_manager.cc:1950] T 2d37d6f54a96471fad26a342cab984ef P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:55.252417 1627 tablet_replica.cc:333] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:55.252657 1627 raft_consensus.cc:2243] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.252853 1627 raft_consensus.cc:2272] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.254307 1627 ts_tablet_manager.cc:1916] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.255388 1201 raft_consensus.cc:359] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.255611 1201 raft_consensus.cc:385] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.260663 1208 tablet_bootstrap.cc:492] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.255702 1201 raft_consensus.cc:740] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.261740 1201 consensus_queue.cc:260] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.262977 1208 tablet_bootstrap.cc:654] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.265240 1201 ts_tablet_manager.cc:1434] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20260619 19:53:55.275466 1201 tablet_bootstrap.cc:492] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.277438 1201 tablet_bootstrap.cc:654] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.281786 1628 raft_consensus.cc:493] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.282008 1628 raft_consensus.cc:515] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.282467 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5cda43d0b4719a82f33a03e2261d3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.282658 1060 raft_consensus.cc:3060] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.282833 1628 leader_election.cc:290] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.283375 1628 raft_consensus.cc:493] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.283560 1628 raft_consensus.cc:515] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.284227 1628 leader_election.cc:290] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.285164 1057 raft_consensus.cc:2393] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:53:55.258071 1247 ts_tablet_manager.cc:1929] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.288437 1247 log.cc:1199] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/69fa5d1df8d84fcd938349af6d2d0af0
I20260619 19:53:55.288982 1247 ts_tablet_manager.cc:1950] T 69fa5d1df8d84fcd938349af6d2d0af0 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.290068 1247 tablet_replica.cc:333] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.290396 1247 raft_consensus.cc:2243] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:55.290342 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5cda43d0b4719a82f33a03e2261d3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.290680 1247 pending_rounds.cc:70] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:55.290745 1247 pending_rounds.cc:77] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657626966769664 op_type: NO_OP noop_request { }
I20260619 19:53:55.291059 996 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.291412 1201 tablet_bootstrap.cc:492] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.291626 1201 ts_tablet_manager.cc:1403] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s
I20260619 19:53:55.292446 1201 raft_consensus.cc:359] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.292654 1201 raft_consensus.cc:385] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.292768 1201 raft_consensus.cc:740] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.292994 1247 raft_consensus.cc:2889] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:55.293140 1247 raft_consensus.cc:2272] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.293100 1201 consensus_queue.cc:260] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.293282 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c379d780b294b9a863576f53f79ee7b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.293140 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5cda43d0b4719a82f33a03e2261d3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.293859 1201 ts_tablet_manager.cc:1434] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:55.293926 919 raft_consensus.cc:2393] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:55.294284 1201 tablet_bootstrap.cc:492] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.295651 1247 ts_tablet_manager.cc:1916] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.296190 1628 raft_consensus.cc:2749] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260619 19:53:55.297319 996 leader_election.cc:343] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.302958 1628 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.303208 1060 raft_consensus.cc:2468] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.303503 1628 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.304350 1628 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.305248 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:55.305968 996 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.306418 1201 tablet_bootstrap.cc:654] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.306731 1331 ts_tablet_manager.cc:1929] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.306926 1331 log.cc:1199] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:53:55.307783 1331 ts_tablet_manager.cc:1950] T a868706c23e948e5ba3320ceb4a19cf8 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.310860 1200 tablet_bootstrap.cc:492] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.311102 1200 ts_tablet_manager.cc:1403] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.182s user 0.009s sys 0.006s
I20260619 19:53:55.312096 1200 raft_consensus.cc:359] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.312390 1200 raft_consensus.cc:385] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.312510 1200 raft_consensus.cc:740] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.312894 1200 consensus_queue.cc:260] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.313623 1200 ts_tablet_manager.cc:1434] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:55.319181 859 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.319551 1514 raft_consensus.cc:2749] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.323534 1514 consensus_queue.cc:1048] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.323994 1685 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d38b77ff37948e19592b36b6d884fe0)
I20260619 19:53:55.324208 1685 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:55.325963 1362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 380 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:53:55.326066 1685 leader_election.cc:290] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:55.326284 1362 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc90ee2d59d4dddae6790dd92b20cb5 in term 2.
I20260619 19:53:55.326825 1247 ts_tablet_manager.cc:1929] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.326833 516 leader_election.cc:304] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5; no voters:
I20260619 19:53:55.327162 1247 log.cc:1199] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/7cd2fca96ee44cf297eb248b1f3ed00a
I20260619 19:53:55.327761 1247 ts_tablet_manager.cc:1950] T 7cd2fca96ee44cf297eb248b1f3ed00a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.342307 1247 tablet_replica.cc:333] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.344092 1247 raft_consensus.cc:2243] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.344395 1247 raft_consensus.cc:2272] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.349493 1514 consensus_queue.cc:1048] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.352429 1685 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260619 19:53:55.352662 1685 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d38b77ff37948e19592b36b6d884fe0)
I20260619 19:53:55.352665 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5cda43d0b4719a82f33a03e2261d3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.352800 1685 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 2 FOLLOWER]: Advancing to term 3
I20260619 19:53:55.355748 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c379d780b294b9a863576f53f79ee7b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.356666 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.361866 1621 consensus_queue.cc:1048] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.363749 1685 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:55.366722 1247 ts_tablet_manager.cc:1916] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:55.374226 720 consensus_peers.cc:597] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d97025f1e0634720bc68d0a6196bd20b. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:55.378335 1362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 380 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff"
I20260619 19:53:55.378633 1362 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 2 FOLLOWER]: Advancing to term 3
I20260619 19:53:55.379405 1685 leader_election.cc:290] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 election: Requested vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:55.381718 1362 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc90ee2d59d4dddae6790dd92b20cb5 in term 3.
I20260619 19:53:55.383087 516 leader_election.cc:304] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5; no voters:
I20260619 19:53:55.383716 1208 tablet_bootstrap.cc:492] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.383924 1208 ts_tablet_manager.cc:1403] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.153s user 0.003s sys 0.001s
I20260619 19:53:55.383894 1685 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 19:53:55.384872 1208 raft_consensus.cc:359] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.357059 996 leader_election.cc:304] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.386616 1200 tablet_bootstrap.cc:492] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:55.386734 996 leader_election.cc:343] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.386914 996 leader_election.cc:304] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:53:55.387383 996 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.387542 996 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.387583 1208 raft_consensus.cc:385] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.387706 1208 raft_consensus.cc:740] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.388214 1684 raft_consensus.cc:2749] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.388439 1684 raft_consensus.cc:2749] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.388360 1208 consensus_queue.cc:260] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.388731 1628 raft_consensus.cc:2749] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.388863 1200 tablet_bootstrap.cc:654] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.389546 1208 ts_tablet_manager.cc:1434] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:55.390460 1208 tablet_bootstrap.cc:492] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.395360 1685 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [term 3 LEADER]: Becoming Leader. State: Replica: 6cc90ee2d59d4dddae6790dd92b20cb5, State: Running, Role: LEADER
I20260619 19:53:55.397596 1208 tablet_bootstrap.cc:654] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.400156 1659 raft_consensus.cc:493] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.400537 1659 raft_consensus.cc:515] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.401324 1659 leader_election.cc:290] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:55.396837 1685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 379, Committed index: 379, Last appended: 2.380, Last appended by leader: 379, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:55.406237 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37393d7c16594032bf2a69abb0ab5931" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.406461 918 raft_consensus.cc:2468] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.409348 1694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc90ee2d59d4dddae6790dd92b20cb5. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:55.409682 1694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:55.410912 719 leader_election.cc:304] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.411259 1659 raft_consensus.cc:2804] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.411377 1659 raft_consensus.cc:493] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.411470 1659 raft_consensus.cc:3060] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.414660 1659 raft_consensus.cc:515] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.415400 1659 leader_election.cc:290] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:55.415931 1514 consensus_queue.cc:1048] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.416323 1208 tablet_bootstrap.cc:492] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.417209 1208 ts_tablet_manager.cc:1403] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260619 19:53:55.418278 1208 raft_consensus.cc:359] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.419453 1208 raft_consensus.cc:385] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.419730 1208 raft_consensus.cc:740] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.420270 1208 consensus_queue.cc:260] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.419807 1247 ts_tablet_manager.cc:1929] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.420094 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37393d7c16594032bf2a69abb0ab5931" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.420758 1247 log.cc:1199] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/da983715197847f18466d61f1eade0f5
I20260619 19:53:55.421368 1208 ts_tablet_manager.cc:1434] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:53:55.420754 918 raft_consensus.cc:3060] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.421872 1247 ts_tablet_manager.cc:1950] T da983715197847f18466d61f1eade0f5 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.422168 1208 tablet_bootstrap.cc:492] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.424547 918 raft_consensus.cc:2468] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.425477 719 leader_election.cc:304] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.425984 1632 raft_consensus.cc:2804] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.426287 1632 raft_consensus.cc:697] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:55.426476 1208 tablet_bootstrap.cc:654] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.427637 1632 consensus_queue.cc:237] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.434954 1627 ts_tablet_manager.cc:1929] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.435429 1247 tablet_replica.cc:333] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.435750 1247 raft_consensus.cc:2243] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.436000 1247 raft_consensus.cc:2272] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.436710 1247 ts_tablet_manager.cc:1916] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.442751 1201 tablet_bootstrap.cc:492] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.442945 1201 ts_tablet_manager.cc:1403] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.149s user 0.026s sys 0.030s
I20260619 19:53:55.386162 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 179) took 2478 ms. Trace:
I20260619 19:53:55.443293 1331 rpcz_store.cc:276] 0619 19:53:52.907663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.916058 (+ 8395us) service_pool.cc:224] Handling call
0619 19:53:55.093468 (+2177410us) ts_tablet_manager.cc:1151] Deleting tablet a868706c23e948e5ba3320ceb4a19cf8
0619 19:53:55.093602 (+ 134us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.141741 (+ 48139us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.306628 (+164887us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.386114 (+ 79486us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166836}
I20260619 19:53:55.443922 1201 raft_consensus.cc:359] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.444123 1201 raft_consensus.cc:385] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.444218 1201 raft_consensus.cc:740] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.444505 1201 consensus_queue.cc:260] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.445243 1201 ts_tablet_manager.cc:1434] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:55.446940 1201 tablet_bootstrap.cc:492] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.382158 1687 raft_consensus.cc:493] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.427412 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37393d7c16594032bf2a69abb0ab5931" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.428596 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37393d7c16594032bf2a69abb0ab5931" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.455233 1627 log.cc:1199] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/7cd2fca96ee44cf297eb248b1f3ed00a
I20260619 19:53:55.455416 1059 raft_consensus.cc:2468] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.455762 1627 ts_tablet_manager.cc:1950] T 7cd2fca96ee44cf297eb248b1f3ed00a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:55.455658 1687 raft_consensus.cc:515] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.457680 1687 leader_election.cc:290] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.458055 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b08ab9ad59049919649b96890b6785d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.458678 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 180) took 2469 ms. Trace:
I20260619 19:53:55.458905 1331 rpcz_store.cc:276] 0619 19:53:52.988993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:52.989297 (+ 304us) service_pool.cc:224] Handling call
0619 19:53:55.458493 (+2469196us) ts_tablet_manager.cc:1151] Deleting tablet 1a686826694b49b9bb5bcdefd61c9a15
0619 19:53:55.458507 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.458636 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2466190}
W20260619 19:53:55.459503 996 leader_election.cc:343] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.459786 1331 tablet_replica.cc:333] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.460179 1331 raft_consensus.cc:2243] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.460225 1627 tablet_replica.cc:333] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:55.460413 1331 raft_consensus.cc:2272] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.460448 1627 raft_consensus.cc:2243] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.460677 1627 raft_consensus.cc:2272] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.461335 1627 ts_tablet_manager.cc:1916] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.461493 1331 ts_tablet_manager.cc:1916] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.465821 1659 consensus_queue.cc:1048] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.479454 1200 tablet_bootstrap.cc:492] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.479653 1200 ts_tablet_manager.cc:1403] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.000s
I20260619 19:53:55.481156 1200 raft_consensus.cc:359] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.481369 1200 raft_consensus.cc:385] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.481467 1200 raft_consensus.cc:740] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.481755 1200 consensus_queue.cc:260] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.462067 1247 ts_tablet_manager.cc:1929] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.457163 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b08ab9ad59049919649b96890b6785d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.487789 1247 log.cc:1199] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/131ccb73ea1f4a7b8781c093ea2995d1
I20260619 19:53:55.488235 1247 ts_tablet_manager.cc:1950] T 131ccb73ea1f4a7b8781c093ea2995d1 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:53:55.488294 996 leader_election.cc:343] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.488476 996 leader_election.cc:304] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.489398 1247 tablet_replica.cc:333] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.489614 1247 raft_consensus.cc:2243] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.489825 1247 raft_consensus.cc:2272] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.490648 1200 ts_tablet_manager.cc:1434] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260619 19:53:55.491297 1247 ts_tablet_manager.cc:1916] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.493775 1687 raft_consensus.cc:2749] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.499557 1247 ts_tablet_manager.cc:1929] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.499796 1247 log.cc:1199] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/c2c0afdcf96247b0a16c8f9ac71cc24a
I20260619 19:53:55.500288 1247 ts_tablet_manager.cc:1950] T c2c0afdcf96247b0a16c8f9ac71cc24a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.449436 1201 tablet_bootstrap.cc:654] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.502090 1200 tablet_bootstrap.cc:492] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.502463 1247 tablet_replica.cc:333] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.502727 1247 raft_consensus.cc:2243] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.502972 1247 raft_consensus.cc:2272] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.503590 1247 ts_tablet_manager.cc:1916] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.511703 1627 ts_tablet_manager.cc:1929] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.512583 1627 log.cc:1199] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/131ccb73ea1f4a7b8781c093ea2995d1
I20260619 19:53:55.513120 1627 ts_tablet_manager.cc:1950] T 131ccb73ea1f4a7b8781c093ea2995d1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:55.514052 1627 tablet_replica.cc:333] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:55.515012 1208 tablet_bootstrap.cc:492] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.515241 1208 ts_tablet_manager.cc:1403] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.093s user 0.008s sys 0.004s
I20260619 19:53:55.516038 1208 raft_consensus.cc:359] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.516286 1208 raft_consensus.cc:385] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.516333 1201 tablet_bootstrap.cc:492] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.516403 1208 raft_consensus.cc:740] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.516657 1201 ts_tablet_manager.cc:1403] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.070s user 0.005s sys 0.004s
I20260619 19:53:55.516721 1208 consensus_queue.cc:260] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.517382 1208 ts_tablet_manager.cc:1434] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:55.517724 1208 tablet_bootstrap.cc:492] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.517761 1201 raft_consensus.cc:359] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.518054 1201 raft_consensus.cc:385] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.518162 1201 raft_consensus.cc:740] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.518435 1201 consensus_queue.cc:260] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.519212 1201 ts_tablet_manager.cc:1434] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:55.520162 1627 raft_consensus.cc:2243] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:55.520555 1201 tablet_bootstrap.cc:492] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.522557 1208 tablet_bootstrap.cc:654] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.522675 1247 ts_tablet_manager.cc:1929] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.522868 1247 log.cc:1199] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/60324f7edaac45ed919be7e2368a4fd5
I20260619 19:53:55.523015 1627 raft_consensus.cc:2272] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.523698 1201 tablet_bootstrap.cc:654] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.523847 1247 ts_tablet_manager.cc:1950] T 60324f7edaac45ed919be7e2368a4fd5 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.525776 1687 consensus_queue.cc:1048] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.525951 1247 tablet_replica.cc:333] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:55.526320 1247 raft_consensus.cc:2243] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:55.526672 1247 pending_rounds.cc:70] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:53:55.526795 1247 pending_rounds.cc:77] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657628223811584 op_type: NO_OP noop_request { }
I20260619 19:53:55.527009 1247 raft_consensus.cc:2889] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:55.527258 1247 raft_consensus.cc:2272] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.527774 1627 ts_tablet_manager.cc:1916] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.528589 1247 ts_tablet_manager.cc:1916] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.541040 1514 raft_consensus.cc:493] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.541221 1514 raft_consensus.cc:515] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.541901 1514 leader_election.cc:290] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.542699 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.542950 1059 raft_consensus.cc:2468] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:55.543368 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:55.543977 858 leader_election.cc:343] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.544132 858 leader_election.cc:304] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.544487 1514 raft_consensus.cc:2804] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.544612 1514 raft_consensus.cc:493] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.544708 1514 raft_consensus.cc:3060] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.545418 1200 tablet_bootstrap.cc:654] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.545425 1627 ts_tablet_manager.cc:1929] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.545351 1628 consensus_queue.cc:1048] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:55.545550 1627 log.cc:1199] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/69fa5d1df8d84fcd938349af6d2d0af0
I20260619 19:53:55.545953 1627 ts_tablet_manager.cc:1950] T 69fa5d1df8d84fcd938349af6d2d0af0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:55.548079 1514 raft_consensus.cc:515] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.549207 1514 leader_election.cc:290] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.549654 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:55.550208 858 leader_election.cc:343] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.551087 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.551373 1059 raft_consensus.cc:3060] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.552363 1247 ts_tablet_manager.cc:1929] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.555017 1247 log.cc:1199] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/304e1eed89f54b809ac52efe2226dc35
I20260619 19:53:55.554966 1059 raft_consensus.cc:2468] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:55.555464 1627 tablet_replica.cc:333] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:55.555778 1627 raft_consensus.cc:2243] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.556041 1627 raft_consensus.cc:2272] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.556710 1208 tablet_bootstrap.cc:492] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.556717 1627 ts_tablet_manager.cc:1916] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.556927 1208 ts_tablet_manager.cc:1403] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.006s
I20260619 19:53:55.557291 859 leader_election.cc:304] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.557720 1514 raft_consensus.cc:2804] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.557919 1514 raft_consensus.cc:697] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:55.558208 1514 consensus_queue.cc:237] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.559897 1208 raft_consensus.cc:359] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.560130 1208 raft_consensus.cc:385] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.560227 1208 raft_consensus.cc:740] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.560504 1208 consensus_queue.cc:260] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.561142 1208 ts_tablet_manager.cc:1434] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260619 19:53:55.561482 1208 tablet_bootstrap.cc:492] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.570436 1247 ts_tablet_manager.cc:1950] T 304e1eed89f54b809ac52efe2226dc35 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:55.537192 1331 ts_tablet_manager.cc:1929] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.570959 1331 log.cc:1199] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:53:55.571385 1331 ts_tablet_manager.cc:1950] T 9be5cda43d0b4719a82f33a03e2261d3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.574630 1208 tablet_bootstrap.cc:654] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.571995 1201 tablet_bootstrap.cc:492] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.577121 1201 ts_tablet_manager.cc:1403] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.005s
I20260619 19:53:55.578248 1201 raft_consensus.cc:359] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.578781 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 181) took 2532 ms. Trace:
I20260619 19:53:55.578958 1201 raft_consensus.cc:385] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.578986 1627 ts_tablet_manager.cc:1929] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.579089 1201 raft_consensus.cc:740] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.579231 1627 log.cc:1199] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/6baa466f30c2460697217f526fc4617f
I20260619 19:53:55.579241 1331 rpcz_store.cc:276] 0619 19:53:53.045801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.045870 (+ 69us) service_pool.cc:224] Handling call
0619 19:53:55.459707 (+2413837us) ts_tablet_manager.cc:1151] Deleting tablet 9be5cda43d0b4719a82f33a03e2261d3
0619 19:53:55.459720 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.475746 (+ 16026us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.537079 (+ 61333us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.578693 (+ 41614us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2413482}
I20260619 19:53:55.579439 1201 consensus_queue.cc:260] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.579914 1627 ts_tablet_manager.cc:1950] T 6baa466f30c2460697217f526fc4617f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:55.581247 1331 tablet_replica.cc:333] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.583580 1201 ts_tablet_manager.cc:1434] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:55.583942 1201 tablet_bootstrap.cc:492] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.586344 1201 tablet_bootstrap.cc:654] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.589347 1208 tablet_bootstrap.cc:492] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.589597 1208 ts_tablet_manager.cc:1403] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260619 19:53:55.590435 1208 raft_consensus.cc:359] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.590710 1208 raft_consensus.cc:385] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.590929 1208 raft_consensus.cc:740] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.591252 1208 consensus_queue.cc:260] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.595384 1331 raft_consensus.cc:2243] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.596364 1201 tablet_bootstrap.cc:492] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.596576 1201 ts_tablet_manager.cc:1403] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260619 19:53:55.597242 1208 ts_tablet_manager.cc:1434] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:53:55.597760 1331 raft_consensus.cc:2272] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.597880 1201 raft_consensus.cc:359] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.598093 1201 raft_consensus.cc:385] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.598181 1201 raft_consensus.cc:740] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.598496 1201 consensus_queue.cc:260] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.601039 1208 tablet_bootstrap.cc:492] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.601404 1200 tablet_bootstrap.cc:492] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.602027 1201 ts_tablet_manager.cc:1434] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:53:55.601637 1200 ts_tablet_manager.cc:1403] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.000s
I20260619 19:53:55.602401 1201 tablet_bootstrap.cc:492] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.604468 1627 tablet_replica.cc:333] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:55.605782 1627 raft_consensus.cc:2243] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.605875 1201 tablet_bootstrap.cc:654] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.606081 1627 raft_consensus.cc:2272] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.606886 1331 ts_tablet_manager.cc:1916] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.608067 1627 ts_tablet_manager.cc:1916] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.605576 1208 tablet_bootstrap.cc:654] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.612686 1200 raft_consensus.cc:359] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.613981 1200 raft_consensus.cc:385] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.614193 1200 raft_consensus.cc:740] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.614473 1201 tablet_bootstrap.cc:492] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.614646 1201 ts_tablet_manager.cc:1403] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260619 19:53:55.614665 1200 consensus_queue.cc:260] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.615492 1200 ts_tablet_manager.cc:1434] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260619 19:53:55.615593 1201 raft_consensus.cc:359] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.615788 1201 raft_consensus.cc:385] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.615896 1201 raft_consensus.cc:740] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.616146 1201 consensus_queue.cc:260] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.616582 1627 ts_tablet_manager.cc:1929] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.618763 1201 ts_tablet_manager.cc:1434] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:55.619118 1201 tablet_bootstrap.cc:492] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.623087 1627 log.cc:1199] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/304e1eed89f54b809ac52efe2226dc35
I20260619 19:53:55.623710 1627 ts_tablet_manager.cc:1950] T 304e1eed89f54b809ac52efe2226dc35 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:55.625785 1208 tablet_bootstrap.cc:492] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.625968 1208 ts_tablet_manager.cc:1403] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260619 19:53:55.626137 1201 tablet_bootstrap.cc:654] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.626925 1514 raft_consensus.cc:493] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.627027 1200 tablet_bootstrap.cc:492] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.627081 1514 raft_consensus.cc:515] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.627748 1514 leader_election.cc:290] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.628661 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.630326 1514 raft_consensus.cc:493] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.630474 1514 raft_consensus.cc:515] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.631163 1514 leader_election.cc:290] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.631313 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fe0c67fe84e5b866fd2553ea26d91" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.631583 1059 raft_consensus.cc:2393] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:55.626758 1208 raft_consensus.cc:359] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.632452 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcaeebaaa93c479bafff14d312d526ec" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.632448 859 leader_election.cc:304] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.632508 1208 raft_consensus.cc:385] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.632598 1208 raft_consensus.cc:740] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.632661 1059 raft_consensus.cc:2468] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:55.632853 1626 raft_consensus.cc:493] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.632943 1621 raft_consensus.cc:3060] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.633014 1626 raft_consensus.cc:515] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.633718 1626 leader_election.cc:290] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.634279 1208 consensus_queue.cc:260] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.635264 1208 ts_tablet_manager.cc:1434] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260619 19:53:55.636329 1621 raft_consensus.cc:2749] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.637646 859 leader_election.cc:304] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:55.637853 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b08ab9ad59049919649b96890b6785d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.638077 1514 raft_consensus.cc:2804] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.638085 1059 raft_consensus.cc:2468] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:55.638186 1514 raft_consensus.cc:493] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.638276 1514 raft_consensus.cc:3060] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.639330 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b08ab9ad59049919649b96890b6785d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.639585 783 raft_consensus.cc:2468] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:55.639349 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcaeebaaa93c479bafff14d312d526ec" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.641319 1514 raft_consensus.cc:515] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.642236 1208 tablet_bootstrap.cc:492] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.642026 858 leader_election.cc:304] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
W20260619 19:53:55.642697 858 leader_election.cc:343] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.643183 1621 raft_consensus.cc:2804] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.643321 1621 raft_consensus.cc:493] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.643409 1621 raft_consensus.cc:3060] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.644606 1208 tablet_bootstrap.cc:654] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.646193 1621 raft_consensus.cc:515] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.646701 1200 tablet_bootstrap.cc:654] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.647660 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b08ab9ad59049919649b96890b6785d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.647924 1059 raft_consensus.cc:3060] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.648084 1514 leader_election.cc:290] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.648566 1621 leader_election.cc:290] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.651387 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcaeebaaa93c479bafff14d312d526ec" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:55.652158 858 leader_election.cc:343] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.652606 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b08ab9ad59049919649b96890b6785d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:55.652993 784 raft_consensus.cc:3060] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.656527 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcaeebaaa93c479bafff14d312d526ec" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.656853 1060 raft_consensus.cc:3060] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.663756 1060 raft_consensus.cc:2468] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:55.665513 784 raft_consensus.cc:2468] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:55.666440 1059 raft_consensus.cc:2468] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:55.667207 1331 ts_tablet_manager.cc:1929] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.667200 858 leader_election.cc:304] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.667255 859 leader_election.cc:304] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.667485 1331 log.cc:1199] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/c2c0afdcf96247b0a16c8f9ac71cc24a
I20260619 19:53:55.667869 1621 raft_consensus.cc:2804] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.667995 1331 ts_tablet_manager.cc:1950] T c2c0afdcf96247b0a16c8f9ac71cc24a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.668026 1621 raft_consensus.cc:697] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:55.668314 1621 consensus_queue.cc:237] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.668843 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 182) took 2617 ms. Trace:
I20260619 19:53:55.669062 1208 tablet_bootstrap.cc:492] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.668951 1331 rpcz_store.cc:276] 0619 19:53:53.051553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.052965 (+ 1412us) service_pool.cc:224] Handling call
0619 19:53:55.581144 (+2528179us) ts_tablet_manager.cc:1151] Deleting tablet c2c0afdcf96247b0a16c8f9ac71cc24a
0619 19:53:55.581159 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.631682 (+ 50523us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.635070 (+ 3388us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.668807 (+ 33737us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2527844}
I20260619 19:53:55.669198 1208 ts_tablet_manager.cc:1403] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.003s
I20260619 19:53:55.669358 1514 raft_consensus.cc:2804] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.669497 1514 raft_consensus.cc:697] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:55.669525 1331 tablet_replica.cc:333] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.669735 1331 raft_consensus.cc:2243] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.669732 1514 consensus_queue.cc:237] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.669888 1331 raft_consensus.cc:2272] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.670012 1208 raft_consensus.cc:359] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.670184 1208 raft_consensus.cc:385] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.670296 1208 raft_consensus.cc:740] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.670576 1208 consensus_queue.cc:260] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.675164 1632 raft_consensus.cc:493] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.675340 1632 raft_consensus.cc:515] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.675694 1331 ts_tablet_manager.cc:1916] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.676064 1632 leader_election.cc:290] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.677004 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4771739543f4b4189b7d603f76325f0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.677034 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4771739543f4b4189b7d603f76325f0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.677268 919 raft_consensus.cc:2468] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.677294 1060 raft_consensus.cc:2468] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.677752 719 leader_election.cc:304] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:55.677831 1208 ts_tablet_manager.cc:1434] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260619 19:53:55.678051 1632 raft_consensus.cc:2804] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.678165 1632 raft_consensus.cc:493] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.678267 1632 raft_consensus.cc:3060] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.679716 1208 tablet_bootstrap.cc:492] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.681061 1200 tablet_bootstrap.cc:492] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.681217 1200 ts_tablet_manager.cc:1403] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260619 19:53:55.682014 1200 raft_consensus.cc:359] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.682192 1200 raft_consensus.cc:385] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:53:55.683924 996 consensus_peers.cc:597] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 131ccb73ea1f4a7b8781c093ea2995d1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:55.684355 1200 raft_consensus.cc:740] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.684978 1200 consensus_queue.cc:260] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.689304 1331 ts_tablet_manager.cc:1929] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.681711 1632 raft_consensus.cc:515] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.692293 1632 leader_election.cc:290] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.692837 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4771739543f4b4189b7d603f76325f0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.693094 919 raft_consensus.cc:3060] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.693768 1201 tablet_bootstrap.cc:492] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.693964 1201 ts_tablet_manager.cc:1403] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.075s user 0.009s sys 0.013s
I20260619 19:53:55.694943 1201 raft_consensus.cc:359] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.695179 1201 raft_consensus.cc:385] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.695277 1201 raft_consensus.cc:740] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.696080 919 raft_consensus.cc:2468] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.696630 719 leader_election.cc:304] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.697052 1632 raft_consensus.cc:2804] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.691478 1200 ts_tablet_manager.cc:1434] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:53:55.692822 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4771739543f4b4189b7d603f76325f0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.697391 1060 raft_consensus.cc:3060] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.697679 1632 raft_consensus.cc:697] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:55.698065 1208 tablet_bootstrap.cc:654] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.697989 1632 consensus_queue.cc:237] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.700692 1200 tablet_bootstrap.cc:492] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.700647 1060 raft_consensus.cc:2468] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.702898 1200 tablet_bootstrap.cc:654] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.704219 1331 log.cc:1199] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/906212dd25ef46f2b381ce6a99c39343
I20260619 19:53:55.705142 1331 ts_tablet_manager.cc:1950] T 906212dd25ef46f2b381ce6a99c39343 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.709089 1201 consensus_queue.cc:260] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.709744 1201 ts_tablet_manager.cc:1434] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.016s user 0.000s sys 0.003s
I20260619 19:53:55.713316 1201 tablet_bootstrap.cc:492] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.714290 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 183) took 2629 ms. Trace:
I20260619 19:53:55.714704 1208 tablet_bootstrap.cc:492] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.714939 1208 ts_tablet_manager.cc:1403] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.004s
I20260619 19:53:55.715016 1201 tablet_bootstrap.cc:654] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.715806 1208 raft_consensus.cc:359] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.716073 1208 raft_consensus.cc:385] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.716177 1208 raft_consensus.cc:740] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.716504 1208 consensus_queue.cc:260] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.717063 1208 ts_tablet_manager.cc:1434] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:55.718642 1208 tablet_bootstrap.cc:492] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.719197 1331 rpcz_store.cc:276] 0619 19:53:53.084610 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.084671 (+ 61us) service_pool.cc:224] Handling call
0619 19:53:55.669467 (+2584796us) ts_tablet_manager.cc:1151] Deleting tablet 906212dd25ef46f2b381ce6a99c39343
0619 19:53:55.669474 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.685872 (+ 16398us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.689227 (+ 3355us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.714233 (+ 25006us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2581597}
I20260619 19:53:55.720012 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 184) took 2621 ms. Trace:
I20260619 19:53:55.720165 1331 rpcz_store.cc:276] 0619 19:53:53.098580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.098644 (+ 64us) service_pool.cc:224] Handling call
0619 19:53:55.719827 (+2621183us) ts_tablet_manager.cc:1151] Deleting tablet aafe2a956b844c9998c84bbe52070e5d
0619 19:53:55.719838 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.719961 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2620918}
I20260619 19:53:55.720407 1208 tablet_bootstrap.cc:654] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.720867 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 187) took 2366 ms. Trace:
I20260619 19:53:55.721016 1331 rpcz_store.cc:276] 0619 19:53:53.354045 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.354101 (+ 56us) service_pool.cc:224] Handling call
0619 19:53:55.720712 (+2366611us) ts_tablet_manager.cc:1151] Deleting tablet 184d655694434b0bbfa178fcd3110405
0619 19:53:55.720723 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.720815 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2366352}
I20260619 19:53:55.722167 1200 tablet_bootstrap.cc:492] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.722388 1200 ts_tablet_manager.cc:1403] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260619 19:53:55.723750 1200 raft_consensus.cc:359] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.724030 1200 raft_consensus.cc:385] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.724138 1200 raft_consensus.cc:740] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.724423 1200 consensus_queue.cc:260] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.733374 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 188) took 2374 ms. Trace:
I20260619 19:53:55.733711 1331 rpcz_store.cc:276] 0619 19:53:53.358834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.358889 (+ 55us) service_pool.cc:224] Handling call
0619 19:53:55.733122 (+2374233us) ts_tablet_manager.cc:1151] Deleting tablet 2d64ccbb2f2840f4ac51cf8556da4a2c
0619 19:53:55.733134 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.733278 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2373977}
I20260619 19:53:55.733605 1200 ts_tablet_manager.cc:1434] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260619 19:53:55.742729 1200 tablet_bootstrap.cc:492] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.744976 1200 tablet_bootstrap.cc:654] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.752343 1208 tablet_bootstrap.cc:492] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.752601 1208 ts_tablet_manager.cc:1403] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.000s
I20260619 19:53:55.753428 1208 raft_consensus.cc:359] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.753710 1208 raft_consensus.cc:385] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.753834 1208 raft_consensus.cc:740] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.754130 1208 consensus_queue.cc:260] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.757654 1208 ts_tablet_manager.cc:1434] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:53:55.758039 1208 tablet_bootstrap.cc:492] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.745324 1331 tablet_replica.cc:333] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.759680 1331 raft_consensus.cc:2243] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.759896 1331 raft_consensus.cc:2272] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.760470 1331 ts_tablet_manager.cc:1916] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.764813 1208 tablet_bootstrap.cc:654] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.769534 1331 ts_tablet_manager.cc:1929] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.769685 1331 log.cc:1199] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:53:55.770066 1331 ts_tablet_manager.cc:1950] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.770872 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 189) took 2410 ms. Trace:
I20260619 19:53:55.773775 1201 tablet_bootstrap.cc:492] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.773936 1201 ts_tablet_manager.cc:1403] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.061s user 0.018s sys 0.026s
I20260619 19:53:55.774724 1200 tablet_bootstrap.cc:492] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.774709 1201 raft_consensus.cc:359] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.774896 1201 raft_consensus.cc:385] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.774979 1201 raft_consensus.cc:740] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.775113 1200 ts_tablet_manager.cc:1403] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.004s
I20260619 19:53:55.775305 1201 consensus_queue.cc:260] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.776046 1201 ts_tablet_manager.cc:1434] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:55.776108 1200 raft_consensus.cc:359] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.776394 1200 raft_consensus.cc:385] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.776506 1200 raft_consensus.cc:740] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.776803 1200 consensus_queue.cc:260] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.777047 1201 tablet_bootstrap.cc:492] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.777386 1200 ts_tablet_manager.cc:1434] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:53:55.779065 1201 tablet_bootstrap.cc:654] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.779698 1200 tablet_bootstrap.cc:492] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.780506 1208 tablet_bootstrap.cc:492] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.780730 1208 ts_tablet_manager.cc:1403] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260619 19:53:55.782173 1208 raft_consensus.cc:359] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.782485 1208 raft_consensus.cc:385] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.782646 1208 raft_consensus.cc:740] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.782989 1208 consensus_queue.cc:260] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.783401 1632 raft_consensus.cc:493] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.783630 1632 raft_consensus.cc:515] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.784299 1632 leader_election.cc:290] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:55.785145 720 leader_election.cc:343] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 906212dd25ef46f2b381ce6a99c39343
I20260619 19:53:55.787355 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906212dd25ef46f2b381ce6a99c39343" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:55.788036 719 leader_election.cc:343] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.788166 719 leader_election.cc:304] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.788781 1632 raft_consensus.cc:2749] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.790258 1208 ts_tablet_manager.cc:1434] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
W20260619 19:53:55.796813 422 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-task38CK2r/build/asan/bin/kudu pid 569: Timed out: CheckLeaks RPC to 127.0.105.188:44433 timed out after 1.000s (SENT)
I20260619 19:53:55.797032 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task38CK2r/build/asan/bin/kudu with pid 569
I20260619 19:53:55.771006 1331 rpcz_store.cc:276] 0619 19:53:53.360194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.360258 (+ 64us) service_pool.cc:224] Handling call
0619 19:53:55.745232 (+2384974us) ts_tablet_manager.cc:1151] Deleting tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60
0619 19:53:55.745244 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.766261 (+ 21017us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.769440 (+ 3179us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.770830 (+ 1390us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2384721}
I20260619 19:53:55.797972 1200 tablet_bootstrap.cc:654] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.798521 1208 tablet_bootstrap.cc:492] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.802295 1201 tablet_bootstrap.cc:492] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.798156 1331 tablet_replica.cc:333] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.802488 1201 ts_tablet_manager.cc:1403] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260619 19:53:55.802717 1331 raft_consensus.cc:2243] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.803083 1331 raft_consensus.cc:2272] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.803432 1201 raft_consensus.cc:359] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.803676 1201 raft_consensus.cc:385] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.803786 1201 raft_consensus.cc:740] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.804073 1201 consensus_queue.cc:260] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.804977 1331 ts_tablet_manager.cc:1916] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.805743 1208 tablet_bootstrap.cc:654] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.806275 1201 ts_tablet_manager.cc:1434] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 19:53:55.809785 1201 tablet_bootstrap.cc:492] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.811642 1201 tablet_bootstrap.cc:654] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.819283 1331 ts_tablet_manager.cc:1929] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.823125 1331 log.cc:1199] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/732a2e073e3442ff873ca00be6106744
I20260619 19:53:55.823356 1200 tablet_bootstrap.cc:492] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.823588 1200 ts_tablet_manager.cc:1403] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.005s
I20260619 19:53:55.823726 1331 ts_tablet_manager.cc:1950] T 732a2e073e3442ff873ca00be6106744 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.824401 1201 tablet_bootstrap.cc:492] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.824404 1200 raft_consensus.cc:359] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.824553 1201 ts_tablet_manager.cc:1403] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260619 19:53:55.824596 1200 raft_consensus.cc:385] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.824654 1200 raft_consensus.cc:740] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.824867 1200 consensus_queue.cc:260] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.825402 1201 raft_consensus.cc:359] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.825572 1201 raft_consensus.cc:385] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.826131 1201 raft_consensus.cc:740] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.826372 1201 consensus_queue.cc:260] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.826897 1201 ts_tablet_manager.cc:1434] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:55.827229 1201 tablet_bootstrap.cc:492] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.829119 1201 tablet_bootstrap.cc:654] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.829732 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 191) took 2386 ms. Trace:
I20260619 19:53:55.839177 1200 ts_tablet_manager.cc:1434] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260619 19:53:55.839586 1331 rpcz_store.cc:276] 0619 19:53:53.443537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.443594 (+ 57us) service_pool.cc:224] Handling call
0619 19:53:55.798084 (+2354490us) ts_tablet_manager.cc:1151] Deleting tablet 732a2e073e3442ff873ca00be6106744
0619 19:53:55.798095 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.812816 (+ 14721us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.819192 (+ 6376us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.829669 (+ 10477us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2354176}
I20260619 19:53:55.840332 1208 tablet_bootstrap.cc:492] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.840557 1208 ts_tablet_manager.cc:1403] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.003s
I20260619 19:53:55.841463 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 193) took 2370 ms. Trace:
I20260619 19:53:55.841457 1208 raft_consensus.cc:359] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.841775 1208 raft_consensus.cc:385] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.841917 1208 raft_consensus.cc:740] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.842252 1208 consensus_queue.cc:260] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.841565 1331 rpcz_store.cc:276] 0619 19:53:53.470886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.470946 (+ 60us) service_pool.cc:224] Handling call
0619 19:53:55.840334 (+2369388us) ts_tablet_manager.cc:1151] Deleting tablet 550297c4d14f4d679d11fded97b671ae
0619 19:53:55.841295 (+ 961us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.841410 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2368958}
I20260619 19:53:55.843344 1331 tablet_replica.cc:333] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.843555 1331 raft_consensus.cc:2243] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.843743 1331 raft_consensus.cc:2272] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.844319 1331 ts_tablet_manager.cc:1916] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.846011 1208 ts_tablet_manager.cc:1434] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:53:55.846390 1208 tablet_bootstrap.cc:492] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.849869 1632 raft_consensus.cc:493] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.850070 1632 raft_consensus.cc:515] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.850761 1632 leader_election.cc:290] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.851418 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c379d780b294b9a863576f53f79ee7b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.851641 1060 raft_consensus.cc:2468] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.851601 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c379d780b294b9a863576f53f79ee7b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.851835 919 raft_consensus.cc:2468] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.852247 720 leader_election.cc:304] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:55.852883 1632 raft_consensus.cc:2804] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.852979 1632 raft_consensus.cc:493] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.853083 1632 raft_consensus.cc:3060] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.853235 1200 tablet_bootstrap.cc:492] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.853443 1201 tablet_bootstrap.cc:492] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.853591 1201 ts_tablet_manager.cc:1403] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20260619 19:53:55.854373 1201 raft_consensus.cc:359] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.854574 1201 raft_consensus.cc:385] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.854635 1201 raft_consensus.cc:740] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.854857 1201 consensus_queue.cc:260] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.855124 1200 tablet_bootstrap.cc:654] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.855392 1201 ts_tablet_manager.cc:1434] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:55.855691 1201 tablet_bootstrap.cc:492] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.857204 1632 raft_consensus.cc:515] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.857560 1201 tablet_bootstrap.cc:654] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.859165 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c379d780b294b9a863576f53f79ee7b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:55.859386 1060 raft_consensus.cc:3060] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.860472 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c379d780b294b9a863576f53f79ee7b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.860664 919 raft_consensus.cc:3060] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.862397 1060 raft_consensus.cc:2468] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.863075 720 leader_election.cc:304] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:55.863425 1659 raft_consensus.cc:2804] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.863576 1659 raft_consensus.cc:697] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:55.863826 1659 consensus_queue.cc:237] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.865193 919 raft_consensus.cc:2468] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.866994 1632 leader_election.cc:290] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.871059 1632 raft_consensus.cc:493] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.871982 1628 raft_consensus.cc:493] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.872148 1628 raft_consensus.cc:515] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.873127 1628 leader_election.cc:290] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.875619 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108f1b2e9ec74271889ffff65d8e852e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.875876 784 raft_consensus.cc:2468] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:55.875939 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108f1b2e9ec74271889ffff65d8e852e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.876192 919 raft_consensus.cc:2468] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:55.876546 996 leader_election.cc:304] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:55.871407 1632 raft_consensus.cc:515] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.877151 1628 raft_consensus.cc:2804] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.877278 1628 raft_consensus.cc:493] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.877364 1628 raft_consensus.cc:3060] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:55.878683 516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.105.188:44433 timed out after 0.551s (SENT) [suppressed 4 similar messages]
I20260619 19:53:55.879427 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f7be0f6e9f4fc6ba7bde011a9bbf60" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.879709 919 raft_consensus.cc:2468] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:55.880256 719 leader_election.cc:304] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.880476 1628 raft_consensus.cc:515] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.880609 1567 raft_consensus.cc:2804] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.880791 1567 raft_consensus.cc:493] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.880900 1567 raft_consensus.cc:3060] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.882805 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108f1b2e9ec74271889ffff65d8e852e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:55.883019 784 raft_consensus.cc:3060] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.885728 784 raft_consensus.cc:2468] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:55.885946 1567 raft_consensus.cc:515] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.886324 996 leader_election.cc:304] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:55.886636 1695 raft_consensus.cc:2804] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.886763 1695 raft_consensus.cc:697] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:55.887053 1695 consensus_queue.cc:237] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.887449 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f7be0f6e9f4fc6ba7bde011a9bbf60" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.887697 918 raft_consensus.cc:3060] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.889444 1628 leader_election.cc:290] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.891227 1567 leader_election.cc:290] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.891309 1628 raft_consensus.cc:493] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.891448 1628 raft_consensus.cc:515] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.892158 918 raft_consensus.cc:2468] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:55.892551 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.893060 1200 tablet_bootstrap.cc:492] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.893162 719 leader_election.cc:304] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:55.893262 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108f1b2e9ec74271889ffff65d8e852e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:55.893399 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.893462 919 raft_consensus.cc:3060] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:55.893175 996 leader_election.cc:343] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.893929 1200 ts_tablet_manager.cc:1403] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
W20260619 19:53:55.894001 996 leader_election.cc:343] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:55.894335 996 leader_election.cc:304] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:55.894655 1684 raft_consensus.cc:2749] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.894137 1628 leader_election.cc:290] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.896262 1200 raft_consensus.cc:359] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.896442 919 raft_consensus.cc:2468] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:53:55.897661 720 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:53:55.897660 1567 raft_consensus.cc:2804] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.898307 1567 raft_consensus.cc:697] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:55.898343 1201 tablet_bootstrap.cc:492] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.898478 1201 ts_tablet_manager.cc:1403] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.008s
I20260619 19:53:55.898717 1567 consensus_queue.cc:237] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.899726 1201 raft_consensus.cc:359] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.899914 1201 raft_consensus.cc:385] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.899998 1201 raft_consensus.cc:740] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.899964 1200 raft_consensus.cc:385] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.900112 1200 raft_consensus.cc:740] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.900211 1201 consensus_queue.cc:260] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.900761 1201 ts_tablet_manager.cc:1434] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:55.900844 1632 leader_election.cc:290] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:55.901117 1201 tablet_bootstrap.cc:492] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.901211 1200 consensus_queue.cc:260] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:55.902328 1200 ts_tablet_manager.cc:1434] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
W20260619 19:53:55.904695 720 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:53:55.905658 1201 tablet_bootstrap.cc:654] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.901701 1331 ts_tablet_manager.cc:1929] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:55.906912 1331 log.cc:1199] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/91e43148bb5b47128e08ed7faf8c7c1f
I20260619 19:53:55.907616 1331 ts_tablet_manager.cc:1950] T 91e43148bb5b47128e08ed7faf8c7c1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.909288 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 190) took 2466 ms. Trace:
I20260619 19:53:55.913741 1331 rpcz_store.cc:276] 0619 19:53:53.443329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:53.480743 (+ 37414us) service_pool.cc:224] Handling call
0619 19:53:55.843256 (+2362513us) ts_tablet_manager.cc:1151] Deleting tablet 91e43148bb5b47128e08ed7faf8c7c1f
0619 19:53:55.843266 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.870660 (+ 27394us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.900789 (+ 30129us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.909248 (+ 8459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2354057}
I20260619 19:53:55.915891 1208 tablet_bootstrap.cc:654] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.916530 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 220) took 2052 ms. Trace:
I20260619 19:53:55.917248 1331 rpcz_store.cc:276] 0619 19:53:53.864425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.128397 (+263972us) service_pool.cc:224] Handling call
0619 19:53:55.916327 (+1787930us) ts_tablet_manager.cc:1151] Deleting tablet 12258d3bcc714f34857d7362c49ee787
0619 19:53:55.916342 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.916497 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1703006}
I20260619 19:53:55.908155 1200 tablet_bootstrap.cc:492] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.920562 1200 tablet_bootstrap.cc:654] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.921100 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 221) took 2042 ms. Trace:
I20260619 19:53:55.923106 1331 rpcz_store.cc:276] 0619 19:53:53.881049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.213346 (+332297us) service_pool.cc:224] Handling call
0619 19:53:55.920844 (+1707498us) ts_tablet_manager.cc:1151] Deleting tablet fbc952b283d94035be1f86f3b90382b6
0619 19:53:55.920856 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.921046 (+ 190us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1707294}
W20260619 19:53:55.924048 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.188:44433, user_credentials={real_user=slave}} blocked reactor thread for 45349.6us
I20260619 19:53:55.924865 1201 tablet_bootstrap.cc:492] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.925081 1201 ts_tablet_manager.cc:1403] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260619 19:53:55.925228 1208 tablet_bootstrap.cc:492] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:55.925565 1208 ts_tablet_manager.cc:1403] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
W20260619 19:53:55.925856 1274 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.105.188:44433 timed out after 0.694s (SENT)
I20260619 19:53:55.925997 1201 raft_consensus.cc:359] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.926218 1201 raft_consensus.cc:385] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.926301 1201 raft_consensus.cc:740] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.927769 1331 tablet_replica.cc:333] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.928232 1331 raft_consensus.cc:2243] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:55.929098 1331 raft_consensus.cc:2272] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.926924 1201 consensus_queue.cc:260] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.930404 1201 ts_tablet_manager.cc:1434] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:55.930851 1201 tablet_bootstrap.cc:492] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.933336 1201 tablet_bootstrap.cc:654] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.935794 1331 ts_tablet_manager.cc:1916] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.938771 1208 raft_consensus.cc:359] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.947841 1621 raft_consensus.cc:493] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.948150 1621 raft_consensus.cc:515] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.949144 1621 leader_election.cc:290] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:55.950276 859 leader_election.cc:343] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 906212dd25ef46f2b381ce6a99c39343
I20260619 19:53:55.948689 1659 raft_consensus.cc:493] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.950194 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906212dd25ef46f2b381ce6a99c39343" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:55.950709 784 raft_consensus.cc:2468] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:55.951305 1659 raft_consensus.cc:515] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.951396 858 leader_election.cc:304] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.952131 1621 raft_consensus.cc:2804] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:55.952289 1621 raft_consensus.cc:493] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:55.952454 1621 raft_consensus.cc:3060] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:55.953862 720 leader_election.cc:343] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 91e43148bb5b47128e08ed7faf8c7c1f
I20260619 19:53:55.954864 1331 ts_tablet_manager.cc:1929] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:55.955159 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e43148bb5b47128e08ed7faf8c7c1f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:55.955523 1331 log.cc:1199] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/2d37d6f54a96471fad26a342cab984ef
I20260619 19:53:55.955802 719 leader_election.cc:304] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.956207 1567 raft_consensus.cc:2749] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:55.956458 1659 leader_election.cc:290] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:55.956848 1208 raft_consensus.cc:385] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.956979 1331 ts_tablet_manager.cc:1950] T 2d37d6f54a96471fad26a342cab984ef P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:55.960363 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 222) took 2075 ms. Trace:
I20260619 19:53:55.961685 1208 raft_consensus.cc:740] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.962211 1200 tablet_bootstrap.cc:492] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:55.962450 1200 ts_tablet_manager.cc:1403] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.005s
I20260619 19:53:55.962898 1621 raft_consensus.cc:515] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.963347 1200 raft_consensus.cc:359] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.963598 1200 raft_consensus.cc:385] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.963699 1200 raft_consensus.cc:740] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.964252 1200 consensus_queue.cc:260] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:55.964676 859 leader_election.cc:343] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 906212dd25ef46f2b381ce6a99c39343
I20260619 19:53:55.964748 1208 consensus_queue.cc:260] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.965328 1208 ts_tablet_manager.cc:1434] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.040s user 0.001s sys 0.001s
I20260619 19:53:55.966068 1621 leader_election.cc:290] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:55.965134 1200 ts_tablet_manager.cc:1434] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:53:55.967555 1200 tablet_bootstrap.cc:492] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:55.967530 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906212dd25ef46f2b381ce6a99c39343" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:55.973176 784 raft_consensus.cc:3060] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:55.961381 1331 rpcz_store.cc:276] 0619 19:53:53.884972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.213575 (+328603us) service_pool.cc:224] Handling call
0619 19:53:55.927632 (+1714057us) ts_tablet_manager.cc:1151] Deleting tablet 2d37d6f54a96471fad26a342cab984ef
0619 19:53:55.927649 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:55.946427 (+ 18778us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.949490 (+ 3063us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:55.960310 (+ 10820us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1713383}
I20260619 19:53:55.975755 1331 tablet_replica.cc:333] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:55.977124 784 raft_consensus.cc:2468] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:55.977895 858 leader_election.cc:304] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:55.978253 1201 tablet_bootstrap.cc:492] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:55.978410 1621 raft_consensus.cc:2804] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:55.978602 1621 raft_consensus.cc:697] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:55.978780 1331 raft_consensus.cc:2243] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:55.978889 1621 consensus_queue.cc:237] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.979341 1331 raft_consensus.cc:2272] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:55.979399 1201 ts_tablet_manager.cc:1403] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.015s
I20260619 19:53:55.980269 1201 raft_consensus.cc:359] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.980495 1201 raft_consensus.cc:385] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:55.980597 1201 raft_consensus.cc:740] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:55.980830 1201 consensus_queue.cc:260] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.981415 1201 ts_tablet_manager.cc:1434] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:55.981738 1201 tablet_bootstrap.cc:492] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:55.983521 1200 tablet_bootstrap.cc:654] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.984560 1201 tablet_bootstrap.cc:654] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.988690 1208 tablet_bootstrap.cc:492] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:55.987731 1331 ts_tablet_manager.cc:1916] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:55.992071 1208 tablet_bootstrap.cc:654] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:55.997490 1621 raft_consensus.cc:493] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:55.997848 1621 raft_consensus.cc:515] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:55.999221 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:55.999462 1060 raft_consensus.cc:2468] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.000123 859 leader_election.cc:304] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.000460 1514 raft_consensus.cc:2804] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.000581 1514 raft_consensus.cc:493] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.000676 1514 raft_consensus.cc:3060] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.003701 1514 raft_consensus.cc:515] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.004766 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:56.005447 858 leader_election.cc:343] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.005729 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.005923 1060 raft_consensus.cc:3060] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.009066 1060 raft_consensus.cc:2468] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.009989 859 leader_election.cc:304] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.010351 1652 raft_consensus.cc:2804] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.010582 1652 raft_consensus.cc:697] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.010970 1200 tablet_bootstrap.cc:492] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.011029 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.010974 1652 consensus_queue.cc:237] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.011150 1200 ts_tablet_manager.cc:1403] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
W20260619 19:53:56.011668 858 leader_election.cc:343] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.011842 1514 leader_election.cc:290] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.012039 1200 raft_consensus.cc:359] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.012228 1200 raft_consensus.cc:385] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.012310 1200 raft_consensus.cc:740] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.012655 1200 consensus_queue.cc:260] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.013375 1621 leader_election.cc:290] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.016037 1362 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 3 FOLLOWER]: Refusing update from remote peer 6cc90ee2d59d4dddae6790dd92b20cb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 379. Preceding OpId from leader: term: 3 index: 381. (index mismatch)
I20260619 19:53:56.017519 1200 ts_tablet_manager.cc:1434] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260619 19:53:56.017894 1694 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 381, Last known committed idx: 370, Time since last communication: 0.000s
I20260619 19:53:56.018366 1621 consensus_queue.cc:1048] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.020056 1200 tablet_bootstrap.cc:492] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.024856 1200 tablet_bootstrap.cc:654] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.027326 1208 tablet_bootstrap.cc:492] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.027521 1208 ts_tablet_manager.cc:1403] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.002s
W20260619 19:53:56.030463 1117 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.031634 1117 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.105.188:44433)
W20260619 19:53:56.031617 718 connection.cc:573] server connection from 127.0.0.1:49744 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.032078 1117 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.188:44433)
W20260619 19:53:56.032428 1117 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.188:44433)
I20260619 19:53:56.032593 1208 raft_consensus.cc:359] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.032788 1208 raft_consensus.cc:385] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.032871 1208 raft_consensus.cc:740] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:53:56.033380 1117 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.105.188:44433)
I20260619 19:53:56.036165 1208 consensus_queue.cc:260] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:56.037102 994 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.037542 856 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.037948 516 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.038127 516 leader_election.cc:336] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.038426 517 connection.cc:573] server connection from 127.0.0.1:37014 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.038715 717 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.039074 857 connection.cc:573] server connection from 127.0.0.1:32994 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.043589 1274 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:53:56.044085 1274 leader_election.cc:336] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 19:53:56.044270 1274 leader_election.cc:304] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff; no voters: 2d38b77ff37948e19592b36b6d884fe0, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:53:56.058578 1695 raft_consensus.cc:493] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.059331 1695 raft_consensus.cc:515] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.060256 1331 ts_tablet_manager.cc:1929] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.060429 1331 log.cc:1199] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:53:56.060782 1695 leader_election.cc:290] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.060930 1331 ts_tablet_manager.cc:1950] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.062335 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 223) took 2063 ms. Trace:
I20260619 19:53:56.062564 1331 rpcz_store.cc:276] 0619 19:53:53.998474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.214298 (+215824us) service_pool.cc:224] Handling call
0619 19:53:55.975501 (+1761203us) ts_tablet_manager.cc:1151] Deleting tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc
0619 19:53:55.975521 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.001973 (+ 26452us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.060110 (+ 58137us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.062280 (+ 2170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761013}
I20260619 19:53:56.064599 1331 tablet_replica.cc:333] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.065469 1331 raft_consensus.cc:2243] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:53:56.070003 1754 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 19:53:56.039802 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:44433 (local address 127.0.105.129:53785)
0619 19:53:56.069301 (+ 29499us) negotiation.cc:107] Waiting for socket to connect
0619 19:53:56.069731 (+ 430us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":29340,"threads_started":1}
W20260619 19:53:56.071834 1753 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 19:53:56.038939 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:44433 (local address 127.0.105.130:42471)
0619 19:53:56.070517 (+ 31578us) negotiation.cc:107] Waiting for socket to connect
0619 19:53:56.070702 (+ 185us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":31456,"threads_started":1}
W20260619 19:53:56.073258 1755 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 19:53:56.040613 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:44433 (local address 127.0.0.1:38886)
0619 19:53:56.072393 (+ 31780us) negotiation.cc:107] Waiting for socket to connect
0619 19:53:56.072484 (+ 91us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":31662,"threads_started":1}
I20260619 19:53:56.074378 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32665a93ee5b4f8290c79e2a1d4b1db1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.075038 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32665a93ee5b4f8290c79e2a1d4b1db1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.076464 1201 tablet_bootstrap.cc:492] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.076692 1201 ts_tablet_manager.cc:1403] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.095s user 0.010s sys 0.030s
W20260619 19:53:56.068863 1752 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 19:53:56.038207 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:44433 (local address 127.0.105.131:51421)
0619 19:53:56.068427 (+ 30220us) negotiation.cc:107] Waiting for socket to connect
0619 19:53:56.068537 (+ 110us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":30088,"threads_started":1}
I20260619 19:53:56.069842 1200 tablet_bootstrap.cc:492] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
W20260619 19:53:56.070242 994 connection.cc:769] server connection from 127.0.0.1:55584 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260619 19:53:56.075031 996 leader_election.cc:343] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.075623 1331 raft_consensus.cc:2272] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.078725 1626 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.077829 1201 raft_consensus.cc:359] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:56.078464 996 leader_election.cc:343] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.078868 1626 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.079064 996 leader_election.cc:304] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.078871 1201 raft_consensus.cc:385] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.079245 1201 raft_consensus.cc:740] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.079493 1695 raft_consensus.cc:2749] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:56.079485 1201 consensus_queue.cc:260] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.079639 1626 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:56.078570 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 223) could send its response
I20260619 19:53:56.080120 1201 ts_tablet_manager.cc:1434] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:53:56.077368 1200 ts_tablet_manager.cc:1403] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.001s
I20260619 19:53:56.080407 1201 tablet_bootstrap.cc:492] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.080870 1208 ts_tablet_manager.cc:1434] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.051s user 0.003s sys 0.000s
I20260619 19:53:56.081049 1200 raft_consensus.cc:359] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.081193 1208 tablet_bootstrap.cc:492] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.081411 1200 raft_consensus.cc:385] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.081547 1200 raft_consensus.cc:740] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.083250 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.083489 784 raft_consensus.cc:2468] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.083961 858 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:56.084285 1621 raft_consensus.cc:2804] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.081794 1200 consensus_queue.cc:260] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.084383 1621 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.084503 1621 raft_consensus.cc:3060] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.084548 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.084759 1060 raft_consensus.cc:2468] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.084811 1628 raft_consensus.cc:493] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.084951 1628 raft_consensus.cc:515] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.085485 1628 leader_election.cc:290] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.087505 1626 raft_consensus.cc:493] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.087709 1626 raft_consensus.cc:515] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.088500 1626 leader_election.cc:290] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.088587 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bae5be1340f4158a0b243415e232ae5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:56.089403 996 leader_election.cc:343] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.090272 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4132f28c434492cbddc8da7d8075c43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.090397 1200 ts_tablet_manager.cc:1434] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260619 19:53:56.090477 1060 raft_consensus.cc:2468] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.090771 1200 tablet_bootstrap.cc:492] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.092139 1621 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.092839 1200 tablet_bootstrap.cc:654] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:56.092796 516 leader_election.cc:336] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection reset by peer (error 104)
I20260619 19:53:56.093139 859 leader_election.cc:304] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.093487 1621 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.093523 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.093717 1621 raft_consensus.cc:2804] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.093715 1060 raft_consensus.cc:3060] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.093855 1621 raft_consensus.cc:493] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.093979 1621 raft_consensus.cc:3060] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.094167 1331 ts_tablet_manager.cc:1916] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.095745 1201 tablet_bootstrap.cc:654] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.096593 1060 raft_consensus.cc:2468] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:53:56.097244 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.098426 859 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.098771 1626 raft_consensus.cc:2804] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.098893 1626 raft_consensus.cc:697] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.099174 1626 consensus_queue.cc:237] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:56.100195 1751 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 19:53:56.035803 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.188:44433 (local address 127.0.0.1:38884)
0619 19:53:56.036929 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0619 19:53:56.036948 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0619 19:53:56.037072 (+ 124us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0619 19:53:56.071076 (+ 34004us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":967,"thread_start_us":841,"threads_started":1}
I20260619 19:53:56.101596 1621 raft_consensus.cc:515] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.104254 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4132f28c434492cbddc8da7d8075c43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.104547 1060 raft_consensus.cc:3060] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.104764 1201 tablet_bootstrap.cc:492] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.104966 1201 ts_tablet_manager.cc:1403] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260619 19:53:56.105088 1621 leader_election.cc:290] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.107923 1060 raft_consensus.cc:2468] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.108428 859 leader_election.cc:304] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.108820 1621 raft_consensus.cc:2804] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.109107 1621 raft_consensus.cc:697] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.089639 1208 tablet_bootstrap.cc:654] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.109565 1621 consensus_queue.cc:237] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.095027 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.110720 783 raft_consensus.cc:3060] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.111644 1201 raft_consensus.cc:359] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.111840 1201 raft_consensus.cc:385] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.111953 1201 raft_consensus.cc:740] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.104486 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4132f28c434492cbddc8da7d8075c43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.108566 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bae5be1340f4158a0b243415e232ae5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:56.115171 858 leader_election.cc:343] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.116029 785 raft_consensus.cc:2468] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:56.116335 783 raft_consensus.cc:2468] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.116519 996 leader_election.cc:304] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:53:56.092463 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4132f28c434492cbddc8da7d8075c43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.117162 1695 raft_consensus.cc:2804] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.117343 1695 raft_consensus.cc:493] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260619 19:53:56.117400 858 leader_election.cc:343] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.117486 1695 raft_consensus.cc:3060] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.119380 1201 consensus_queue.cc:260] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.120582 1695 raft_consensus.cc:515] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.121152 1201 ts_tablet_manager.cc:1434] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260619 19:53:56.121534 1201 tablet_bootstrap.cc:492] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.121745 1695 leader_election.cc:290] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.122671 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bae5be1340f4158a0b243415e232ae5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.122942 784 raft_consensus.cc:3060] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:56.125749 1274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.188:44433, user_credentials={real_user=slave}} blocked reactor thread for 81766.3us
I20260619 19:53:56.128175 784 raft_consensus.cc:2468] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.128923 996 leader_election.cc:304] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.129511 1695 raft_consensus.cc:2804] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.130026 1695 raft_consensus.cc:697] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:56.130369 1695 consensus_queue.cc:237] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:56.132726 859 consensus_peers.cc:597] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d29506dab4c84850ad79b8b7a0340987. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.133191 1201 tablet_bootstrap.cc:654] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.134195 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bae5be1340f4158a0b243415e232ae5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:56.134470 919 raft_consensus.cc:3060] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.136632 1208 tablet_bootstrap.cc:492] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.136873 1208 ts_tablet_manager.cc:1403] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.006s
I20260619 19:53:56.137531 919 raft_consensus.cc:2468] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.137714 1208 raft_consensus.cc:359] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.137934 1208 raft_consensus.cc:385] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.138010 1208 raft_consensus.cc:740] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.138252 1208 consensus_queue.cc:260] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.144304 1208 ts_tablet_manager.cc:1434] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260619 19:53:56.144734 1208 tablet_bootstrap.cc:492] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.146620 1208 tablet_bootstrap.cc:654] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.151758 1747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc90ee2d59d4dddae6790dd92b20cb5. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:56.152148 1747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:56.154685 1756 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:53:56.158383 1695 raft_consensus.cc:493] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.158809 1695 raft_consensus.cc:515] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.161283 1695 leader_election.cc:290] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.162027 1201 tablet_bootstrap.cc:492] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.162201 1201 ts_tablet_manager.cc:1403] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260619 19:53:56.162984 1201 raft_consensus.cc:359] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.163192 1201 raft_consensus.cc:385] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.163262 1201 raft_consensus.cc:740] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.165164 1200 tablet_bootstrap.cc:492] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.165117 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.165408 1200 ts_tablet_manager.cc:1403] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.002s
I20260619 19:53:56.165633 1201 consensus_queue.cc:260] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.166201 1201 ts_tablet_manager.cc:1434] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:56.166425 1200 raft_consensus.cc:359] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.166723 1200 raft_consensus.cc:385] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.166851 1200 raft_consensus.cc:740] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.167172 1200 consensus_queue.cc:260] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.169458 1201 tablet_bootstrap.cc:492] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.170507 1659 raft_consensus.cc:493] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.170694 1659 raft_consensus.cc:515] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.171396 1659 leader_election.cc:290] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.172164 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcaeebaaa93c479bafff14d312d526ec" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.172418 1059 raft_consensus.cc:2393] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:56.173441 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcaeebaaa93c479bafff14d312d526ec" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:56.173653 996 leader_election.cc:343] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.174105 719 leader_election.cc:304] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.174594 1659 raft_consensus.cc:3060] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.176043 1756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:56.176401 1756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:53:56.177693 1659 raft_consensus.cc:2749] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:56.179944 1201 tablet_bootstrap.cc:654] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.183072 1331 ts_tablet_manager.cc:1929] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:56.184698 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:56.185407 996 leader_election.cc:343] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.192649 996 leader_election.cc:304] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.193411 1695 raft_consensus.cc:2749] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:56.192355 1200 ts_tablet_manager.cc:1434] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260619 19:53:56.193863 1201 tablet_bootstrap.cc:492] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.194023 1201 ts_tablet_manager.cc:1403] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.002s
I20260619 19:53:56.196379 1200 tablet_bootstrap.cc:492] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.197322 1060 raft_consensus.cc:3060] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.198673 1200 tablet_bootstrap.cc:654] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.196599 1331 log.cc:1199] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/1d0fe0c67fe84e5b866fd2553ea26d91
I20260619 19:53:56.199417 1331 ts_tablet_manager.cc:1950] T 1d0fe0c67fe84e5b866fd2553ea26d91 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.201588 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 224) took 2202 ms. Trace:
I20260619 19:53:56.202131 1331 rpcz_store.cc:276] 0619 19:53:53.998583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.214488 (+215905us) service_pool.cc:224] Handling call
0619 19:53:56.064518 (+1850030us) ts_tablet_manager.cc:1151] Deleting tablet 1d0fe0c67fe84e5b866fd2553ea26d91
0619 19:53:56.064528 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.113122 (+ 48594us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.182980 (+ 69858us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.201514 (+ 18534us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1847491}
I20260619 19:53:56.202562 1331 tablet_replica.cc:333] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.202507 1201 raft_consensus.cc:359] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.202703 1201 raft_consensus.cc:385] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.202761 1331 raft_consensus.cc:2243] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:56.202786 1201 raft_consensus.cc:740] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.203016 1201 consensus_queue.cc:260] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.203154 1331 raft_consensus.cc:2272] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.203219 1659 consensus_queue.cc:1048] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.203615 1201 ts_tablet_manager.cc:1434] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
W20260619 19:53:56.203708 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 224) could send its response
I20260619 19:53:56.203919 1201 tablet_bootstrap.cc:492] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:53:56.205716 720 consensus_peers.cc:597] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2c0afdcf96247b0a16c8f9ac71cc24a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.211959 1694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:53:56.212270 1694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: LEADER
I20260619 19:53:56.214592 1201 tablet_bootstrap.cc:654] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.214756 1331 ts_tablet_manager.cc:1916] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.215910 1208 tablet_bootstrap.cc:492] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.216077 1208 ts_tablet_manager.cc:1403] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.008s
I20260619 19:53:56.216917 1208 raft_consensus.cc:359] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.217113 1208 raft_consensus.cc:385] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.217207 1208 raft_consensus.cc:740] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.218372 1567 raft_consensus.cc:493] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.218533 1567 raft_consensus.cc:515] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.219261 1567 leader_election.cc:290] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.220280 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2dd6eedd24f44a6a17aceb20e62bb" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.220563 919 raft_consensus.cc:2468] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:56.220908 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2dd6eedd24f44a6a17aceb20e62bb" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.221135 1060 raft_consensus.cc:2468] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:56.222373 720 leader_election.cc:304] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.223017 1659 raft_consensus.cc:2804] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.223133 1659 raft_consensus.cc:493] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.223320 1659 raft_consensus.cc:3060] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.226475 1659 raft_consensus.cc:515] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.228775 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2dd6eedd24f44a6a17aceb20e62bb" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:56.228938 1200 tablet_bootstrap.cc:492] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.228999 918 raft_consensus.cc:3060] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.229115 1200 ts_tablet_manager.cc:1403] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.002s
I20260619 19:53:56.229996 1200 raft_consensus.cc:359] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.230186 1200 raft_consensus.cc:385] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.230250 1200 raft_consensus.cc:740] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.230489 1200 consensus_queue.cc:260] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.231012 1200 ts_tablet_manager.cc:1434] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:56.231354 1200 tablet_bootstrap.cc:492] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.232829 1632 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.232990 1632 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.233319 1200 tablet_bootstrap.cc:654] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.233570 1201 tablet_bootstrap.cc:492] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.233848 1632 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.235682 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.235948 1060 raft_consensus.cc:2393] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:53:56.236542 1201 ts_tablet_manager.cc:1403] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.005s
I20260619 19:53:56.236841 1331 ts_tablet_manager.cc:1929] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.237040 1331 log.cc:1199] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:53:56.237406 1201 raft_consensus.cc:359] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.237438 1630 consensus_queue.cc:1048] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.237602 1201 raft_consensus.cc:385] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.237530 1331 ts_tablet_manager.cc:1950] T 4e2f73871161488dbad7a19fc9e20b9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.237671 1201 raft_consensus.cc:740] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.237893 1201 consensus_queue.cc:260] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.238276 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.238411 1201 ts_tablet_manager.cc:1434] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:56.238534 919 raft_consensus.cc:2393] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:56.239429 1201 tablet_bootstrap.cc:492] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.239379 719 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.239892 1567 raft_consensus.cc:3060] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.246644 1201 tablet_bootstrap.cc:654] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.247831 1567 raft_consensus.cc:2749] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:56.249143 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 225) took 2250 ms. Trace:
I20260619 19:53:56.249348 1331 rpcz_store.cc:276] 0619 19:53:53.998658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.217056 (+218398us) service_pool.cc:224] Handling call
0619 19:53:56.202454 (+1985398us) ts_tablet_manager.cc:1151] Deleting tablet 4e2f73871161488dbad7a19fc9e20b9c
0619 19:53:56.202464 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.220584 (+ 18120us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.236088 (+ 15504us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.249103 (+ 13015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1968975}
W20260619 19:53:56.249730 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 225) could send its response
I20260619 19:53:56.251997 1695 raft_consensus.cc:493] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.252235 1695 raft_consensus.cc:515] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.253080 1695 leader_election.cc:290] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:56.254005 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea9f17d5e75499a8433fc9a3043a88e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.254244 784 raft_consensus.cc:2468] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:56.254789 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea9f17d5e75499a8433fc9a3043a88e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.254990 923 raft_consensus.cc:2468] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:56.256022 918 raft_consensus.cc:2468] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:56.256454 719 leader_election.cc:304] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:56.257098 996 leader_election.cc:304] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.259116 1695 raft_consensus.cc:2804] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.259258 1695 raft_consensus.cc:493] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.259380 1695 raft_consensus.cc:3060] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.260067 1208 consensus_queue.cc:260] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.261938 1567 raft_consensus.cc:2804] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.262295 1567 raft_consensus.cc:697] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:56.262084 1632 consensus_queue.cc:1048] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.262624 1201 tablet_bootstrap.cc:492] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.262769 1201 ts_tablet_manager.cc:1403] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.001s
I20260619 19:53:56.262718 1695 raft_consensus.cc:515] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.263657 1201 raft_consensus.cc:359] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.263834 1201 raft_consensus.cc:385] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.263913 1201 raft_consensus.cc:740] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.264118 1201 consensus_queue.cc:260] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.264514 1567 consensus_queue.cc:237] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.264645 1201 ts_tablet_manager.cc:1434] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:56.264956 1201 tablet_bootstrap.cc:492] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.265429 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea9f17d5e75499a8433fc9a3043a88e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.265643 784 raft_consensus.cc:3060] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.266180 1659 leader_election.cc:290] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.266613 1201 tablet_bootstrap.cc:654] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.271482 784 raft_consensus.cc:2468] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.273988 996 leader_election.cc:304] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.274448 1628 raft_consensus.cc:2804] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.274586 1628 raft_consensus.cc:697] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:56.274849 1628 consensus_queue.cc:237] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.276443 1695 leader_election.cc:290] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:56.276748 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ea9f17d5e75499a8433fc9a3043a88e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:56.277107 918 raft_consensus.cc:3060] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.278164 1201 tablet_bootstrap.cc:492] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.278334 1201 ts_tablet_manager.cc:1403] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20260619 19:53:56.279223 1201 raft_consensus.cc:359] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.279448 1201 raft_consensus.cc:385] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.279531 1201 raft_consensus.cc:740] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.279805 1201 consensus_queue.cc:260] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.280360 1201 ts_tablet_manager.cc:1434] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:56.280663 1201 tablet_bootstrap.cc:492] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.282877 1201 tablet_bootstrap.cc:654] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.283624 918 raft_consensus.cc:2468] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.284727 1652 raft_consensus.cc:493] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.284900 1652 raft_consensus.cc:515] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.285527 1652 leader_election.cc:290] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.287736 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:56.288331 858 leader_election.cc:343] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.296494 1697 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 19:53:56.299580 1200 tablet_bootstrap.cc:492] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.299964 1200 ts_tablet_manager.cc:1403] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.006s
I20260619 19:53:56.305310 1200 raft_consensus.cc:359] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.305575 1200 raft_consensus.cc:385] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.305774 1200 raft_consensus.cc:740] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.306169 1200 consensus_queue.cc:260] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.306617 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_c2dbeec92873437ab12eedf151dbd3ad [id=0030f2fdb14a4d4d850c1f61d7135a21]
I20260619 19:53:56.308158 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]
I20260619 19:53:56.308701 1200 ts_tablet_manager.cc:1434] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20260619 19:53:56.308928 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]
I20260619 19:53:56.309008 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d2dd6eedd24f44a6a17aceb20e62bb" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.309221 1059 raft_consensus.cc:3060] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.309365 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.309525 1058 raft_consensus.cc:2468] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.309610 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]
I20260619 19:53:56.309994 859 leader_election.cc:304] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.310446 1652 raft_consensus.cc:2804] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.310451 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]
I20260619 19:53:56.310559 1652 raft_consensus.cc:493] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.310643 1652 raft_consensus.cc:3060] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:56.310632 720 consensus_peers.cc:597] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9be5cda43d0b4719a82f33a03e2261d3. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.311118 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703]
I20260619 19:53:56.312067 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]
I20260619 19:53:56.312568 1059 raft_consensus.cc:2468] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:56.312935 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5]
I20260619 19:53:56.313629 1652 raft_consensus.cc:515] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.314185 1200 tablet_bootstrap.cc:492] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.316629 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5397e7b4951344259694a66e18f7fd6f [id=173145ae0ed048a08221a123efe05b12]
I20260619 19:53:56.316929 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.317198 1059 raft_consensus.cc:3060] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.318776 1331 tablet_replica.cc:333] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.319170 1331 raft_consensus.cc:2243] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:56.319062 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_4f97c7f3371b4cd9bf5b12bd61a73e1a [id=1a158f2fac454de8b7527ea346ec4786]
I20260619 19:53:56.320664 1201 tablet_bootstrap.cc:492] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.320854 1652 leader_election.cc:290] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.321007 1201 ts_tablet_manager.cc:1403] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.003s
I20260619 19:53:56.321695 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:56.322567 858 leader_election.cc:343] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.323823 1201 raft_consensus.cc:359] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.324229 1201 raft_consensus.cc:385] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.324443 1201 raft_consensus.cc:740] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.325206 1201 consensus_queue.cc:260] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.326622 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]
I20260619 19:53:56.327836 1201 ts_tablet_manager.cc:1434] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260619 19:53:56.328745 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]
I20260619 19:53:56.329103 1201 tablet_bootstrap.cc:492] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.333212 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]
I20260619 19:53:56.334131 1652 raft_consensus.cc:493] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.334313 1652 raft_consensus.cc:515] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.335762 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e606b958d940c6a353a09a2eb627ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.335115 1652 leader_election.cc:290] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.335990 784 raft_consensus.cc:2468] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.336531 858 leader_election.cc:304] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:56.336576 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]
I20260619 19:53:56.337944 1652 raft_consensus.cc:2804] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.338064 1652 raft_consensus.cc:493] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.338173 1652 raft_consensus.cc:3060] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.339514 1201 tablet_bootstrap.cc:654] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.320314 1200 tablet_bootstrap.cc:654] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.342778 1331 raft_consensus.cc:2272] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.320438 1059 raft_consensus.cc:2468] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.342849 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_6e54fd634fc845d7b9ab428009616c61 [id=23b39c02806142d4b0a5c7c0d898b8dd]
I20260619 19:53:56.335954 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e606b958d940c6a353a09a2eb627ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.346127 1056 raft_consensus.cc:2468] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.348433 1652 raft_consensus.cc:515] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.349555 1208 ts_tablet_manager.cc:1434] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.133s user 0.007s sys 0.002s
I20260619 19:53:56.349547 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]
I20260619 19:53:56.350175 1208 tablet_bootstrap.cc:492] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.355851 1331 ts_tablet_manager.cc:1916] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.351392 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e606b958d940c6a353a09a2eb627ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:56.351738 720 consensus_peers.cc:597] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d0fe0c67fe84e5b866fd2553ea26d91. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.356220 784 raft_consensus.cc:3060] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.359652 784 raft_consensus.cc:2468] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.360896 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_fa6e27c7a16c411e91a2913fda307afb [id=2daa177012434787b804b7721c3f91d2]
I20260619 19:53:56.363837 1208 tablet_bootstrap.cc:654] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.365053 859 leader_election.cc:304] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.365574 858 leader_election.cc:304] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:56.366021 1621 raft_consensus.cc:2804] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.366183 1621 raft_consensus.cc:697] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.365990 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_38edae940f8c454286821ba5a5703a7f [id=388e0d04a45e495aa4e3bbc05802a988]
I20260619 19:53:56.366456 1621 consensus_queue.cc:237] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.367237 1626 raft_consensus.cc:2804] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.367707 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_c73a82d38a4545cc8940056415afdc2b [id=394d8c70bca54b0eb32990278e06cd91]
I20260619 19:53:56.369758 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e606b958d940c6a353a09a2eb627ee" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.370025 1056 raft_consensus.cc:3060] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.372833 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]
I20260619 19:53:56.373824 1056 raft_consensus.cc:2468] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.374141 1331 ts_tablet_manager.cc:1929] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.377297 1331 log.cc:1199] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fd9c959792fa48e89b669520f7332b26
I20260619 19:53:56.378866 1331 ts_tablet_manager.cc:1950] T fd9c959792fa48e89b669520f7332b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.378983 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea]
I20260619 19:53:56.380689 1208 tablet_bootstrap.cc:492] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.381028 1208 ts_tablet_manager.cc:1403] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.004s
I20260619 19:53:56.382226 1208 raft_consensus.cc:359] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.382614 1208 raft_consensus.cc:385] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.382747 1208 raft_consensus.cc:740] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.383271 1208 consensus_queue.cc:260] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.385243 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 226) took 2386 ms. Trace:
I20260619 19:53:56.385499 1208 ts_tablet_manager.cc:1434] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 19:53:56.385087 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]
I20260619 19:53:56.389355 1652 leader_election.cc:290] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.396903 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]
I20260619 19:53:56.398574 1208 tablet_bootstrap.cc:492] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.399466 1331 rpcz_store.cc:276] 0619 19:53:53.998759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.218512 (+219753us) service_pool.cc:224] Handling call
0619 19:53:56.249999 (+2031487us) ts_tablet_manager.cc:1151] Deleting tablet fd9c959792fa48e89b669520f7332b26
0619 19:53:56.308483 (+ 58484us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.369096 (+ 60613us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.374046 (+ 4950us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.385177 (+ 11131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016018}
W20260619 19:53:56.400005 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 226) could send its response
I20260619 19:53:56.400204 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 246) took 1893 ms. Trace:
I20260619 19:53:56.401412 1208 tablet_bootstrap.cc:654] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.407682 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_813fc3596f604c7a99d0ac0c6c42a5e0 [id=41f6ba3e85b04574878f66c6f98d60ff]
I20260619 19:53:56.413425 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_7fce2193633d4d80b56750d4df0c8e90 [id=4571c7fa9c1f4c478238240370b24d9f]
I20260619 19:53:56.415644 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]
I20260619 19:53:56.419899 1201 tablet_bootstrap.cc:492] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.421967 1201 ts_tablet_manager.cc:1403] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.092s user 0.005s sys 0.012s
I20260619 19:53:56.422771 1201 raft_consensus.cc:359] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.423023 1201 raft_consensus.cc:385] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.423095 1201 raft_consensus.cc:740] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.423729 1201 consensus_queue.cc:260] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.424657 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_20dc9175b4c84bc6ac2546afae733eca [id=52998f068e554dd7b19f353a041fda6a]
I20260619 19:53:56.425896 1201 ts_tablet_manager.cc:1434] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:53:56.426947 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]
I20260619 19:53:56.427487 1331 rpcz_store.cc:276] 0619 19:53:54.507066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.545073 (+ 38007us) service_pool.cc:224] Handling call
0619 19:53:56.400023 (+1854950us) ts_tablet_manager.cc:1151] Deleting tablet 376dfca0b54d4c689c96242566869717
0619 19:53:56.400036 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.400154 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1854699}
W20260619 19:53:56.427767 720 consensus_peers.cc:597] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fb8df8d8ac047bfa6ab7a6b533e38fc. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.427891 1331 tablet_replica.cc:333] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:53:56.427975 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 246) could send its response
I20260619 19:53:56.428108 1331 raft_consensus.cc:2243] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:56.402285 1200 tablet_bootstrap.cc:492] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.428350 1331 raft_consensus.cc:2272] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.428409 1200 ts_tablet_manager.cc:1403] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.114s user 0.012s sys 0.005s
I20260619 19:53:56.428990 1331 ts_tablet_manager.cc:1916] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.429306 1200 raft_consensus.cc:359] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.429569 1200 raft_consensus.cc:385] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.429646 1200 raft_consensus.cc:740] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.429713 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_13a373b0df95461581e1325a78c25c13 [id=55b6b9eae3ed41a487ea1b9468cd518f]
I20260619 19:53:56.429960 1200 consensus_queue.cc:260] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.430330 1201 tablet_bootstrap.cc:492] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.430536 1200 ts_tablet_manager.cc:1434] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:56.430711 1626 raft_consensus.cc:697] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.432233 1626 consensus_queue.cc:237] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.436120 1201 tablet_bootstrap.cc:654] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.437211 1208 tablet_bootstrap.cc:492] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.437441 1208 ts_tablet_manager.cc:1403] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.005s
I20260619 19:53:56.437634 1331 ts_tablet_manager.cc:1929] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.438069 1331 log.cc:1199] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/5f25c0378a6f4e9ea1a62d98f27778ee
I20260619 19:53:56.438020 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_c8c43c1f76624e4d8d4429389c71c3e7 [id=55c0a07c0adb4b1db2f1715c4fe2137b]
I20260619 19:53:56.438400 1208 raft_consensus.cc:359] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.438673 1331 ts_tablet_manager.cc:1950] T 5f25c0378a6f4e9ea1a62d98f27778ee P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.439555 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 250) took 1927 ms. Trace:
I20260619 19:53:56.439821 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_6354f0bf977c438d9ffcf548901ac7af [id=56ee4af476f74b9ab373fb2bfc1c315e]
I20260619 19:53:56.439792 1331 rpcz_store.cc:276] 0619 19:53:54.511934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.565662 (+ 53728us) service_pool.cc:224] Handling call
0619 19:53:56.427801 (+1862139us) ts_tablet_manager.cc:1151] Deleting tablet 5f25c0378a6f4e9ea1a62d98f27778ee
0619 19:53:56.427812 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.433672 (+ 5860us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.437530 (+ 3858us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.439509 (+ 1979us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1861899}
W20260619 19:53:56.440303 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 250) could send its response
I20260619 19:53:56.440856 1200 tablet_bootstrap.cc:492] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.442389 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b [id=57b57ad63a674bf08da4cf6d7bcd1b4e]
I20260619 19:53:56.442839 1200 tablet_bootstrap.cc:654] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.443233 1331 tablet_replica.cc:333] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.443210 1208 raft_consensus.cc:385] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.443343 1208 raft_consensus.cc:740] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.443534 1331 raft_consensus.cc:2243] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:56.443872 1331 raft_consensus.cc:2272] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.443864 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]
I20260619 19:53:56.444512 1331 ts_tablet_manager.cc:1916] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.447445 1208 consensus_queue.cc:260] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.447564 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_64306ac3336a496b97becea891be9344 [id=592df24d0a274aa7a92b1f1952627c0c]
I20260619 19:53:56.448407 1208 ts_tablet_manager.cc:1434] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260619 19:53:56.451179 1208 tablet_bootstrap.cc:492] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.451046 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]
I20260619 19:53:56.454840 1208 tablet_bootstrap.cc:654] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.457161 1201 tablet_bootstrap.cc:492] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.457506 1201 ts_tablet_manager.cc:1403] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.002s
I20260619 19:53:56.459177 1201 raft_consensus.cc:359] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.459667 1201 raft_consensus.cc:385] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.459896 1201 raft_consensus.cc:740] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.460508 1201 consensus_queue.cc:260] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.461848 1201 ts_tablet_manager.cc:1434] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:53:56.462385 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]
I20260619 19:53:56.463793 1201 tablet_bootstrap.cc:492] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.465648 784 raft_consensus.cc:3060] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.468544 1200 tablet_bootstrap.cc:492] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.468683 1200 ts_tablet_manager.cc:1403] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260619 19:53:56.469586 1796 consensus_queue.cc:1048] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.469911 1786 consensus_queue.cc:1048] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.472222 1200 raft_consensus.cc:359] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.472486 1200 raft_consensus.cc:385] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.472746 1628 raft_consensus.cc:493] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.472893 1628 raft_consensus.cc:515] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.473513 1628 leader_election.cc:290] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.473837 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_f499d3b7eac649a7b6f05c64db213152 [id=62118399790b4ce49c35ec8cfe23ca5d]
I20260619 19:53:56.474221 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f8635b919a44a8a1e5fe48420ca4b7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.474433 783 raft_consensus.cc:2468] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:56.474942 996 leader_election.cc:304] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.475417 1628 raft_consensus.cc:2804] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.475512 1628 raft_consensus.cc:493] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.475611 1628 raft_consensus.cc:3060] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.475569 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f8635b919a44a8a1e5fe48420ca4b7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.475768 919 raft_consensus.cc:2468] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:56.478490 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]
I20260619 19:53:56.478348 1628 raft_consensus.cc:515] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:56.481858 719 consensus_peers.cc:597] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2c0afdcf96247b0a16c8f9ac71cc24a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.482074 1201 tablet_bootstrap.cc:654] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.482723 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f8635b919a44a8a1e5fe48420ca4b7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.482949 783 raft_consensus.cc:3060] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.483889 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]
I20260619 19:53:56.484349 1331 ts_tablet_manager.cc:1929] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.485230 1331 log.cc:1199] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/69fa5d1df8d84fcd938349af6d2d0af0
I20260619 19:53:56.485848 1331 ts_tablet_manager.cc:1950] T 69fa5d1df8d84fcd938349af6d2d0af0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.486382 783 raft_consensus.cc:2468] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.486960 996 leader_election.cc:304] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.487656 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f8635b919a44a8a1e5fe48420ca4b7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:56.487871 919 raft_consensus.cc:3060] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.487888 1628 leader_election.cc:290] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.472648 1200 raft_consensus.cc:740] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.488241 1200 consensus_queue.cc:260] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.489603 1208 tablet_bootstrap.cc:492] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.489784 1208 ts_tablet_manager.cc:1403] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.002s
I20260619 19:53:56.490052 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_30932010f9e54c029a0c57b5c379957e [id=6d7c9506a27b4a70a32958a89c72c202]
I20260619 19:53:56.490630 1208 raft_consensus.cc:359] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.490866 1208 raft_consensus.cc:385] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.490942 1208 raft_consensus.cc:740] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.491722 1208 consensus_queue.cc:260] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.491901 919 raft_consensus.cc:2468] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.492477 1208 ts_tablet_manager.cc:1434] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 19:53:56.492872 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]
I20260619 19:53:56.493813 1208 tablet_bootstrap.cc:492] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.496610 1208 tablet_bootstrap.cc:654] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.499646 1567 raft_consensus.cc:493] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.499796 1567 raft_consensus.cc:515] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.500447 1567 leader_election.cc:290] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.501106 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.501358 1056 raft_consensus.cc:2393] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:56.499176 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]
I20260619 19:53:56.502202 1695 raft_consensus.cc:2804] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.502358 1695 raft_consensus.cc:697] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:56.502661 1695 consensus_queue.cc:237] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:53:56.505898 859 consensus_peers.cc:597] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91e43148bb5b47128e08ed7faf8c7c1f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.506319 1200 ts_tablet_manager.cc:1434] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260619 19:53:56.506808 1200 tablet_bootstrap.cc:492] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.508306 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aafe2a956b844c9998c84bbe52070e5d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.508888 719 leader_election.cc:304] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.509402 1786 raft_consensus.cc:3060] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.512848 1786 raft_consensus.cc:2749] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:56.516312 1200 tablet_bootstrap.cc:654] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.518383 1201 tablet_bootstrap.cc:492] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.518659 1201 ts_tablet_manager.cc:1403] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.004s
I20260619 19:53:56.519531 1208 tablet_bootstrap.cc:492] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.519740 1208 ts_tablet_manager.cc:1403] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260619 19:53:56.520567 1208 raft_consensus.cc:359] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.520823 1208 raft_consensus.cc:385] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.521064 1208 raft_consensus.cc:740] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.521416 1208 consensus_queue.cc:260] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.521479 1201 raft_consensus.cc:359] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.522470 1201 raft_consensus.cc:385] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.523034 1201 raft_consensus.cc:740] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.524482 1201 consensus_queue.cc:260] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.525825 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]
I20260619 19:53:56.527665 1208 ts_tablet_manager.cc:1434] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260619 19:53:56.527922 996 consensus_peers.cc:597] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 131ccb73ea1f4a7b8781c093ea2995d1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.529970 1201 ts_tablet_manager.cc:1434] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260619 19:53:56.530874 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]
I20260619 19:53:56.531891 1201 tablet_bootstrap.cc:492] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.534021 1208 tablet_bootstrap.cc:492] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.534022 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_318e69014c974faabdc436cbeec6cbdc [id=7ebab8e3fd93430aa6d2a429f2dca4f7]
I20260619 19:53:56.535924 1208 tablet_bootstrap.cc:654] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.539657 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 [id=7f1a06b87720448aba53d5447e938e0b]
I20260619 19:53:56.543889 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]
I20260619 19:53:56.545763 1208 tablet_bootstrap.cc:492] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.546021 1208 ts_tablet_manager.cc:1403] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260619 19:53:56.546948 1208 raft_consensus.cc:359] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.547283 1208 raft_consensus.cc:385] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.547410 1208 raft_consensus.cc:740] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.547753 1208 consensus_queue.cc:260] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.550475 1201 tablet_bootstrap.cc:654] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.554065 1208 ts_tablet_manager.cc:1434] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260619 19:53:56.554138 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_1e665d03a8764d998282ef50afaa6b12 [id=814802093a404dadb94baac5b9037087]
I20260619 19:53:56.559460 1208 tablet_bootstrap.cc:492] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.560096 1621 raft_consensus.cc:493] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.560323 1621 raft_consensus.cc:515] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.561230 1621 leader_election.cc:290] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.561563 1208 tablet_bootstrap.cc:654] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.562282 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3fa43017fa4c278111c29d0d22f7da" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.562655 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3fa43017fa4c278111c29d0d22f7da" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.562878 784 raft_consensus.cc:2468] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:53:56.562951 859 leader_election.cc:343] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.563531 858 leader_election.cc:304] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.564106 1626 raft_consensus.cc:2804] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.564203 1626 raft_consensus.cc:493] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.564288 1626 raft_consensus.cc:3060] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.566036 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 247) took 2055 ms. Trace:
I20260619 19:53:56.566148 1331 rpcz_store.cc:276] 0619 19:53:54.510590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.545332 (+ 34742us) service_pool.cc:224] Handling call
0619 19:53:56.440537 (+1895205us) ts_tablet_manager.cc:1151] Deleting tablet 69fa5d1df8d84fcd938349af6d2d0af0
0619 19:53:56.440546 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.447787 (+ 7241us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.484272 (+ 36485us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.516745 (+ 32473us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1860124}
W20260619 19:53:56.566421 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 247) could send its response
I20260619 19:53:56.566713 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]
I20260619 19:53:56.567942 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 248) took 2056 ms. Trace:
I20260619 19:53:56.568045 1331 rpcz_store.cc:276] 0619 19:53:54.511190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.551501 (+ 40311us) service_pool.cc:224] Handling call
0619 19:53:56.567734 (+2016233us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:53:56.567749 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.567879 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1986746}
W20260619 19:53:56.568287 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 248) could send its response
I20260619 19:53:56.567070 1626 raft_consensus.cc:515] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.571586 1626 leader_election.cc:290] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.571599 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3fa43017fa4c278111c29d0d22f7da" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.571825 784 raft_consensus.cc:3060] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.572023 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3fa43017fa4c278111c29d0d22f7da" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:53:56.572602 859 leader_election.cc:343] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.576035 784 raft_consensus.cc:2468] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.576772 858 leader_election.cc:304] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.577224 1626 raft_consensus.cc:2804] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.577392 1626 raft_consensus.cc:697] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.577812 1626 consensus_queue.cc:237] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.580441 1208 tablet_bootstrap.cc:492] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.580983 1331 tablet_replica.cc:333] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.581442 1201 tablet_bootstrap.cc:492] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.581596 1201 ts_tablet_manager.cc:1403] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.000s
I20260619 19:53:56.581470 1331 raft_consensus.cc:2243] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:56.582443 1201 raft_consensus.cc:359] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.582639 1201 raft_consensus.cc:385] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.582726 1201 raft_consensus.cc:740] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.583066 1201 consensus_queue.cc:260] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.583884 1201 ts_tablet_manager.cc:1434] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:53:56.583815 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]
I20260619 19:53:56.584187 1201 tablet_bootstrap.cc:492] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.585621 1208 ts_tablet_manager.cc:1403] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.002s
I20260619 19:53:56.586580 1201 tablet_bootstrap.cc:654] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.586920 1208 raft_consensus.cc:359] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.587180 1208 raft_consensus.cc:385] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.587304 1208 raft_consensus.cc:740] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.593642 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]
I20260619 19:53:56.599768 1201 tablet_bootstrap.cc:492] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.599972 1201 ts_tablet_manager.cc:1403] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260619 19:53:56.598152 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_49472f6375c04623bbaba293eb98dd6f [id=8d6402c45a4d4456935a213be45b3c51]
I20260619 19:53:56.602561 1201 raft_consensus.cc:359] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.602795 1201 raft_consensus.cc:385] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.602875 1201 raft_consensus.cc:740] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.603120 1201 consensus_queue.cc:260] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.603284 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:44433
--webserver_interface=127.0.105.188
--webserver_port=42109
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 19:53:56.603679 1201 ts_tablet_manager.cc:1434] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:53:56.604269 1201 tablet_bootstrap.cc:492] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.606024 1201 tablet_bootstrap.cc:654] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.606299 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]
I20260619 19:53:56.583069 1331 raft_consensus.cc:2272] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.610386 1621 consensus_queue.cc:1048] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.602351 1785 consensus_queue.cc:1048] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.614655 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_e170513f38a14ffcaceccb5ee9052c80 [id=8eedaa1e27904cadb0b52ab19f4c43ff]
I20260619 19:53:56.615861 1208 consensus_queue.cc:260] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.617560 1208 ts_tablet_manager.cc:1434] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260619 19:53:56.618680 1208 tablet_bootstrap.cc:492] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.617890 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]
I20260619 19:53:56.620738 1331 ts_tablet_manager.cc:1916] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.621107 1208 tablet_bootstrap.cc:654] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.622009 1200 tablet_bootstrap.cc:492] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.622227 1200 ts_tablet_manager.cc:1403] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.115s user 0.028s sys 0.024s
I20260619 19:53:56.623215 1200 raft_consensus.cc:359] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.623950 1200 raft_consensus.cc:385] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.624274 1200 raft_consensus.cc:740] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.624863 1200 consensus_queue.cc:260] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.629874 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]
I20260619 19:53:56.633316 1200 ts_tablet_manager.cc:1434] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260619 19:53:56.635254 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]
I20260619 19:53:56.637403 1200 tablet_bootstrap.cc:492] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.627460 1785 raft_consensus.cc:493] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.637917 1785 raft_consensus.cc:515] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.630897 1630 consensus_queue.cc:1048] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.639916 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4132f28c434492cbddc8da7d8075c43" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.640192 1056 raft_consensus.cc:2393] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:56.641177 1200 tablet_bootstrap.cc:654] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.638659 1785 leader_election.cc:290] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.650903 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_ff9ca3289e4b45ba86c2ab483ea08d30 [id=96dda797fa474e119e765b5d9946bfb7]
I20260619 19:53:56.652189 1514 consensus_queue.cc:1048] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.654963 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4132f28c434492cbddc8da7d8075c43" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.656035 719 leader_election.cc:304] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.656579 1632 raft_consensus.cc:3060] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.659588 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]
I20260619 19:53:56.663120 1632 raft_consensus.cc:2749] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:56.671362 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]
I20260619 19:53:56.673854 1331 ts_tablet_manager.cc:1929] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.674161 1331 log.cc:1199] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/37393d7c16594032bf2a69abb0ab5931
I20260619 19:53:56.676080 1756 raft_consensus.cc:493] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6cc90ee2d59d4dddae6790dd92b20cb5)
I20260619 19:53:56.676297 1756 raft_consensus.cc:515] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:53:56.677215 1756 leader_election.cc:290] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849), 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433)
I20260619 19:53:56.686091 1331 ts_tablet_manager.cc:1950] T 37393d7c16594032bf2a69abb0ab5931 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.687218 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]
I20260619 19:53:56.687870 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 249) took 2176 ms. Trace:
I20260619 19:53:56.688174 1331 rpcz_store.cc:276] 0619 19:53:54.511665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.557544 (+ 45879us) service_pool.cc:224] Handling call
0619 19:53:56.570059 (+2012515us) ts_tablet_manager.cc:1151] Deleting tablet 37393d7c16594032bf2a69abb0ab5931
0619 19:53:56.570071 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.640353 (+ 70282us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.673533 (+ 33180us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.687795 (+ 14262us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1989079}
I20260619 19:53:56.688405 1201 tablet_bootstrap.cc:492] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:53:56.689378 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 249) could send its response
I20260619 19:53:56.689742 1331 tablet_replica.cc:333] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.690521 1201 ts_tablet_manager.cc:1403] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.086s user 0.002s sys 0.023s
I20260619 19:53:56.690146 1331 raft_consensus.cc:2243] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:56.694952 1331 raft_consensus.cc:2272] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.696530 1200 tablet_bootstrap.cc:492] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.696607 1331 ts_tablet_manager.cc:1916] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.696846 1200 ts_tablet_manager.cc:1403] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.060s user 0.016s sys 0.006s
I20260619 19:53:56.696527 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4 [id=a57b082016f14ff48e4194fcbd7b63c1]
I20260619 19:53:56.697752 1200 raft_consensus.cc:359] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.698201 1200 raft_consensus.cc:385] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.698354 1200 raft_consensus.cc:740] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.698777 1200 consensus_queue.cc:260] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.701285 1201 raft_consensus.cc:359] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.702893 1201 raft_consensus.cc:385] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.703102 1201 raft_consensus.cc:740] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.703577 1201 consensus_queue.cc:260] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.704728 1201 ts_tablet_manager.cc:1434] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260619 19:53:56.704774 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1]
I20260619 19:53:56.706475 1208 tablet_bootstrap.cc:492] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.706859 1208 ts_tablet_manager.cc:1403] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.005s
I20260619 19:53:56.708487 1208 raft_consensus.cc:359] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.709077 1208 raft_consensus.cc:385] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.709403 1208 raft_consensus.cc:740] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.710116 1201 tablet_bootstrap.cc:492] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.709935 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_516e7616f9ea454fbe587f5be52a3c55 [id=af3f4335b675482195a6511647ca2871]
I20260619 19:53:56.710728 1208 consensus_queue.cc:260] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.718111 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]
I20260619 19:53:56.719336 1632 consensus_queue.cc:1048] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.720386 1200 ts_tablet_manager.cc:1434] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260619 19:53:56.720916 1200 tablet_bootstrap.cc:492] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:53:56.722561 1274 leader_election.cc:336] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111)
I20260619 19:53:56.725364 1514 raft_consensus.cc:493] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.725590 1514 raft_consensus.cc:515] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.726375 1514 leader_election.cc:290] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.726246 1208 ts_tablet_manager.cc:1434] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260619 19:53:56.727401 1200 tablet_bootstrap.cc:654] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.727623 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32665a93ee5b4f8290c79e2a1d4b1db1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.727931 784 raft_consensus.cc:2468] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.728842 858 leader_election.cc:304] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:56.729799 1514 raft_consensus.cc:2804] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.729897 1514 raft_consensus.cc:493] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.729996 1514 raft_consensus.cc:3060] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.731251 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32665a93ee5b4f8290c79e2a1d4b1db1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.731485 1056 raft_consensus.cc:2468] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.732672 1208 tablet_bootstrap.cc:492] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.733011 1514 raft_consensus.cc:515] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.734283 1652 raft_consensus.cc:493] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.734488 1652 raft_consensus.cc:515] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.735219 1652 leader_election.cc:290] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.735996 1201 tablet_bootstrap.cc:654] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.736508 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297f07f2d08d47dfa69f845dadb973b1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.737522 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32665a93ee5b4f8290c79e2a1d4b1db1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.737773 1056 raft_consensus.cc:3060] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.737803 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297f07f2d08d47dfa69f845dadb973b1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.737988 1059 raft_consensus.cc:2468] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:53:56.741297 858 leader_election.cc:343] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.742164 859 leader_election.cc:304] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.742699 1652 raft_consensus.cc:2804] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.743110 1652 raft_consensus.cc:493] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.743269 1652 raft_consensus.cc:3060] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.744778 1208 tablet_bootstrap.cc:654] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.746243 1652 raft_consensus.cc:515] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.747727 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297f07f2d08d47dfa69f845dadb973b1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:56.748425 858 leader_election.cc:343] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.749737 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32665a93ee5b4f8290c79e2a1d4b1db1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.749977 784 raft_consensus.cc:3060] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.752969 1056 raft_consensus.cc:2468] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.753525 784 raft_consensus.cc:2468] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.753672 1331 ts_tablet_manager.cc:1929] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:56.754127 858 leader_election.cc:304] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:56.754635 1796 raft_consensus.cc:2804] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.754841 1796 raft_consensus.cc:697] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.755208 1796 consensus_queue.cc:237] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:56.757390 1208 tablet_bootstrap.cc:492] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.757736 1208 ts_tablet_manager.cc:1403] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.000s
I20260619 19:53:56.760340 1652 leader_election.cc:290] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.761413 1514 leader_election.cc:290] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.761785 1201 tablet_bootstrap.cc:492] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.762247 1200 tablet_bootstrap.cc:492] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.762457 1514 consensus_queue.cc:1048] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.761364 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_33d4ef8901924ac38b9500db539f2257 [id=b0c20277b82e48e096fc0ea8d3053c55]
I20260619 19:53:56.762677 1201 ts_tablet_manager.cc:1403] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.007s
I20260619 19:53:56.762857 1652 raft_consensus.cc:493] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.763567 1652 raft_consensus.cc:515] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.764701 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b22024a0c434f8e8d4a370dbfb9a4e2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.764706 1201 raft_consensus.cc:359] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.765069 1201 raft_consensus.cc:385] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.765120 1626 raft_consensus.cc:493] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.765218 1201 raft_consensus.cc:740] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.765285 1626 raft_consensus.cc:515] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.765861 1626 leader_election.cc:290] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.765836 1201 consensus_queue.cc:260] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.766655 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e463032d0744cc88d011accbebfe1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.766120 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_a918fc9dd9df4b9d928067cbd4dd0756 [id=b3d6c18b7ce64c23a0c84bde930aa147]
I20260619 19:53:56.766911 1331 log.cc:1199] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/6ef20e35c612400bbbf1c707a36ced8c
I20260619 19:53:56.767191 1200 ts_tablet_manager.cc:1403] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.002s
I20260619 19:53:56.767186 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297f07f2d08d47dfa69f845dadb973b1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.767421 1056 raft_consensus.cc:3060] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.767695 1331 ts_tablet_manager.cc:1950] T 6ef20e35c612400bbbf1c707a36ced8c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.768095 1200 raft_consensus.cc:359] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.768323 1200 raft_consensus.cc:385] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.768414 1200 raft_consensus.cc:740] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.768610 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 251) took 2256 ms. Trace:
I20260619 19:53:56.768724 1331 rpcz_store.cc:276] 0619 19:53:54.518120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.565925 (+ 47805us) service_pool.cc:224] Handling call
0619 19:53:56.689043 (+2123118us) ts_tablet_manager.cc:1151] Deleting tablet 6ef20e35c612400bbbf1c707a36ced8c
0619 19:53:56.689058 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.723857 (+ 34799us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.738608 (+ 14751us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.768546 (+ 29938us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2070077}
W20260619 19:53:56.769021 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 251) could send its response
I20260619 19:53:56.769464 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 253) took 2015 ms. Trace:
I20260619 19:53:56.769563 1331 rpcz_store.cc:276] 0619 19:53:54.754305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.754601 (+ 296us) service_pool.cc:224] Handling call
0619 19:53:56.769256 (+2014655us) ts_tablet_manager.cc:1151] Deleting tablet 45c0ffb4629a46349ccfe473cc20cdfc
0619 19:53:56.769265 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.769394 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2014362}
W20260619 19:53:56.769830 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 253) could send its response
I20260619 19:53:56.770119 1331 tablet_replica.cc:333] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.770378 1331 raft_consensus.cc:2243] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:56.770529 1056 raft_consensus.cc:2468] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.770594 1331 raft_consensus.cc:2272] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.770991 859 leader_election.cc:304] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.771065 1200 consensus_queue.cc:260] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.771728 1200 ts_tablet_manager.cc:1434] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260619 19:53:56.771860 1060 raft_consensus.cc:2468] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.772457 1200 tablet_bootstrap.cc:492] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.773083 1331 ts_tablet_manager.cc:1916] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.771327 1201 ts_tablet_manager.cc:1434] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260619 19:53:56.775074 859 leader_election.cc:304] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.775382 1201 tablet_bootstrap.cc:492] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.775709 1621 raft_consensus.cc:2804] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.776031 1626 raft_consensus.cc:2804] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.776140 1626 raft_consensus.cc:493] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.776221 1626 raft_consensus.cc:3060] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.774559 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]
I20260619 19:53:56.780596 1621 raft_consensus.cc:697] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.781351 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]
I20260619 19:53:56.781695 1200 tablet_bootstrap.cc:654] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.782302 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5315cb7e69284c01ab36267884d6abf5 [id=b9dc702105844f9a8864d15332e30313]
I20260619 19:53:56.782752 1621 consensus_queue.cc:237] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.785007 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]
I20260619 19:53:56.767266 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e463032d0744cc88d011accbebfe1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.767755 1630 raft_consensus.cc:493] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.786165 1630 raft_consensus.cc:515] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.786921 1630 leader_election.cc:290] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.771585 1208 raft_consensus.cc:359] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.787457 1208 raft_consensus.cc:385] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.787310 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472]
I20260619 19:53:56.787569 1208 raft_consensus.cc:740] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.787797 1208 consensus_queue.cc:260] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.788069 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620f3a56e57e49b7b520012857e71187" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.788375 1208 ts_tablet_manager.cc:1434] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
W20260619 19:53:56.788988 720 leader_election.cc:343] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.790688 1208 tablet_bootstrap.cc:492] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.793113 1208 tablet_bootstrap.cc:654] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.795020 784 raft_consensus.cc:2468] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:56.796437 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b22024a0c434f8e8d4a370dbfb9a4e2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.798080 1200 tablet_bootstrap.cc:492] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.798316 1200 ts_tablet_manager.cc:1403] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.005s
I20260619 19:53:56.799042 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_8d50f1b1ec814e8d85b077e1eb08a18c [id=c128b2a4a40748dabd196e9703c43254]
I20260619 19:53:56.799328 1200 raft_consensus.cc:359] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.801630 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620f3a56e57e49b7b520012857e71187" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.802138 1200 raft_consensus.cc:385] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.802265 1200 raft_consensus.cc:740] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:53:56.802434 859 leader_election.cc:343] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.802627 1200 consensus_queue.cc:260] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.803979 1200 ts_tablet_manager.cc:1434] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:56.804483 1200 tablet_bootstrap.cc:492] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:56.807219 1626 raft_consensus.cc:515] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:56.807469 858 leader_election.cc:343] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.808236 1626 leader_election.cc:290] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.809437 858 leader_election.cc:304] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.810794 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e463032d0744cc88d011accbebfe1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.811059 1060 raft_consensus.cc:3060] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.811866 1201 tablet_bootstrap.cc:654] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.806887 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]
I20260619 19:53:56.813037 1832 raft_consensus.cc:2804] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.813179 1832 raft_consensus.cc:493] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.813318 1832 raft_consensus.cc:3060] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.814150 1060 raft_consensus.cc:2468] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.814484 1652 leader_election.cc:290] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.814513 919 raft_consensus.cc:2468] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:56.816053 719 leader_election.cc:304] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.816686 859 leader_election.cc:304] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.817081 1652 raft_consensus.cc:2804] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.817284 1652 raft_consensus.cc:697] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.817355 1632 raft_consensus.cc:2804] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.817512 1632 raft_consensus.cc:493] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.817633 1632 raft_consensus.cc:3060] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.817631 1652 consensus_queue.cc:237] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.821015 1632 raft_consensus.cc:515] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.822650 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620f3a56e57e49b7b520012857e71187" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.822777 1514 raft_consensus.cc:493] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.823035 1514 raft_consensus.cc:515] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:56.823354 720 leader_election.cc:343] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.824251 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "620f3a56e57e49b7b520012857e71187" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:56.824510 919 raft_consensus.cc:3060] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.824554 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12258d3bcc714f34857d7362c49ee787" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:56.825459 1632 leader_election.cc:290] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.825579 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12258d3bcc714f34857d7362c49ee787" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.825757 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e463032d0744cc88d011accbebfe1f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.826920 1200 tablet_bootstrap.cc:654] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.827955 919 raft_consensus.cc:2468] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:53:56.828401 859 leader_election.cc:343] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.828540 719 leader_election.cc:304] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.828980 1626 consensus_queue.cc:1048] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.829064 1632 raft_consensus.cc:2804] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.829613 1632 raft_consensus.cc:697] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:56.829879 1514 leader_election.cc:290] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.829941 1632 consensus_queue.cc:237] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.832067 1208 tablet_bootstrap.cc:492] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.832533 1208 ts_tablet_manager.cc:1403] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
I20260619 19:53:56.834606 1208 raft_consensus.cc:359] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.834904 1208 raft_consensus.cc:385] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.834996 1208 raft_consensus.cc:740] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.837028 1208 consensus_queue.cc:260] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.838214 1695 raft_consensus.cc:493] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:56.838420 1695 raft_consensus.cc:515] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.839148 1208 ts_tablet_manager.cc:1434] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260619 19:53:56.839237 1695 leader_election.cc:290] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.839562 1208 tablet_bootstrap.cc:492] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.842989 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467bb41a4e9f46e497726c6b29ddeb04" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:56.844096 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467bb41a4e9f46e497726c6b29ddeb04" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:56.844374 919 raft_consensus.cc:2468] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
W20260619 19:53:56.844452 996 leader_election.cc:343] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.845079 996 leader_election.cc:304] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.845553 1695 raft_consensus.cc:2804] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:56.845729 1695 raft_consensus.cc:493] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:56.845875 1695 raft_consensus.cc:3060] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.847085 1208 tablet_bootstrap.cc:654] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.847579 1832 raft_consensus.cc:515] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.849582 1695 raft_consensus.cc:515] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.852022 1695 leader_election.cc:290] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:56.852546 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467bb41a4e9f46e497726c6b29ddeb04" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:56.852751 919 raft_consensus.cc:3060] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.852936 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "467bb41a4e9f46e497726c6b29ddeb04" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:56.854004 996 leader_election.cc:343] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.854238 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b22024a0c434f8e8d4a370dbfb9a4e2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:56.854465 1060 raft_consensus.cc:3060] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.855990 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_5ba1b89a3b684c4f9927a1cefb74588d [id=cb0dfc15d9414ae3b63638e94c05c0a5]
I20260619 19:53:56.857525 919 raft_consensus.cc:2468] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:56.857703 1060 raft_consensus.cc:2468] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:56.857976 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_747e9c8819a64b7fae8a5ece57035907 [id=d0f3320ba06b47b38830db7ad44b766c]
I20260619 19:53:56.858170 859 leader_election.cc:304] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:56.858601 996 leader_election.cc:304] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:56.859175 1695 raft_consensus.cc:2804] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.859367 1695 raft_consensus.cc:697] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:56.859737 1695 consensus_queue.cc:237] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.860633 1652 raft_consensus.cc:2804] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:56.861696 1652 raft_consensus.cc:697] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:56.862241 1652 consensus_queue.cc:237] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.861956 1832 leader_election.cc:290] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:56.864696 1630 consensus_queue.cc:1048] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.852017 1331 ts_tablet_manager.cc:1929] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:56.867702 1331 log.cc:1199] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/1bc12bcf50074b46860899a82dc0b46e
I20260619 19:53:56.868432 1331 ts_tablet_manager.cc:1950] T 1bc12bcf50074b46860899a82dc0b46e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.870318 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 254) took 2115 ms. Trace:
I20260619 19:53:56.870668 1331 rpcz_store.cc:276] 0619 19:53:54.754526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.769509 (+ 14983us) service_pool.cc:224] Handling call
0619 19:53:56.770030 (+2000521us) ts_tablet_manager.cc:1151] Deleting tablet 1bc12bcf50074b46860899a82dc0b46e
0619 19:53:56.770039 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.794063 (+ 24024us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.851897 (+ 57834us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.870273 (+ 18376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2000009}
W20260619 19:53:56.871078 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 254) could send its response
I20260619 19:53:56.872769 1201 tablet_bootstrap.cc:492] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.873232 1201 ts_tablet_manager.cc:1403] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.005s
I20260619 19:53:56.884020 1331 tablet_replica.cc:333] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:56.884640 1331 raft_consensus.cc:2243] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:56.886376 1331 raft_consensus.cc:2272] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:56.889338 1331 ts_tablet_manager.cc:1916] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:56.893723 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]
I20260619 19:53:56.895542 1208 tablet_bootstrap.cc:492] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.875733 1201 raft_consensus.cc:359] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.903034 1201 raft_consensus.cc:385] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.903201 1201 raft_consensus.cc:740] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.903292 1208 ts_tablet_manager.cc:1403] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.004s
I20260619 19:53:56.903760 1201 consensus_queue.cc:260] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.906378 1208 raft_consensus.cc:359] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.906648 1208 raft_consensus.cc:385] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.908262 1628 consensus_queue.cc:1048] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.911412 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b22024a0c434f8e8d4a370dbfb9a4e2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:56.911686 784 raft_consensus.cc:3060] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:56.915297 784 raft_consensus.cc:2468] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:53:56.916455 858 leader_election.cc:343] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.917027 858 leader_election.cc:304] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:56.917430 1652 raft_consensus.cc:2749] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:56.917565 858 leader_election.cc:343] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:56.917984 1652 consensus_queue.cc:1048] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.918401 1201 ts_tablet_manager.cc:1434] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.045s user 0.003s sys 0.001s
I20260619 19:53:56.921434 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae [id=dbf8a7ab6063477b9e3bd2bd051116bf]
I20260619 19:53:56.922533 1201 tablet_bootstrap.cc:492] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:56.926185 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f]
I20260619 19:53:56.907405 1208 raft_consensus.cc:740] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.931017 1208 consensus_queue.cc:260] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.933145 1208 ts_tablet_manager.cc:1434] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260619 19:53:56.934392 1208 tablet_bootstrap.cc:492] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.935792 1200 tablet_bootstrap.cc:492] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:56.936043 1200 ts_tablet_manager.cc:1403] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.132s user 0.004s sys 0.009s
I20260619 19:53:56.935978 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]
I20260619 19:53:56.936448 1208 tablet_bootstrap.cc:654] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.937218 1200 raft_consensus.cc:359] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.937572 1200 raft_consensus.cc:385] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.937686 1200 raft_consensus.cc:740] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.938057 1200 consensus_queue.cc:260] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.938410 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_28205fd1dd524e6b8aa7a105f1a9638f [id=e21bf9fe2c944b2b801fe5304ec7f99d]
I20260619 19:53:56.941641 1201 tablet_bootstrap.cc:654] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:56.938678 1200 ts_tablet_manager.cc:1434] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:56.947974 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]
I20260619 19:53:56.950181 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8]
I20260619 19:53:56.957397 1514 consensus_queue.cc:1048] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.966741 1331 ts_tablet_manager.cc:1929] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:56.971674 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]
I20260619 19:53:56.975317 1331 log.cc:1199] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/131ccb73ea1f4a7b8781c093ea2995d1
I20260619 19:53:56.975917 1331 ts_tablet_manager.cc:1950] T 131ccb73ea1f4a7b8781c093ea2995d1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:56.976876 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 255) took 2214 ms. Trace:
I20260619 19:53:56.978160 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_89e0d67d36c34443a92db1e8c7031834 [id=ee7da39dc2234901a52a8835d106ffc9]
I20260619 19:53:56.979750 1208 tablet_bootstrap.cc:492] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:56.979986 1208 ts_tablet_manager.cc:1403] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260619 19:53:56.980854 1208 raft_consensus.cc:359] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.981148 1208 raft_consensus.cc:385] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:56.981289 1208 raft_consensus.cc:740] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:56.981633 1208 consensus_queue.cc:260] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:56.984575 1208 ts_tablet_manager.cc:1434] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:53:56.984390 1807 consensus_queue.cc:1048] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:56.988181 1331 rpcz_store.cc:276] 0619 19:53:54.763859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.789550 (+ 25691us) service_pool.cc:224] Handling call
0619 19:53:56.883909 (+2094359us) ts_tablet_manager.cc:1151] Deleting tablet 131ccb73ea1f4a7b8781c093ea2995d1
0619 19:53:56.883924 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.939562 (+ 55638us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.966652 (+ 27090us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:56.976816 (+ 10164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":522,"tablet-delete.queue_time_us":2092363}
I20260619 19:53:56.989096 1208 tablet_bootstrap.cc:492] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:56.988745 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]
W20260619 19:53:56.989306 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 255) could send its response
W20260619 19:53:56.989872 859 consensus_peers.cc:597] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 906212dd25ef46f2b381ce6a99c39343. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:56.989899 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 257) took 2161 ms. Trace:
I20260619 19:53:56.990865 1201 tablet_bootstrap.cc:492] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:56.992822 1201 ts_tablet_manager.cc:1403] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.000s
I20260619 19:53:56.995934 1331 rpcz_store.cc:276] 0619 19:53:54.828780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.834578 (+ 5798us) service_pool.cc:224] Handling call
0619 19:53:56.989728 (+2155150us) ts_tablet_manager.cc:1151] Deleting tablet 19d6333b0c8940b2802307d0da8a57ac
0619 19:53:56.989740 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.989839 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2154610}
W20260619 19:53:56.996610 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 257) could send its response
I20260619 19:53:56.997166 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 256) took 2230 ms. Trace:
I20260619 19:53:56.997975 1331 rpcz_store.cc:276] 0619 19:53:54.828500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.828804 (+ 304us) service_pool.cc:224] Handling call
0619 19:53:56.996971 (+2168167us) ts_tablet_manager.cc:1151] Deleting tablet 33935217c1f44ce0ad5b8610d368f2eb
0619 19:53:56.996984 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:56.997111 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2151431}
I20260619 19:53:56.998494 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_6597096e540440bb848c3ee8f9c3d828 [id=f16b13bbd1cf466087fe37693c83fba2]
W20260619 19:53:56.999667 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 256) could send its response
I20260619 19:53:57.000025 1331 tablet_replica.cc:333] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:57.004127 1331 raft_consensus.cc:2243] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:57.004556 1331 raft_consensus.cc:2272] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:57.005020 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d]
I20260619 19:53:57.005307 1201 raft_consensus.cc:359] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.000669 1695 consensus_queue.cc:1048] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.007983 1201 raft_consensus.cc:385] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.008862 1200 tablet_bootstrap.cc:492] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.009246 1201 raft_consensus.cc:740] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.011264 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]
I20260619 19:53:57.014909 1331 ts_tablet_manager.cc:1916] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:57.012651 1201 consensus_queue.cc:260] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.015552 1208 tablet_bootstrap.cc:654] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.019312 1201 ts_tablet_manager.cc:1434] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260619 19:53:57.019753 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]
I20260619 19:53:57.022069 1201 tablet_bootstrap.cc:492] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.023248 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_09a6a4004a244d5087ee5476d0d28299 [id=f58a91c6f29e4958b3de00addcb87fec]
I20260619 19:53:57.025710 1695 consensus_queue.cc:1048] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.028357 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]
W20260619 19:53:57.031859 720 consensus_peers.cc:597] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:57.039954 1201 tablet_bootstrap.cc:654] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.040053 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]
I20260619 19:53:57.046449 1208 tablet_bootstrap.cc:492] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.046900 1208 ts_tablet_manager.cc:1403] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.000s
I20260619 19:53:57.048548 1331 ts_tablet_manager.cc:1929] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:57.048800 1208 raft_consensus.cc:359] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.049229 1208 raft_consensus.cc:385] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.049697 1208 raft_consensus.cc:740] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.050599 1331 log.cc:1199] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/304e1eed89f54b809ac52efe2226dc35
I20260619 19:53:57.050601 1697 catalog_manager.cc:679] Loaded metadata for table default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292]
I20260619 19:53:57.051477 1331 ts_tablet_manager.cc:1950] T 304e1eed89f54b809ac52efe2226dc35 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:57.052033 1632 raft_consensus.cc:493] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.052280 1632 raft_consensus.cc:515] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.051187 1208 consensus_queue.cc:260] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.053628 1632 leader_election.cc:290] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.057930 1208 ts_tablet_manager.cc:1434] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260619 19:53:57.058596 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2448429656934063887b63d9a6e79894" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.054216 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2448429656934063887b63d9a6e79894" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.058907 918 raft_consensus.cc:2468] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:57.059156 1060 raft_consensus.cc:2468] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:57.059451 719 leader_election.cc:304] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.060185 1632 raft_consensus.cc:2804] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.060377 1632 raft_consensus.cc:493] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.063056 1632 raft_consensus.cc:3060] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.065941 1208 tablet_bootstrap.cc:492] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.067377 1331 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 252) took 2313 ms. Trace:
I20260619 19:53:57.067371 1632 raft_consensus.cc:515] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.067701 1331 rpcz_store.cc:276] 0619 19:53:54.754181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.839410 (+ 85229us) service_pool.cc:224] Handling call
0619 19:53:56.999938 (+2160528us) ts_tablet_manager.cc:1151] Deleting tablet 304e1eed89f54b809ac52efe2226dc35
0619 19:53:56.999949 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:57.038658 (+ 38709us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:57.048449 (+ 9791us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:57.067317 (+ 18868us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2136757}
W20260619 19:53:57.068203 994 connection.cc:466] server connection from 127.0.0.1:55584 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55584 (request call id 252) could send its response
I20260619 19:53:57.068607 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2448429656934063887b63d9a6e79894" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.068845 918 raft_consensus.cc:3060] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.075168 1632 leader_election.cc:290] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:57.075417 720 consensus_peers.cc:597] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37393d7c16594032bf2a69abb0ab5931. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:57.075675 918 raft_consensus.cc:2468] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:57.076140 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2448429656934063887b63d9a6e79894" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:57.076408 1060 raft_consensus.cc:3060] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.076653 719 leader_election.cc:304] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.078974 1514 raft_consensus.cc:493] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.079159 1514 raft_consensus.cc:515] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.079463 1060 raft_consensus.cc:2468] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:57.079878 1514 leader_election.cc:290] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.080005 1632 raft_consensus.cc:2804] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.080540 1632 raft_consensus.cc:697] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:57.080540 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65f88b43b4e45c481aa7d43ef59fe7a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.080724 1060 raft_consensus.cc:2468] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:57.080855 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65f88b43b4e45c481aa7d43ef59fe7a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.080926 1632 consensus_queue.cc:237] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.081044 784 raft_consensus.cc:2468] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:57.081276 859 leader_election.cc:304] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.081549 1514 raft_consensus.cc:2804] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.081664 1514 raft_consensus.cc:493] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.081763 1514 raft_consensus.cc:3060] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.081884 1208 tablet_bootstrap.cc:654] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.082806 1200 tablet_bootstrap.cc:654] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.084859 1514 raft_consensus.cc:515] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.089035 1514 leader_election.cc:290] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.089062 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65f88b43b4e45c481aa7d43ef59fe7a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:57.089267 784 raft_consensus.cc:3060] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.092602 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65f88b43b4e45c481aa7d43ef59fe7a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:57.092816 1060 raft_consensus.cc:3060] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.093894 784 raft_consensus.cc:2468] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:57.094393 858 leader_election.cc:304] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.094784 1835 raft_consensus.cc:2804] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.094936 1835 raft_consensus.cc:697] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:57.095275 1835 consensus_queue.cc:237] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.096341 1060 raft_consensus.cc:2468] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:57.098695 1832 consensus_queue.cc:1048] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.112257 1201 tablet_bootstrap.cc:492] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.113735 1201 ts_tablet_manager.cc:1403] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.007s
I20260619 19:53:57.114816 1201 raft_consensus.cc:359] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.117784 1201 raft_consensus.cc:385] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.121632 1807 consensus_queue.cc:1048] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.123482 1786 consensus_queue.cc:1048] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.125970 1201 raft_consensus.cc:740] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.128628 1201 consensus_queue.cc:260] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.132110 1621 consensus_queue.cc:1048] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 19:53:57.135973 1201 ts_tablet_manager.cc:1434] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260619 19:53:57.139185 1201 tablet_bootstrap.cc:492] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.143826 1201 tablet_bootstrap.cc:654] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.155381 1632 raft_consensus.cc:493] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.155779 1632 raft_consensus.cc:515] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.157490 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297f07f2d08d47dfa69f845dadb973b1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.159029 1632 leader_election.cc:290] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.159057 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "297f07f2d08d47dfa69f845dadb973b1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.159438 1056 raft_consensus.cc:2393] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:57.159978 720 leader_election.cc:304] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.159940 1697 tablet_loader.cc:96] loaded metadata for tablet 08ef46cfced54742832fd3c01f952a9d (table default.Table_8d50f1b1ec814e8d85b077e1eb08a18c [id=c128b2a4a40748dabd196e9703c43254])
I20260619 19:53:57.160620 1632 raft_consensus.cc:3060] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.166702 1786 raft_consensus.cc:493] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.166893 1786 raft_consensus.cc:515] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:57.167861 1786 leader_election.cc:290] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.168676 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.169967 1056 raft_consensus.cc:2393] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:57.169888 1695 consensus_queue.cc:1048] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.170058 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.170962 719 leader_election.cc:304] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.171769 1632 raft_consensus.cc:2749] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.171770 1786 raft_consensus.cc:3060] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.173794 1697 tablet_loader.cc:96] loaded metadata for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_20dc9175b4c84bc6ac2546afae733eca [id=52998f068e554dd7b19f353a041fda6a])
I20260619 19:53:57.175061 1786 raft_consensus.cc:2749] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.176771 1697 tablet_loader.cc:96] loaded metadata for tablet 0b55debc1b064192a56d2453364ba260 (table default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7])
I20260619 19:53:57.177630 1208 tablet_bootstrap.cc:492] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.179165 1208 ts_tablet_manager.cc:1403] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.114s user 0.004s sys 0.016s
I20260619 19:53:57.180652 1697 tablet_loader.cc:96] loaded metadata for tablet 0dd210e843db4f58a976af5c28dabc9c (table default.Table_fa6e27c7a16c411e91a2913fda307afb [id=2daa177012434787b804b7721c3f91d2])
I20260619 19:53:57.183588 1201 tablet_bootstrap.cc:492] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.183890 1208 raft_consensus.cc:359] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.184221 1208 raft_consensus.cc:385] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.184355 1208 raft_consensus.cc:740] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.184721 1208 consensus_queue.cc:260] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.185371 1201 ts_tablet_manager.cc:1403] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260619 19:53:57.186086 1208 ts_tablet_manager.cc:1434] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:53:57.186244 1697 tablet_loader.cc:96] loaded metadata for tablet 108f1b2e9ec74271889ffff65d8e852e (table default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d])
I20260619 19:53:57.186415 1201 raft_consensus.cc:359] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.186619 1201 raft_consensus.cc:385] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.186671 1208 tablet_bootstrap.cc:492] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.186698 1201 raft_consensus.cc:740] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.186968 1201 consensus_queue.cc:260] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.187644 1201 ts_tablet_manager.cc:1434] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:57.188010 1201 tablet_bootstrap.cc:492] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.188513 1697 tablet_loader.cc:96] loaded metadata for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_30932010f9e54c029a0c57b5c379957e [id=6d7c9506a27b4a70a32958a89c72c202])
I20260619 19:53:57.189118 1208 tablet_bootstrap.cc:654] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.190277 1697 tablet_loader.cc:96] loaded metadata for tablet 1202fe45d0964d368989f969e95f880d (table default.Table_813fc3596f604c7a99d0ac0c6c42a5e0 [id=41f6ba3e85b04574878f66c6f98d60ff])
I20260619 19:53:57.201786 1832 consensus_queue.cc:1048] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.198731 1200 tablet_bootstrap.cc:492] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.203657 1200 ts_tablet_manager.cc:1403] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.195s user 0.002s sys 0.009s
I20260619 19:53:57.206470 1200 raft_consensus.cc:359] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.206895 1200 raft_consensus.cc:385] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.207067 1200 raft_consensus.cc:740] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.207101 1621 raft_consensus.cc:493] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.207315 1621 raft_consensus.cc:515] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.208433 1621 leader_election.cc:290] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.208910 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a686826694b49b9bb5bcdefd61c9a15" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.209602 858 leader_election.cc:343] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.208902 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a686826694b49b9bb5bcdefd61c9a15" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:57.210530 859 leader_election.cc:343] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.210695 859 leader_election.cc:304] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.210963 1200 consensus_queue.cc:260] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.211277 1621 raft_consensus.cc:2749] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.211666 1201 tablet_bootstrap.cc:654] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.215451 1697 tablet_loader.cc:96] loaded metadata for tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_ff9ca3289e4b45ba86c2ab483ea08d30 [id=96dda797fa474e119e765b5d9946bfb7])
I20260619 19:53:57.217649 1697 tablet_loader.cc:96] loaded metadata for tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a])
I20260619 19:53:57.221215 1697 tablet_loader.cc:96] loaded metadata for tablet 26355bc6b5c147a88c14a9f053b4e1f3 (table default.Table_5397e7b4951344259694a66e18f7fd6f [id=173145ae0ed048a08221a123efe05b12])
I20260619 19:53:57.223604 1697 tablet_loader.cc:96] loaded metadata for tablet 268c752e60624f96b37b0afab2d994e3 (table default.Table_f499d3b7eac649a7b6f05c64db213152 [id=62118399790b4ce49c35ec8cfe23ca5d])
I20260619 19:53:57.228439 1200 ts_tablet_manager.cc:1434] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260619 19:53:57.228526 1697 tablet_loader.cc:96] loaded metadata for tablet 28e463032d0744cc88d011accbebfe1f (table default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a])
I20260619 19:53:57.234058 1697 tablet_loader.cc:96] loaded metadata for tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_49472f6375c04623bbaba293eb98dd6f [id=8d6402c45a4d4456935a213be45b3c51])
I20260619 19:53:57.235191 1201 tablet_bootstrap.cc:492] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.235363 1201 ts_tablet_manager.cc:1403] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
I20260619 19:53:57.236312 1201 raft_consensus.cc:359] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.236559 1201 raft_consensus.cc:385] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.236691 1201 raft_consensus.cc:740] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.237052 1201 consensus_queue.cc:260] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.237205 1697 tablet_loader.cc:96] loaded metadata for tablet 29e73d38af8241b29b8d47a5f9db1834 (table default.Table_318e69014c974faabdc436cbeec6cbdc [id=7ebab8e3fd93430aa6d2a429f2dca4f7])
I20260619 19:53:57.240666 1697 tablet_loader.cc:96] loaded metadata for tablet 2b1fdec7ead34f9188d73507cf1c620a (table default.Table_38edae940f8c454286821ba5a5703a7f [id=388e0d04a45e495aa4e3bbc05802a988])
I20260619 19:53:57.246682 1807 raft_consensus.cc:493] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.246913 1807 raft_consensus.cc:515] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.247805 1807 leader_election.cc:290] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.251384 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3fa43017fa4c278111c29d0d22f7da" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.251675 1201 ts_tablet_manager.cc:1434] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260619 19:53:57.252075 1201 tablet_bootstrap.cc:492] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.252709 1697 tablet_loader.cc:96] loaded metadata for tablet 3064bd01ced9429d82ce449e8afc4999 (table default.Table_89e0d67d36c34443a92db1e8c7031834 [id=ee7da39dc2234901a52a8835d106ffc9])
I20260619 19:53:57.253104 1630 consensus_queue.cc:1048] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.254711 1697 tablet_loader.cc:96] loaded metadata for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_721d0ea740aa432590e6d491422cd791 [id=ff393d500bb34f318889666cc5650292])
I20260619 19:53:57.256342 1201 tablet_bootstrap.cc:654] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.258203 1697 tablet_loader.cc:96] loaded metadata for tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665])
I20260619 19:53:57.259256 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3fa43017fa4c278111c29d0d22f7da" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.259637 785 raft_consensus.cc:2393] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:57.260311 996 leader_election.cc:304] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:57.260650 1807 raft_consensus.cc:3060] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.261932 1697 tablet_loader.cc:96] loaded metadata for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (table default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8])
I20260619 19:53:57.262439 1200 tablet_bootstrap.cc:492] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.263891 1807 raft_consensus.cc:2749] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.266287 1200 tablet_bootstrap.cc:654] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.267079 1786 raft_consensus.cc:493] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.267156 1621 consensus_queue.cc:1048] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.267295 1786 raft_consensus.cc:515] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.267938 1786 leader_election.cc:290] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.269485 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e463032d0744cc88d011accbebfe1f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.269804 1059 raft_consensus.cc:2393] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:57.270223 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e463032d0744cc88d011accbebfe1f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.271318 720 leader_election.cc:304] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.271718 1630 raft_consensus.cc:3060] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.273821 1208 tablet_bootstrap.cc:492] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.274021 1208 ts_tablet_manager.cc:1403] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.088s user 0.000s sys 0.020s
I20260619 19:53:57.274785 1630 raft_consensus.cc:2749] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.274940 1208 raft_consensus.cc:359] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.275920 1208 raft_consensus.cc:385] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.276014 1208 raft_consensus.cc:740] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.276244 1208 consensus_queue.cc:260] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.277011 1208 ts_tablet_manager.cc:1434] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:53:57.277529 1208 tablet_bootstrap.cc:492] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.283495 1201 tablet_bootstrap.cc:492] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.283746 1201 ts_tablet_manager.cc:1403] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.001s
I20260619 19:53:57.284729 1201 raft_consensus.cc:359] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.286923 1201 raft_consensus.cc:385] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.287014 1201 raft_consensus.cc:740] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.288625 1201 consensus_queue.cc:260] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.289263 1201 ts_tablet_manager.cc:1434] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:53:57.289629 1201 tablet_bootstrap.cc:492] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.290510 1659 consensus_queue.cc:1048] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.290115 1697 tablet_loader.cc:96] loaded metadata for tablet 33cfbae501de432cbcb34d2a6365f806 (table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581])
I20260619 19:53:57.292217 1201 tablet_bootstrap.cc:654] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.293427 1208 tablet_bootstrap.cc:654] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.299722 1621 raft_consensus.cc:493] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.299963 1621 raft_consensus.cc:515] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.300796 1621 leader_election.cc:290] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.301817 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d212a279754f2497ad4fc2a3c8b5c3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.302429 858 leader_election.cc:343] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.303010 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d212a279754f2497ad4fc2a3c8b5c3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.303244 1060 raft_consensus.cc:2468] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:57.303718 859 leader_election.cc:304] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:57.304137 1208 tablet_bootstrap.cc:492] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.304169 1621 raft_consensus.cc:2804] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.304275 1621 raft_consensus.cc:493] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.304373 1621 raft_consensus.cc:3060] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.304387 1208 ts_tablet_manager.cc:1403] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
I20260619 19:53:57.305153 1208 raft_consensus.cc:359] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.305342 1208 raft_consensus.cc:385] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.305411 1208 raft_consensus.cc:740] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.305660 1208 consensus_queue.cc:260] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.306177 1208 ts_tablet_manager.cc:1434] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:57.306480 1208 tablet_bootstrap.cc:492] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.300822 1201 tablet_bootstrap.cc:492] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.307323 1201 ts_tablet_manager.cc:1403] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20260619 19:53:57.308614 1208 tablet_bootstrap.cc:654] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.309746 1621 raft_consensus.cc:515] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.310355 1201 raft_consensus.cc:359] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.310534 1201 raft_consensus.cc:385] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.310621 1201 raft_consensus.cc:740] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.310833 1201 consensus_queue.cc:260] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.311882 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d212a279754f2497ad4fc2a3c8b5c3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:57.312595 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d212a279754f2497ad4fc2a3c8b5c3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:53:57.312696 858 leader_election.cc:343] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.312824 1060 raft_consensus.cc:3060] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.312953 1621 leader_election.cc:290] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.315910 1060 raft_consensus.cc:2468] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:57.316078 1697 tablet_loader.cc:96] loaded metadata for tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3])
I20260619 19:53:57.316584 859 leader_election.cc:304] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:57.317507 1201 ts_tablet_manager.cc:1434] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260619 19:53:57.317509 1621 raft_consensus.cc:2804] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.317824 1201 tablet_bootstrap.cc:492] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.317946 1621 raft_consensus.cc:697] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:57.318288 1621 consensus_queue.cc:237] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.319725 1201 tablet_bootstrap.cc:654] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.323999 1697 tablet_loader.cc:96] loaded metadata for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472])
I20260619 19:53:57.328583 1697 tablet_loader.cc:96] loaded metadata for tablet 369cb2f2b599469680eed94a221c2f27 (table default.Table_c2dbeec92873437ab12eedf151dbd3ad [id=0030f2fdb14a4d4d850c1f61d7135a21])
I20260619 19:53:57.330878 1832 consensus_queue.cc:1048] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.342510 1807 raft_consensus.cc:493] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.342692 1807 raft_consensus.cc:515] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.343339 1807 leader_election.cc:290] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:53:57.344568 859 consensus_peers.cc:597] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd9c959792fa48e89b669520f7332b26. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:57.344758 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b7b743e594e2aaeaeedd8613d9789" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.344967 785 raft_consensus.cc:2468] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.345316 996 leader_election.cc:304] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.345625 1807 raft_consensus.cc:2804] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.345752 1807 raft_consensus.cc:493] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.345888 1807 raft_consensus.cc:3060] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.348826 1807 raft_consensus.cc:515] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.350376 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b7b743e594e2aaeaeedd8613d9789" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:57.350435 1807 leader_election.cc:290] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.350608 784 raft_consensus.cc:3060] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.350904 1200 tablet_bootstrap.cc:492] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.351063 1200 ts_tablet_manager.cc:1403] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.001s
I20260619 19:53:57.351866 1200 raft_consensus.cc:359] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.352058 1200 raft_consensus.cc:385] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.352129 1200 raft_consensus.cc:740] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.352357 1200 consensus_queue.cc:260] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.352432 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b7b743e594e2aaeaeedd8613d9789" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.352628 919 raft_consensus.cc:2468] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.352859 1200 ts_tablet_manager.cc:1434] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:57.353154 1200 tablet_bootstrap.cc:492] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.353425 784 raft_consensus.cc:2468] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.355031 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b7b743e594e2aaeaeedd8613d9789" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.355243 919 raft_consensus.cc:3060] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.356269 996 leader_election.cc:304] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.356707 1832 consensus_queue.cc:1048] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.357519 1807 raft_consensus.cc:2804] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.358039 1807 raft_consensus.cc:697] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:57.358376 1807 consensus_queue.cc:237] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.360399 1200 tablet_bootstrap.cc:654] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.363397 1832 consensus_queue.cc:1048] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.367067 1208 tablet_bootstrap.cc:492] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.368319 1208 ts_tablet_manager.cc:1403] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.001s
I20260619 19:53:57.369632 1208 raft_consensus.cc:359] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.369841 1621 raft_consensus.cc:493] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.370118 1621 raft_consensus.cc:515] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.371304 1208 raft_consensus.cc:385] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.371647 1208 raft_consensus.cc:740] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.372278 1208 consensus_queue.cc:260] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.374835 1208 ts_tablet_manager.cc:1434] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260619 19:53:57.376222 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef20e35c612400bbbf1c707a36ced8c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.376511 785 raft_consensus.cc:2468] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:57.377146 858 leader_election.cc:304] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.377243 1208 tablet_bootstrap.cc:492] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.377550 1832 raft_consensus.cc:2804] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.377578 1621 leader_election.cc:290] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.377665 1832 raft_consensus.cc:493] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.377775 1832 raft_consensus.cc:3060] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.379244 1208 tablet_bootstrap.cc:654] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:57.385010 859 leader_election.cc:343] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6ef20e35c612400bbbf1c707a36ced8c
I20260619 19:53:57.392097 1201 tablet_bootstrap.cc:492] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.392295 1201 ts_tablet_manager.cc:1403] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.003s
I20260619 19:53:57.393069 1697 tablet_loader.cc:96] loaded metadata for tablet 3be362aa28504b729801de35d869beac (table default.Table_7fce2193633d4d80b56750d4df0c8e90 [id=4571c7fa9c1f4c478238240370b24d9f])
I20260619 19:53:57.393075 1201 raft_consensus.cc:359] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.393234 919 raft_consensus.cc:2468] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.393286 1201 raft_consensus.cc:385] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.393357 1201 raft_consensus.cc:740] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.393497 1697 tablet_loader.cc:96] loaded metadata for tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c])
I20260619 19:53:57.393596 1201 consensus_queue.cc:260] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.393962 1697 tablet_loader.cc:96] loaded metadata for tablet 41455237399b45efbe8190dcb01e764c (table default.Table_516e7616f9ea454fbe587f5be52a3c55 [id=af3f4335b675482195a6511647ca2871])
I20260619 19:53:57.394133 1201 ts_tablet_manager.cc:1434] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:57.394392 1697 tablet_loader.cc:96] loaded metadata for tablet 42a3f254125141bf8783626e669717d2 (table default.Table_a918fc9dd9df4b9d928067cbd4dd0756 [id=b3d6c18b7ce64c23a0c84bde930aa147])
I20260619 19:53:57.394474 1201 tablet_bootstrap.cc:492] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.394795 1697 tablet_loader.cc:96] loaded metadata for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60])
I20260619 19:53:57.398789 1832 raft_consensus.cc:515] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.403255 1621 raft_consensus.cc:493] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.408987 1621 raft_consensus.cc:515] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.409515 1621 leader_election.cc:290] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.403683 1840 consensus_queue.cc:1048] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260619 19:53:57.410084 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.408695 1652 consensus_queue.cc:1048] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:53:57.410548 858 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.410657 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.410822 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef20e35c612400bbbf1c707a36ced8c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:57.411021 784 raft_consensus.cc:3060] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:57.411199 859 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.411325 859 leader_election.cc:304] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.411877 1652 raft_consensus.cc:2749] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.416615 1201 tablet_bootstrap.cc:654] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.420707 1652 consensus_queue.cc:1048] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.413862 784 raft_consensus.cc:2468] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:57.421397 858 leader_election.cc:304] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.421701 1652 raft_consensus.cc:2804] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.421842 1652 raft_consensus.cc:697] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:57.422159 1652 consensus_queue.cc:237] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.422382 1832 leader_election.cc:290] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.424247 1201 tablet_bootstrap.cc:492] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.424453 1201 ts_tablet_manager.cc:1403] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260619 19:53:57.425371 1201 raft_consensus.cc:359] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.425565 1201 raft_consensus.cc:385] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.425673 1201 raft_consensus.cc:740] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.425951 1201 consensus_queue.cc:260] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.426506 1201 ts_tablet_manager.cc:1434] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260619 19:53:57.426646 859 leader_election.cc:343] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6ef20e35c612400bbbf1c707a36ced8c
I20260619 19:53:57.427984 1201 tablet_bootstrap.cc:492] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.430555 1201 tablet_bootstrap.cc:654] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:57.449267 859 consensus_peers.cc:597] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f25c0378a6f4e9ea1a62d98f27778ee. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:57.453096 1200 tablet_bootstrap.cc:492] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.453356 1200 ts_tablet_manager.cc:1403] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.100s user 0.006s sys 0.017s
I20260619 19:53:57.454677 1200 raft_consensus.cc:359] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.454964 1200 raft_consensus.cc:385] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.455089 1200 raft_consensus.cc:740] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.455495 1200 consensus_queue.cc:260] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.456316 1200 ts_tablet_manager.cc:1434] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:57.456766 1200 tablet_bootstrap.cc:492] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.471385 1201 tablet_bootstrap.cc:492] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.471813 1201 ts_tablet_manager.cc:1403] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.022s
I20260619 19:53:57.478730 1201 raft_consensus.cc:359] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.479302 1201 raft_consensus.cc:385] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.479665 1201 raft_consensus.cc:740] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.481058 1201 consensus_queue.cc:260] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.485733 1697 tablet_loader.cc:96] loaded metadata for tablet 46dcf2293e2d461ca1be171069867d1f (table default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848])
I20260619 19:53:57.486903 1697 tablet_loader.cc:96] loaded metadata for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (table default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b [id=57b57ad63a674bf08da4cf6d7bcd1b4e])
I20260619 19:53:57.497144 1201 ts_tablet_manager.cc:1434] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.025s user 0.002s sys 0.002s
I20260619 19:53:57.499100 1697 tablet_loader.cc:96] loaded metadata for tablet 4b88dd7d19514e83857e2c6108291b9f (table default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f])
I20260619 19:53:57.500454 1697 tablet_loader.cc:96] loaded metadata for tablet 53ff57208565495480920b6eaaff9295 (table default.Table_e902d26af2734b138a7beda9b1fc800c [id=3c9da136fa6d4578a5ad210801a2ccea])
I20260619 19:53:57.503266 1201 tablet_bootstrap.cc:492] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.513154 1697 tablet_loader.cc:96] loaded metadata for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1])
I20260619 19:53:57.513643 1697 tablet_loader.cc:96] loaded metadata for tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed])
I20260619 19:53:57.514057 1697 tablet_loader.cc:96] loaded metadata for tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413])
I20260619 19:53:57.514482 1697 tablet_loader.cc:96] loaded metadata for tablet 59123a56731645e1bbfcc94b2a46b1d6 (table default.Table_e170513f38a14ffcaceccb5ee9052c80 [id=8eedaa1e27904cadb0b52ab19f4c43ff])
I20260619 19:53:57.518297 1200 tablet_bootstrap.cc:654] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.519982 1208 tablet_bootstrap.cc:492] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.520264 1208 ts_tablet_manager.cc:1403] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.143s user 0.002s sys 0.021s
I20260619 19:53:57.520515 1835 consensus_queue.cc:1048] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.521279 1208 raft_consensus.cc:359] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.521585 1208 raft_consensus.cc:385] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.521715 1208 raft_consensus.cc:740] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.522078 1208 consensus_queue.cc:260] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.522688 1208 ts_tablet_manager.cc:1434] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:53:57.523145 1208 tablet_bootstrap.cc:492] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.525107 1208 tablet_bootstrap.cc:654] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.533216 1697 tablet_loader.cc:96] loaded metadata for tablet 5d772e0bd2d4420f836fa14ca2dadb24 (table default.Table_6597096e540440bb848c3ee8f9c3d828 [id=f16b13bbd1cf466087fe37693c83fba2])
I20260619 19:53:57.533836 1697 tablet_loader.cc:96] loaded metadata for tablet 5ea9f17d5e75499a8433fc9a3043a88e (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f])
I20260619 19:53:57.535881 1201 tablet_bootstrap.cc:654] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.536777 1697 tablet_loader.cc:96] loaded metadata for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26])
I20260619 19:53:57.538681 1697 tablet_loader.cc:96] loaded metadata for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277])
I20260619 19:53:57.541070 1697 tablet_loader.cc:96] loaded metadata for tablet 68788824224b426bb433b87763073bae (table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360])
I20260619 19:53:57.542095 1208 tablet_bootstrap.cc:492] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.542253 1832 raft_consensus.cc:493] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.542352 1208 ts_tablet_manager.cc:1403] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260619 19:53:57.542452 1832 raft_consensus.cc:515] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.543035 1832 leader_election.cc:290] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.543555 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.543712 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.543887 1832 raft_consensus.cc:493] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.544045 1832 raft_consensus.cc:515] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:57.544131 858 leader_election.cc:343] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.544629 1832 leader_election.cc:290] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.544914 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.544983 859 leader_election.cc:343] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.545104 859 leader_election.cc:304] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.545172 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:57.545362 858 leader_election.cc:343] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:57.545661 859 leader_election.cc:343] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.545779 859 leader_election.cc:304] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.546118 1835 raft_consensus.cc:2749] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.546169 1200 tablet_bootstrap.cc:492] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.546288 1835 raft_consensus.cc:2749] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.546335 1200 ts_tablet_manager.cc:1403] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.002s
I20260619 19:53:57.547092 1200 raft_consensus.cc:359] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.547369 1200 raft_consensus.cc:385] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.547487 1200 raft_consensus.cc:740] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.547816 1200 consensus_queue.cc:260] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.543219 1208 raft_consensus.cc:359] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.554113 1208 raft_consensus.cc:385] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.554947 1697 tablet_loader.cc:96] loaded metadata for tablet 6b9cdbff79734eb7ac6590bdd40eadf0 (table default.Table_6159673514964291b9b99a452f0f51dc [id=10db403faff64a3982ea32a736a9d0f5])
I20260619 19:53:57.555205 1208 raft_consensus.cc:740] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.555962 1200 ts_tablet_manager.cc:1434] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:53:57.557680 1208 consensus_queue.cc:260] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.558257 1659 raft_consensus.cc:493] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.561669 1659 raft_consensus.cc:515] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.562505 1659 leader_election.cc:290] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.562747 1200 tablet_bootstrap.cc:492] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.563019 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1fdec7ead34f9188d73507cf1c620a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.563290 919 raft_consensus.cc:2468] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:57.563405 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1fdec7ead34f9188d73507cf1c620a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.563642 1060 raft_consensus.cc:2468] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:57.563941 719 leader_election.cc:304] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.564714 1630 raft_consensus.cc:2804] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.564846 1630 raft_consensus.cc:493] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.564970 1630 raft_consensus.cc:3060] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.567874 1630 raft_consensus.cc:515] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.569402 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1fdec7ead34f9188d73507cf1c620a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:57.569617 1060 raft_consensus.cc:3060] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.570290 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1fdec7ead34f9188d73507cf1c620a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.570470 919 raft_consensus.cc:3060] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.572553 1060 raft_consensus.cc:2468] T 2b1fdec7ead34f9188d73507cf1c620a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:57.573163 720 leader_election.cc:304] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.573429 919 raft_consensus.cc:2468] T 2b1fdec7ead34f9188d73507cf1c620a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:57.573649 1659 raft_consensus.cc:2804] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.573827 1659 raft_consensus.cc:697] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:57.574136 1659 consensus_queue.cc:237] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.575498 1630 leader_election.cc:290] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.580554 1208 ts_tablet_manager.cc:1434] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.038s user 0.003s sys 0.000s
I20260619 19:53:57.581146 1697 tablet_loader.cc:96] loaded metadata for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_5315cb7e69284c01ab36267884d6abf5 [id=b9dc702105844f9a8864d15332e30313])
I20260619 19:53:57.581772 1208 tablet_bootstrap.cc:492] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.584702 1697 tablet_loader.cc:96] loaded metadata for tablet 71d212a279754f2497ad4fc2a3c8b5c3 (table default.Table_09a6a4004a244d5087ee5476d0d28299 [id=f58a91c6f29e4958b3de00addcb87fec])
I20260619 19:53:57.587016 1208 tablet_bootstrap.cc:654] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.591107 1200 tablet_bootstrap.cc:654] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.592453 1201 tablet_bootstrap.cc:492] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.592981 1201 ts_tablet_manager.cc:1403] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.005s
I20260619 19:53:57.596055 1201 raft_consensus.cc:359] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.597455 1201 raft_consensus.cc:385] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.598033 1201 raft_consensus.cc:740] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.599248 1201 consensus_queue.cc:260] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.602267 1201 ts_tablet_manager.cc:1434] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260619 19:53:57.603790 1201 tablet_bootstrap.cc:492] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.606304 1697 tablet_loader.cc:96] loaded metadata for tablet 74949d09466f42e2852389e10192989d (table default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34])
I20260619 19:53:57.606421 1807 raft_consensus.cc:493] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.606606 1807 raft_consensus.cc:515] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.610760 1807 leader_election.cc:290] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.611595 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cfbae501de432cbcb34d2a6365f806" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.611811 919 raft_consensus.cc:2468] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.611908 1200 tablet_bootstrap.cc:492] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.612062 1200 ts_tablet_manager.cc:1403] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.007s
I20260619 19:53:57.612357 996 leader_election.cc:304] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.612651 1807 raft_consensus.cc:2804] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.612753 1807 raft_consensus.cc:493] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.612836 1807 raft_consensus.cc:3060] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.615680 1807 raft_consensus.cc:515] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.617274 1060 raft_consensus.cc:3060] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.621095 1807 leader_election.cc:290] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.621575 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cfbae501de432cbcb34d2a6365f806" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.621855 1201 tablet_bootstrap.cc:654] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.621915 919 raft_consensus.cc:3060] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.622130 1200 raft_consensus.cc:359] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.622303 1200 raft_consensus.cc:385] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.622403 1200 raft_consensus.cc:740] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.625330 1200 consensus_queue.cc:260] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.625898 919 raft_consensus.cc:2468] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.626325 996 leader_election.cc:304] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.626678 1628 raft_consensus.cc:2804] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.626829 1628 raft_consensus.cc:697] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:57.627101 1628 consensus_queue.cc:237] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.634217 1832 consensus_queue.cc:1048] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.637974 1201 tablet_bootstrap.cc:492] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.638550 1201 ts_tablet_manager.cc:1403] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.002s
I20260619 19:53:57.641080 1201 raft_consensus.cc:359] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.641708 1201 raft_consensus.cc:385] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.641997 1201 raft_consensus.cc:740] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.642825 1201 consensus_queue.cc:260] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.645737 1201 ts_tablet_manager.cc:1434] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260619 19:53:57.647497 1201 tablet_bootstrap.cc:492] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.648541 1200 ts_tablet_manager.cc:1434] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20260619 19:53:57.648968 1200 tablet_bootstrap.cc:492] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.610139 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cfbae501de432cbcb34d2a6365f806" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.653141 785 raft_consensus.cc:2468] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.616902 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33cfbae501de432cbcb34d2a6365f806" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:57.621474 1659 consensus_queue.cc:1048] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 19:53:57.653463 784 raft_consensus.cc:3060] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.656293 784 raft_consensus.cc:2468] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.658739 1201 tablet_bootstrap.cc:654] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.667589 1832 raft_consensus.cc:493] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.667786 1832 raft_consensus.cc:515] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.668468 1832 leader_election.cc:290] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.669427 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75baa585102481fa0ea01e87e394e32" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:57.669983 859 leader_election.cc:343] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.670130 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75baa585102481fa0ea01e87e394e32" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.670413 1695 consensus_queue.cc:1048] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:53:57.670598 858 leader_election.cc:343] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.670733 858 leader_election.cc:304] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.670974 1832 raft_consensus.cc:2749] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.671649 1697 tablet_loader.cc:96] loaded metadata for tablet 74f39941c13847d79e2b2c3ddd176533 (table default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd])
I20260619 19:53:57.672158 1697 tablet_loader.cc:96] loaded metadata for tablet 76ffe451545c4af6821971384fce483e (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc])
I20260619 19:53:57.672587 1697 tablet_loader.cc:96] loaded metadata for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d])
I20260619 19:53:57.673475 1697 tablet_loader.cc:96] loaded metadata for tablet 7dc1a472e7aa49639212a41619eabff3 (table default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 [id=7f1a06b87720448aba53d5447e938e0b])
I20260619 19:53:57.674353 1697 tablet_loader.cc:96] loaded metadata for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_28205fd1dd524e6b8aa7a105f1a9638f [id=e21bf9fe2c944b2b801fe5304ec7f99d])
I20260619 19:53:57.676334 1200 tablet_bootstrap.cc:654] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.686403 1695 consensus_queue.cc:1048] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.690991 1208 tablet_bootstrap.cc:492] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.691318 1208 ts_tablet_manager.cc:1403] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.110s user 0.005s sys 0.000s
I20260619 19:53:57.692611 1840 consensus_queue.cc:1048] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.694674 1208 raft_consensus.cc:359] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.694998 1208 raft_consensus.cc:385] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.705752 1200 tablet_bootstrap.cc:492] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.706730 1200 ts_tablet_manager.cc:1403] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260619 19:53:57.707978 1200 raft_consensus.cc:359] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.708686 1208 raft_consensus.cc:740] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.709295 1697 tablet_loader.cc:96] loaded metadata for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_33d4ef8901924ac38b9500db539f2257 [id=b0c20277b82e48e096fc0ea8d3053c55])
I20260619 19:53:57.709705 1208 consensus_queue.cc:260] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.711673 1697 tablet_loader.cc:96] loaded metadata for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c])
I20260619 19:53:57.712559 1208 ts_tablet_manager.cc:1434] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260619 19:53:57.712837 1200 raft_consensus.cc:385] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.713995 1840 consensus_queue.cc:1048] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.729665 1200 raft_consensus.cc:740] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.730254 1200 consensus_queue.cc:260] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.732015 1200 ts_tablet_manager.cc:1434] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260619 19:53:57.733073 1200 tablet_bootstrap.cc:492] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.737422 1697 tablet_loader.cc:96] loaded metadata for tablet 8bc11c632b514118856ea4c11b431142 (table default.Table_1e665d03a8764d998282ef50afaa6b12 [id=814802093a404dadb94baac5b9037087])
I20260619 19:53:57.738224 1697 tablet_loader.cc:96] loaded metadata for tablet 90b8468df4a449d088f47b3b150ce54a (table default.Table_6354f0bf977c438d9ffcf548901ac7af [id=56ee4af476f74b9ab373fb2bfc1c315e])
I20260619 19:53:57.739240 1697 tablet_loader.cc:96] loaded metadata for tablet 950b8e74d12f46a68ba5eae3186c87a9 (table default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84])
I20260619 19:53:57.740051 1697 tablet_loader.cc:96] loaded metadata for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520])
I20260619 19:53:57.740846 1697 tablet_loader.cc:96] loaded metadata for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730])
I20260619 19:53:57.741245 1628 consensus_queue.cc:1048] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.742861 1208 tablet_bootstrap.cc:492] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.746968 1208 tablet_bootstrap.cc:654] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.750582 1201 tablet_bootstrap.cc:492] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.750998 1201 ts_tablet_manager.cc:1403] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.013s
I20260619 19:53:57.750676 1835 consensus_queue.cc:1048] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.752177 1201 raft_consensus.cc:359] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.752377 1201 raft_consensus.cc:385] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.752487 1201 raft_consensus.cc:740] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.752758 1201 consensus_queue.cc:260] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.753345 1201 ts_tablet_manager.cc:1434] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:57.753672 1201 tablet_bootstrap.cc:492] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.760535 1835 consensus_queue.cc:1048] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.767385 1835 consensus_queue.cc:1048] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.776047 1200 tablet_bootstrap.cc:654] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.780717 1697 tablet_loader.cc:96] loaded metadata for tablet 997cd0b5a8d24b56a2d5b95ab877d95f (table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0])
I20260619 19:53:57.782810 1697 tablet_loader.cc:96] loaded metadata for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f])
I20260619 19:53:57.785295 1697 tablet_loader.cc:96] loaded metadata for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee])
I20260619 19:53:57.787174 1785 consensus_queue.cc:1048] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.800740 1695 raft_consensus.cc:493] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.800944 1695 raft_consensus.cc:515] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.801676 1695 leader_election.cc:290] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.802919 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.803179 921 raft_consensus.cc:2468] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.803942 996 leader_election.cc:304] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.804225 1695 raft_consensus.cc:2804] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.804345 1695 raft_consensus.cc:493] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.804428 1695 raft_consensus.cc:3060] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.807943 1695 raft_consensus.cc:515] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.809057 1695 leader_election.cc:290] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.817543 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.817866 918 raft_consensus.cc:3060] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.825029 918 raft_consensus.cc:2468] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.825626 1201 tablet_bootstrap.cc:654] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.826735 996 leader_election.cc:304] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.827064 1695 raft_consensus.cc:2804] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.827229 1695 raft_consensus.cc:697] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:57.827486 1697 tablet_loader.cc:96] loaded metadata for tablet 9f6ec149e1ac475f8038b328dae4af2a (table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16])
I20260619 19:53:57.827534 1695 consensus_queue.cc:237] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.828440 1697 tablet_loader.cc:96] loaded metadata for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057])
I20260619 19:53:57.828835 1697 tablet_loader.cc:96] loaded metadata for tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f])
I20260619 19:53:57.835336 1201 tablet_bootstrap.cc:492] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.835366 1200 tablet_bootstrap.cc:492] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.835799 1201 ts_tablet_manager.cc:1403] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.082s user 0.001s sys 0.003s
I20260619 19:53:57.835781 1200 ts_tablet_manager.cc:1403] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.004s
I20260619 19:53:57.836422 1832 consensus_queue.cc:1048] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.829241 1697 tablet_loader.cc:96] loaded metadata for tablet a6b5f1da20614838aac1a0175ad4a67d (table default.Table_a3aea512fc0e4621ae8d112053e1e4b8 [id=ae897279d45c4caa8d2b55342f3f79f1])
I20260619 19:53:57.838901 1200 raft_consensus.cc:359] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.839695 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.841147 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:53:57.841693 996 leader_election.cc:343] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.842446 784 raft_consensus.cc:3060] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.839098 1200 raft_consensus.cc:385] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.842844 1200 raft_consensus.cc:740] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.843127 1200 consensus_queue.cc:260] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:57.843518 996 leader_election.cc:343] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.844151 1200 ts_tablet_manager.cc:1434] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20260619 19:53:57.844703 1200 tablet_bootstrap.cc:492] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.847255 1832 raft_consensus.cc:493] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.847429 1832 raft_consensus.cc:515] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.848058 1832 leader_election.cc:290] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.849296 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7adec89ed984837a8cf3544679ca617" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:57.849874 859 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.851996 1201 raft_consensus.cc:359] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.852207 1201 raft_consensus.cc:385] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.852298 1201 raft_consensus.cc:740] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.852545 1201 consensus_queue.cc:260] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.853237 1201 ts_tablet_manager.cc:1434] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.017s user 0.000s sys 0.000s
I20260619 19:53:57.855067 1200 tablet_bootstrap.cc:654] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.856757 1697 tablet_loader.cc:96] loaded metadata for tablet b57381b0a02141459dc582196d0c0095 (table default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0])
I20260619 19:53:57.857264 1697 tablet_loader.cc:96] loaded metadata for tablet b65f88b43b4e45c481aa7d43ef59fe7a (table default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656])
I20260619 19:53:57.857793 1697 tablet_loader.cc:96] loaded metadata for tablet b6a468ca001340e98addf91dd3829efa (table default.Table_c73a82d38a4545cc8940056415afdc2b [id=394d8c70bca54b0eb32990278e06cd91])
I20260619 19:53:57.858793 1697 tablet_loader.cc:96] loaded metadata for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6])
I20260619 19:53:57.860491 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7adec89ed984837a8cf3544679ca617" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.861248 858 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.861408 858 leader_election.cc:304] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.862332 1832 raft_consensus.cc:2749] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.864024 1695 consensus_queue.cc:1048] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.865602 1201 tablet_bootstrap.cc:492] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.867187 1200 tablet_bootstrap.cc:492] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.869135 1652 consensus_queue.cc:1048] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.871760 1652 consensus_queue.cc:1048] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.873607 1208 tablet_bootstrap.cc:492] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.875428 1208 ts_tablet_manager.cc:1403] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.133s user 0.005s sys 0.003s
I20260619 19:53:57.867431 1200 ts_tablet_manager.cc:1403] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.010s
I20260619 19:53:57.877462 1200 raft_consensus.cc:359] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.877483 1208 raft_consensus.cc:359] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.878181 1208 raft_consensus.cc:385] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.878455 1208 raft_consensus.cc:740] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.878820 1200 raft_consensus.cc:385] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.878925 1200 raft_consensus.cc:740] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.879220 1200 consensus_queue.cc:260] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.879164 1208 consensus_queue.cc:260] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.882007 1208 ts_tablet_manager.cc:1434] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260619 19:53:57.882705 1208 tablet_bootstrap.cc:492] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.887077 1200 ts_tablet_manager.cc:1434] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:53:57.887931 1201 tablet_bootstrap.cc:654] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.889577 1200 tablet_bootstrap.cc:492] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.893234 1835 consensus_queue.cc:1048] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:57.901593 1208 tablet_bootstrap.cc:654] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.902109 1200 tablet_bootstrap.cc:654] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.907393 1697 tablet_loader.cc:96] loaded metadata for tablet bb56767231db42bebb75a45b5d512de3 (table default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a])
I20260619 19:53:57.907893 1697 tablet_loader.cc:96] loaded metadata for tablet bc313f3185814ffea50ceb2a804ed158 (table default.Table_4f97c7f3371b4cd9bf5b12bd61a73e1a [id=1a158f2fac454de8b7527ea346ec4786])
I20260619 19:53:57.908447 1697 tablet_loader.cc:96] loaded metadata for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96])
I20260619 19:53:57.917472 1697 tablet_loader.cc:96] loaded metadata for tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308])
I20260619 19:53:57.917886 1697 tablet_loader.cc:96] loaded metadata for tablet c83c093717ef4424b56d49e2689a6d0b (table default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8])
I20260619 19:53:57.918619 1697 tablet_loader.cc:96] loaded metadata for tablet ca6d7f30c5a84106bebebc42eedee654 (table default.Table_5ba1b89a3b684c4f9927a1cefb74588d [id=cb0dfc15d9414ae3b63638e94c05c0a5])
I20260619 19:53:57.918994 1697 tablet_loader.cc:96] loaded metadata for tablet cbec819571854db8a46daae15b9127bd (table default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174])
I20260619 19:53:57.919911 1835 raft_consensus.cc:493] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.920055 1835 raft_consensus.cc:515] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.920750 1835 leader_election.cc:290] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.922541 1201 tablet_bootstrap.cc:492] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.922713 1201 ts_tablet_manager.cc:1403] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.000s
I20260619 19:53:57.923921 1697 tablet_loader.cc:96] loaded metadata for tablet cc57b42a97fa437b93842f7cd379dbb7 (table default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8])
I20260619 19:53:57.924322 1697 tablet_loader.cc:96] loaded metadata for tablet cfdd40b76a6046b18d83dabc35268af3 (table default.Table_c8c43c1f76624e4d8d4429389c71c3e7 [id=55c0a07c0adb4b1db2f1715c4fe2137b])
I20260619 19:53:57.924737 1697 tablet_loader.cc:96] loaded metadata for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b])
I20260619 19:53:57.925091 1697 tablet_loader.cc:96] loaded metadata for tablet d27342783a5641d7a324e71183269308 (table default.Table_64306ac3336a496b97becea891be9344 [id=592df24d0a274aa7a92b1f1952627c0c])
I20260619 19:53:57.926055 1201 raft_consensus.cc:359] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.926273 1201 raft_consensus.cc:385] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.926375 1201 raft_consensus.cc:740] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.926573 1697 tablet_loader.cc:96] loaded metadata for tablet d895be304fcf445e9a4d2d8242becdd5 (table default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90])
I20260619 19:53:57.926837 1201 consensus_queue.cc:260] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.926959 1697 tablet_loader.cc:96] loaded metadata for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb])
I20260619 19:53:57.927479 1201 ts_tablet_manager.cc:1434] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 19:53:57.927800 1201 tablet_bootstrap.cc:492] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.928222 1697 tablet_loader.cc:96] loaded metadata for tablet dc5235127fb54d3dba90c9f9f8c134b4 (table default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703])
I20260619 19:53:57.928576 1697 tablet_loader.cc:96] loaded metadata for tablet dff07e4afabc4e21a74ed0aa68c9026f (table default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247])
I20260619 19:53:57.928994 1697 tablet_loader.cc:96] loaded metadata for tablet e151dc97ad13456ba35708d50c9d7b26 (table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f])
I20260619 19:53:57.929546 1697 tablet_loader.cc:96] loaded metadata for tablet e3031a45cf534814bbece8d271c0420e (table default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d])
I20260619 19:53:57.929715 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83c093717ef4424b56d49e2689a6d0b" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:57.930291 859 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.930585 1201 tablet_bootstrap.cc:654] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.931864 1835 raft_consensus.cc:493] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.932020 1835 raft_consensus.cc:515] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.932581 1835 leader_election.cc:290] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.935693 1697 tablet_loader.cc:96] loaded metadata for tablet e4132f28c434492cbddc8da7d8075c43 (table default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4 [id=a57b082016f14ff48e4194fcbd7b63c1])
I20260619 19:53:57.936129 1697 tablet_loader.cc:96] loaded metadata for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb])
I20260619 19:53:57.936900 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.937078 1697 tablet_loader.cc:96] loaded metadata for tablet ed9d1bd98764451990e7e8e1b6fbcb0b (table default.Table_6e54fd634fc845d7b9ab428009616c61 [id=23b39c02806142d4b0a5c7c0d898b8dd])
I20260619 19:53:57.937645 1697 tablet_loader.cc:96] loaded metadata for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (table default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2])
W20260619 19:53:57.937696 859 leader_election.cc:343] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.938238 1697 tablet_loader.cc:96] loaded metadata for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (table default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6])
I20260619 19:53:57.938575 1697 tablet_loader.cc:96] loaded metadata for tablet f8e48a3e5c1642f6b12adb0033f74404 (table default.Table_13a373b0df95461581e1325a78c25c13 [id=55b6b9eae3ed41a487ea1b9468cd518f])
I20260619 19:53:57.938951 1697 tablet_loader.cc:96] loaded metadata for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c])
I20260619 19:53:57.942973 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83c093717ef4424b56d49e2689a6d0b" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.946148 858 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.946333 858 leader_election.cc:304] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.946599 1835 raft_consensus.cc:2749] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.947232 1201 tablet_bootstrap.cc:492] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:57.947433 1201 ts_tablet_manager.cc:1403] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.002s
I20260619 19:53:57.948665 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.949406 858 leader_election.cc:343] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.949568 858 leader_election.cc:304] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.949888 1835 raft_consensus.cc:2749] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:57.949983 1785 raft_consensus.cc:493] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.949949 1201 raft_consensus.cc:359] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.950385 1201 raft_consensus.cc:385] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.950603 1201 raft_consensus.cc:740] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.950770 1785 raft_consensus.cc:515] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.951413 1201 consensus_queue.cc:260] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.953485 1201 ts_tablet_manager.cc:1434] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260619 19:53:57.953701 1695 raft_consensus.cc:493] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.953851 1695 raft_consensus.cc:515] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.954509 1695 leader_election.cc:290] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.955626 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12258d3bcc714f34857d7362c49ee787" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.955829 919 raft_consensus.cc:2468] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.955971 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12258d3bcc714f34857d7362c49ee787" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:57.956380 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:57.956539 919 raft_consensus.cc:2468] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:57.956589 781 raft_consensus.cc:2468] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:57.957072 996 leader_election.cc:304] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.957351 1695 raft_consensus.cc:2804] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.957473 1695 raft_consensus.cc:493] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.957568 1695 raft_consensus.cc:3060] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.957880 1201 tablet_bootstrap.cc:492] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:57.960680 1695 raft_consensus.cc:515] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.962116 1785 leader_election.cc:290] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.962525 719 leader_election.cc:304] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.963662 1785 raft_consensus.cc:2804] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:57.963771 1785 raft_consensus.cc:493] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:57.964286 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12258d3bcc714f34857d7362c49ee787" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:57.964560 1785 raft_consensus.cc:3060] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.967197 783 raft_consensus.cc:3060] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.970100 783 raft_consensus.cc:2468] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.970642 996 leader_election.cc:304] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:57.970554 1201 tablet_bootstrap.cc:654] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.970949 1860 raft_consensus.cc:2804] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.971103 1860 raft_consensus.cc:697] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:57.971408 1860 consensus_queue.cc:237] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.972158 1785 raft_consensus.cc:515] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.973367 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.973588 919 raft_consensus.cc:3060] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:57.976635 919 raft_consensus.cc:2468] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:57.977130 719 leader_election.cc:304] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:57.977458 1630 raft_consensus.cc:2804] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:57.977602 1630 raft_consensus.cc:697] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:57.977851 1630 consensus_queue.cc:237] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.980450 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.982422 1697 tablet_loader.cc:96] loaded metadata for tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9])
I20260619 19:53:57.983294 1785 leader_election.cc:290] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.981770 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:57.984185 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12258d3bcc714f34857d7362c49ee787" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:57.984469 919 raft_consensus.cc:3060] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:57.983946 720 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:57.987749 720 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.983579 1695 leader_election.cc:290] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:57.989313 919 raft_consensus.cc:2468] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:57.989779 1208 tablet_bootstrap.cc:492] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:57.989792 1200 tablet_bootstrap.cc:492] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:57.989939 1200 ts_tablet_manager.cc:1403] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.000s
I20260619 19:53:57.989959 1208 ts_tablet_manager.cc:1403] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.107s user 0.005s sys 0.000s
I20260619 19:53:57.990705 1200 raft_consensus.cc:359] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.990691 1208 raft_consensus.cc:359] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.990872 1200 raft_consensus.cc:385] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.990899 1208 raft_consensus.cc:385] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:57.990959 1200 raft_consensus.cc:740] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.990993 1208 raft_consensus.cc:740] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:57.991214 1200 consensus_queue.cc:260] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.991525 1208 consensus_queue.cc:260] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.991760 1200 ts_tablet_manager.cc:1434] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:57.992012 1208 ts_tablet_manager.cc:1434] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:57.992063 1200 tablet_bootstrap.cc:492] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:57.992323 1208 tablet_bootstrap.cc:492] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:57.994179 1832 raft_consensus.cc:493] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:57.994328 1208 tablet_bootstrap.cc:654] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.994307 1200 tablet_bootstrap.cc:654] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:57.994354 1832 raft_consensus.cc:515] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:57.995047 1832 leader_election.cc:290] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:57.995795 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:57.996611 858 leader_election.cc:343] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.997093 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:57.997212 1697 tablet_loader.cc:96] loaded metadata for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae [id=dbf8a7ab6063477b9e3bd2bd051116bf])
I20260619 19:53:57.997921 1697 tablet_loader.cc:96] loaded metadata for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_747e9c8819a64b7fae8a5ece57035907 [id=d0f3320ba06b47b38830db7ad44b766c])
W20260619 19:53:57.998581 859 leader_election.cc:343] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:57.998729 859 leader_election.cc:304] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:57.999233 1832 raft_consensus.cc:2749] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.000433 1208 tablet_bootstrap.cc:492] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.000607 1208 ts_tablet_manager.cc:1403] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260619 19:53:58.001734 1208 raft_consensus.cc:359] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.002167 1208 raft_consensus.cc:385] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.002332 1208 raft_consensus.cc:740] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.002657 1208 consensus_queue.cc:260] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.003870 1208 ts_tablet_manager.cc:1434] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:53:58.004298 1208 tablet_bootstrap.cc:492] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:53:58.004506 1292 leader_election.cc:336] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849): Timed out: RequestConsensusVote RPC to 127.0.105.189:45849 timed out after 0.660s (SENT)
I20260619 19:53:58.005674 1292 leader_election.cc:304] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 031619d60e724837bd292c5ce23d0aff; no voters: 2d38b77ff37948e19592b36b6d884fe0, 6cc90ee2d59d4dddae6790dd92b20cb5
W20260619 19:53:58.006068 1697 catalog_manager.cc:1511] Time spent T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Loading table and tablet metadata into memory: real 1.703s user 0.164s sys 0.055s
I20260619 19:53:58.006244 1697 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 19:53:58.006220 542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 4 candidate_status { last_received { term: 3 index: 381 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:58.006057 532 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:37030 (request call id 50) took 1698 ms. Trace:
W20260619 19:53:58.006798 542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50904 (request call id 5) took 545 ms (client timeout 660 ms). Trace:
I20260619 19:53:58.007755 532 rpcz_store.cc:276] 0619 19:53:56.301433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:56.301494 (+ 61us) service_pool.cc:224] Handling call
0619 19:53:57.999722 (+1698228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:53:58.008096 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "031619d60e724837bd292c5ce23d0aff" candidate_term: 4 candidate_status { last_received { term: 3 index: 381 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:53:58.008484 1201 tablet_bootstrap.cc:492] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.008657 1201 ts_tablet_manager.cc:1403] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.001s
I20260619 19:53:58.009873 1201 raft_consensus.cc:359] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.010078 1201 raft_consensus.cc:385] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.010170 1201 raft_consensus.cc:740] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.010466 1208 tablet_bootstrap.cc:654] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.010380 1201 consensus_queue.cc:260] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.010937 1201 ts_tablet_manager.cc:1434] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:58.011276 1201 tablet_bootstrap.cc:492] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.013136 1201 tablet_bootstrap.cc:654] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.014317 1952 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 031619d60e724837bd292c5ce23d0aff [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260619 19:53:58.014389 541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50904 (request call id 4) took 1330 ms (client timeout 660 ms). Trace:
W20260619 19:53:58.006911 542 rpcz_store.cc:269] 0619 19:53:57.461099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:57.461163 (+ 64us) service_pool.cc:224] Handling call
0619 19:53:58.006488 (+545325us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260619 19:53:58.014506 541 rpcz_store.cc:269] 0619 19:53:56.677753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:56.677981 (+ 228us) service_pool.cc:224] Handling call
0619 19:53:58.008293 (+1330312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:53:58.024189 1697 catalog_manager.cc:1294] Loaded cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:53:58.024307 1697 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 19:53:58.029541 1697 catalog_manager.cc:1539] Loading token signing keys...
I20260619 19:53:58.032621 1832 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.032812 1832 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.033512 1832 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.035584 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.035776 1200 tablet_bootstrap.cc:492] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.035955 1200 ts_tablet_manager.cc:1403] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260619 19:53:58.036412 1785 consensus_queue.cc:1048] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:53:58.036585 859 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.036871 1200 raft_consensus.cc:359] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.037088 1200 raft_consensus.cc:385] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.037182 1200 raft_consensus.cc:740] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.037282 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.037428 1200 consensus_queue.cc:260] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:58.037899 858 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.037983 1200 ts_tablet_manager.cc:1434] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:58.038025 858 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.038321 1200 tablet_bootstrap.cc:492] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.038400 1835 raft_consensus.cc:493] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.038532 1835 raft_consensus.cc:515] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.040639 1652 raft_consensus.cc:2749] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.041242 1835 leader_election.cc:290] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.042222 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031a45cf534814bbece8d271c0420e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.044775 1200 tablet_bootstrap.cc:654] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.044737 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031a45cf534814bbece8d271c0420e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.049440 1208 tablet_bootstrap.cc:492] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.049650 1208 ts_tablet_manager.cc:1403] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.000s
I20260619 19:53:58.050391 1201 tablet_bootstrap.cc:492] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:53:58.050422 859 leader_election.cc:343] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.050472 1208 raft_consensus.cc:359] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.050598 1201 ts_tablet_manager.cc:1403] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.001s
I20260619 19:53:58.050668 1208 raft_consensus.cc:385] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.050755 1208 raft_consensus.cc:740] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.051014 1208 consensus_queue.cc:260] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.051416 1201 raft_consensus.cc:359] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.051543 1208 ts_tablet_manager.cc:1434] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:58.051625 1201 raft_consensus.cc:385] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:53:58.051653 858 leader_election.cc:343] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.051712 1201 raft_consensus.cc:740] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.051774 858 leader_election.cc:304] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.051884 1208 tablet_bootstrap.cc:492] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.051955 1201 consensus_queue.cc:260] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.052428 1201 ts_tablet_manager.cc:1434] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:53:58.052767 1201 tablet_bootstrap.cc:492] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.053542 1832 raft_consensus.cc:2749] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.054118 1835 raft_consensus.cc:493] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.054381 1208 tablet_bootstrap.cc:654] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.054296 1835 raft_consensus.cc:515] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.054498 1201 tablet_bootstrap.cc:654] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.054983 1835 leader_election.cc:290] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.055584 1807 raft_consensus.cc:493] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.055739 1807 raft_consensus.cc:515] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.056401 1807 leader_election.cc:290] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.057349 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64ccbb2f2840f4ac51cf8556da4a2c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.057559 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64ccbb2f2840f4ac51cf8556da4a2c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.058480 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.058687 919 raft_consensus.cc:2468] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.059087 996 leader_election.cc:304] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.059178 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.059427 1807 raft_consensus.cc:2804] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.059542 1807 raft_consensus.cc:493] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.059628 1807 raft_consensus.cc:3060] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.059778 1697 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Loaded TSK: 0
W20260619 19:53:58.060487 859 leader_election.cc:343] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:58.060756 858 leader_election.cc:343] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.060860 858 leader_election.cc:304] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.060966 1697 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 19:53:58.061339 1832 raft_consensus.cc:2749] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.062395 1807 raft_consensus.cc:515] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.062960 1807 leader_election.cc:290] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:53:58.063628 996 leader_election.cc:343] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.064316 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:58.064354 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:58.064546 919 raft_consensus.cc:3060] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:58.064901 996 leader_election.cc:343] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.067977 919 raft_consensus.cc:2468] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:58.070904 996 leader_election.cc:304] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:58.071647 1860 raft_consensus.cc:2804] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:58.071925 1860 raft_consensus.cc:697] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:58.072189 1860 consensus_queue.cc:237] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.074103 1201 tablet_bootstrap.cc:492] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.074267 1201 ts_tablet_manager.cc:1403] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.004s
I20260619 19:53:58.074566 1659 consensus_queue.cc:1048] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.076489 1835 raft_consensus.cc:493] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.076637 1835 raft_consensus.cc:515] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.076783 1200 tablet_bootstrap.cc:492] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.076941 1200 ts_tablet_manager.cc:1403] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.002s
I20260619 19:53:58.077723 1200 raft_consensus.cc:359] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.077914 1200 raft_consensus.cc:385] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.078006 1200 raft_consensus.cc:740] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.078233 1200 consensus_queue.cc:260] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.078533 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbec819571854db8a46daae15b9127bd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.078837 1200 ts_tablet_manager.cc:1434] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:58.079167 1201 raft_consensus.cc:359] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.079352 1200 tablet_bootstrap.cc:492] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.079511 1201 raft_consensus.cc:385] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.080114 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbec819571854db8a46daae15b9127bd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.079517 1835 leader_election.cc:290] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.081535 1695 raft_consensus.cc:493] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.081828 1695 raft_consensus.cc:515] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.082513 1695 leader_election.cc:290] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.083388 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 6baa466f30c2460697217f526fc4617f from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.083758 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a686826694b49b9bb5bcdefd61c9a15" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.083993 781 raft_consensus.cc:2468] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.085034 996 leader_election.cc:304] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.085356 1695 raft_consensus.cc:2804] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.085462 1695 raft_consensus.cc:493] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.085557 1695 raft_consensus.cc:3060] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:58.086141 859 leader_election.cc:343] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.086822 1201 raft_consensus.cc:740] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:53:58.086895 858 leader_election.cc:343] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.086995 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a686826694b49b9bb5bcdefd61c9a15" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.087185 858 leader_election.cc:304] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.087121 1201 consensus_queue.cc:260] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.087234 921 raft_consensus.cc:2468] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.087657 1832 raft_consensus.cc:2749] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.087812 1201 ts_tablet_manager.cc:1434] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260619 19:53:58.088117 1201 tablet_bootstrap.cc:492] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.090130 1201 tablet_bootstrap.cc:654] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.091595 532 master_service.cc:960] ReplaceTablet: received request to replace tablet e151dc97ad13456ba35708d50c9d7b26 from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.092795 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ef20e35c612400bbbf1c707a36ced8c from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.094647 1835 raft_consensus.cc:493] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.094877 1835 raft_consensus.cc:515] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.095788 1835 leader_election.cc:290] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.097425 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33935217c1f44ce0ad5b8610d368f2eb" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.097766 1060 raft_consensus.cc:2468] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:58.098371 859 leader_election.cc:304] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.098721 1835 raft_consensus.cc:2804] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.098820 1835 raft_consensus.cc:493] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.098939 1835 raft_consensus.cc:3060] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.099396 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33935217c1f44ce0ad5b8610d368f2eb" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:58.100131 858 leader_election.cc:343] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.101593 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9359939c44674491aed56c5ad7d71e13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.102077 1835 raft_consensus.cc:515] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:58.103415 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9359939c44674491aed56c5ad7d71e13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.103505 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33935217c1f44ce0ad5b8610d368f2eb" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:58.103730 1060 raft_consensus.cc:3060] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.107602 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33935217c1f44ce0ad5b8610d368f2eb" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:58.108145 1060 raft_consensus.cc:2468] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:53:58.109475 858 leader_election.cc:343] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.110424 1208 tablet_bootstrap.cc:492] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.110579 1208 ts_tablet_manager.cc:1403] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.006s
I20260619 19:53:58.111371 1208 raft_consensus.cc:359] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.111579 1208 raft_consensus.cc:385] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.111665 1208 raft_consensus.cc:740] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.111915 1208 consensus_queue.cc:260] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.114646 1208 ts_tablet_manager.cc:1434] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 19:53:58.115381 1208 tablet_bootstrap.cc:492] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.116931 859 leader_election.cc:304] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:58.117317 1832 raft_consensus.cc:2804] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:58.117480 1832 raft_consensus.cc:697] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:58.117734 1832 consensus_queue.cc:237] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.118191 1208 tablet_bootstrap.cc:654] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.108569 1695 raft_consensus.cc:515] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.115586 1860 consensus_queue.cc:1048] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.121212 1695 leader_election.cc:290] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.122316 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a686826694b49b9bb5bcdefd61c9a15" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:58.122581 921 raft_consensus.cc:3060] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.126186 921 raft_consensus.cc:2468] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:58.126958 996 leader_election.cc:304] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.127027 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a686826694b49b9bb5bcdefd61c9a15" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:58.127251 783 raft_consensus.cc:3060] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.127616 1695 raft_consensus.cc:2804] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:58.127948 1695 raft_consensus.cc:697] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:58.128291 1695 consensus_queue.cc:237] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.129976 783 raft_consensus.cc:2468] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:58.136479 1860 consensus_queue.cc:1048] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.137127 832 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:53:58.142787 1201 tablet_bootstrap.cc:492] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.143007 1201 ts_tablet_manager.cc:1403] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.005s
I20260619 19:53:58.143795 1201 raft_consensus.cc:359] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.144008 1201 raft_consensus.cc:385] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.144030 1659 raft_consensus.cc:493] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.144096 1201 raft_consensus.cc:740] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.144193 1659 raft_consensus.cc:515] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.144335 1201 consensus_queue.cc:260] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.144841 1201 ts_tablet_manager.cc:1434] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:58.144841 1659 leader_election.cc:290] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.145213 1201 tablet_bootstrap.cc:492] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.145539 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d212a279754f2497ad4fc2a3c8b5c3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.145879 1060 raft_consensus.cc:2393] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:58.146346 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d212a279754f2497ad4fc2a3c8b5c3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.147078 719 leader_election.cc:304] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.147467 1659 raft_consensus.cc:3060] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.081559 1200 tablet_bootstrap.cc:654] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.150126 1835 leader_election.cc:290] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.151151 1659 raft_consensus.cc:2749] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.152187 1201 tablet_bootstrap.cc:654] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.170187 746 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:58.174769 1201 tablet_bootstrap.cc:492] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.174947 1201 ts_tablet_manager.cc:1403] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260619 19:53:58.175868 1201 raft_consensus.cc:359] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.176218 1201 raft_consensus.cc:385] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.176331 1201 raft_consensus.cc:740] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.176527 1201 consensus_queue.cc:260] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.177044 1201 ts_tablet_manager.cc:1434] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:53:58.177578 1201 tablet_bootstrap.cc:492] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.186061 1201 tablet_bootstrap.cc:654] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.188544 1973 tablet_replica.cc:333] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:58.188931 1973 raft_consensus.cc:2243] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:58.189230 1973 raft_consensus.cc:2272] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:58.190522 1973 ts_tablet_manager.cc:1916] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:58.196259 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_30932010f9e54c029a0c57b5c379957e" } new_table_name: "default.Table_7a1b2d870fc840db98f41ddb6dedc0fa" modify_external_catalogs: true
I20260619 19:53:58.196709 1200 tablet_bootstrap.cc:492] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.197535 530 catalog_manager.cc:5696] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:53:58.198203 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]). Expected version 1 got 0
I20260619 19:53:58.198719 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_64d25d0d86ef4a70a981ebed6a29e834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.199625 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64d25d0d86ef4a70a981ebed6a29e834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.199887 1201 tablet_bootstrap.cc:492] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.200037 1201 ts_tablet_manager.cc:1403] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20260619 19:53:58.200711 1201 raft_consensus.cc:359] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.200897 1201 raft_consensus.cc:385] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.200955 1201 raft_consensus.cc:740] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.201182 1201 consensus_queue.cc:260] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.201838 1201 ts_tablet_manager.cc:1434] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:53:58.201858 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1e665d03a8764d998282ef50afaa6b12" } new_table_name: "default.Table_7a804e38bb484833a00aecd12f4ad7e0" modify_external_catalogs: true
I20260619 19:53:58.203915 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a7392d5a5a7643c6b3e0b1037ddd48ae" } new_table_name: "default.Table_d81fd5ddf99c4cc69b837400b6c4722a" modify_external_catalogs: true
I20260619 19:53:58.204478 1201 tablet_bootstrap.cc:492] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.205475 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dedab2e9a4f84ef7a4741c2c6e5e1f5b" } new_table_name: "default.Table_d911a0e8835847cb9ccf9d5d192872fe" modify_external_catalogs: true
I20260619 19:53:58.205559 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_92408f2035484b0a9ae4690e46cf66f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.196923 1200 ts_tablet_manager.cc:1403] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.118s user 0.000s sys 0.004s
W20260619 19:53:58.206625 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92408f2035484b0a9ae4690e46cf66f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.207008 1201 tablet_bootstrap.cc:654] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.207034 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6d1f0f1124cb46138d7584cfd183ea34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.207643 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d1f0f1124cb46138d7584cfd183ea34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.212986 1200 raft_consensus.cc:359] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.217859 1200 raft_consensus.cc:385] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.218261 1200 raft_consensus.cc:740] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.218993 1200 consensus_queue.cc:260] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.221253 1200 ts_tablet_manager.cc:1434] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260619 19:53:58.223017 1200 tablet_bootstrap.cc:492] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.223407 1201 tablet_bootstrap.cc:492] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.223560 1201 ts_tablet_manager.cc:1403] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260619 19:53:58.224046 1208 tablet_bootstrap.cc:492] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.224280 1208 ts_tablet_manager.cc:1403] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.109s user 0.010s sys 0.001s
I20260619 19:53:58.224372 1201 raft_consensus.cc:359] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.224579 1201 raft_consensus.cc:385] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.224671 1201 raft_consensus.cc:740] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.225064 1201 consensus_queue.cc:260] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.225493 1208 raft_consensus.cc:359] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.225623 1201 ts_tablet_manager.cc:1434] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:53:58.225970 1201 tablet_bootstrap.cc:492] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.225976 1208 raft_consensus.cc:385] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.226166 1208 raft_consensus.cc:740] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.226467 1208 consensus_queue.cc:260] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.227236 1785 raft_consensus.cc:493] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.227386 1785 raft_consensus.cc:515] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.228042 1785 leader_election.cc:290] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.228178 1201 tablet_bootstrap.cc:654] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.229661 1208 ts_tablet_manager.cc:1434] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:53:58.230060 1208 tablet_bootstrap.cc:492] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.234431 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.234798 918 raft_consensus.cc:2393] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:53:58.235721 1208 tablet_bootstrap.cc:654] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.238168 1973 ts_tablet_manager.cc:1929] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:58.228688 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376dfca0b54d4c689c96242566869717" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.239362 1201 tablet_bootstrap.cc:492] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.239526 1201 ts_tablet_manager.cc:1403] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.002s
I20260619 19:53:58.240293 1201 raft_consensus.cc:359] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.240491 1201 raft_consensus.cc:385] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.240563 1201 raft_consensus.cc:740] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.240808 1201 consensus_queue.cc:260] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.241299 1201 ts_tablet_manager.cc:1434] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:53:58.241641 1201 tablet_bootstrap.cc:492] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.239909 720 leader_election.cc:304] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.242605 1785 raft_consensus.cc:3060] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.245386 1785 raft_consensus.cc:2749] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.245718 1973 log.cc:1199] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b7adec89ed984837a8cf3544679ca617
I20260619 19:53:58.249534 1200 tablet_bootstrap.cc:654] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.243428 1201 tablet_bootstrap.cc:654] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.256176 1208 tablet_bootstrap.cc:492] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.256420 1208 ts_tablet_manager.cc:1403] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.004s
I20260619 19:53:58.257462 1208 raft_consensus.cc:359] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.257738 1208 raft_consensus.cc:385] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.257892 1208 raft_consensus.cc:740] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.258160 1208 consensus_queue.cc:260] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.262494 1201 tablet_bootstrap.cc:492] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.262670 1201 ts_tablet_manager.cc:1403] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260619 19:53:58.263497 1208 ts_tablet_manager.cc:1434] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:53:58.263687 1201 raft_consensus.cc:359] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.263955 1201 raft_consensus.cc:385] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.263998 1208 tablet_bootstrap.cc:492] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.264045 1201 raft_consensus.cc:740] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.264604 1201 consensus_queue.cc:260] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.265163 1201 ts_tablet_manager.cc:1434] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:53:58.265479 1201 tablet_bootstrap.cc:492] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.267985 1200 tablet_bootstrap.cc:492] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.268231 1200 ts_tablet_manager.cc:1403] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
I20260619 19:53:58.269852 1200 raft_consensus.cc:359] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.270116 1200 raft_consensus.cc:385] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.270253 1200 raft_consensus.cc:740] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.270555 1200 consensus_queue.cc:260] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.271342 1200 ts_tablet_manager.cc:1434] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:53:58.271903 1201 tablet_bootstrap.cc:654] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.273036 1973 ts_tablet_manager.cc:1950] T b7adec89ed984837a8cf3544679ca617 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:58.274060 1208 tablet_bootstrap.cc:654] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.275429 1200 tablet_bootstrap.cc:492] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.279780 1835 consensus_queue.cc:1048] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.281342 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b7adec89ed984837a8cf3544679ca617 (table default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]) successfully deleted
I20260619 19:53:58.288029 1201 tablet_bootstrap.cc:492] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.288208 1201 ts_tablet_manager.cc:1403] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.004s
I20260619 19:53:58.288983 1201 raft_consensus.cc:359] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.289172 1201 raft_consensus.cc:385] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.289240 1201 raft_consensus.cc:740] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.289454 1201 consensus_queue.cc:260] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.290344 1201 ts_tablet_manager.cc:1434] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:53:58.290766 1201 tablet_bootstrap.cc:492] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.292563 1201 tablet_bootstrap.cc:654] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.293885 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e151dc97ad13456ba35708d50c9d7b26
I20260619 19:53:58.295183 532 catalog_manager.cc:6784] ReplaceTablet: tablet e151dc97ad13456ba35708d50c9d7b26 deleted and replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1
I20260619 19:53:58.296144 746 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:58.313699 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e151dc97ad13456ba35708d50c9d7b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e151dc97ad13456ba35708d50c9d7b26 already in progress: creating tablet
I20260619 19:53:58.318213 1208 tablet_bootstrap.cc:492] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.318408 1208 ts_tablet_manager.cc:1403] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.003s
I20260619 19:53:58.329036 1208 raft_consensus.cc:359] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.329320 1208 raft_consensus.cc:385] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.329407 1208 raft_consensus.cc:740] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.329711 1208 consensus_queue.cc:260] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.330734 1208 ts_tablet_manager.cc:1434] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260619 19:53:58.332252 1208 tablet_bootstrap.cc:492] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.339412 1208 tablet_bootstrap.cc:654] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.341602 1201 tablet_bootstrap.cc:492] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.341809 1201 ts_tablet_manager.cc:1403] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.051s user 0.013s sys 0.004s
I20260619 19:53:58.343170 1201 raft_consensus.cc:359] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.343394 1201 raft_consensus.cc:385] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.343498 1201 raft_consensus.cc:740] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.343752 1201 consensus_queue.cc:260] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.344353 1201 ts_tablet_manager.cc:1434] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:53:58.344710 1201 tablet_bootstrap.cc:492] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.347087 1201 tablet_bootstrap.cc:654] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.348428 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:33622
W20260619 19:53:58.368921 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e151dc97ad13456ba35708d50c9d7b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e151dc97ad13456ba35708d50c9d7b26 already in progress: creating tablet
I20260619 19:53:58.370570 1201 tablet_bootstrap.cc:492] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.371239 1201 ts_tablet_manager.cc:1403] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.005s
I20260619 19:53:58.372438 1201 raft_consensus.cc:359] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.372673 1201 raft_consensus.cc:385] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.372766 1201 raft_consensus.cc:740] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.373273 1201 consensus_queue.cc:260] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.375242 1201 ts_tablet_manager.cc:1434] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260619 19:53:58.376187 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260619 19:53:58.376291 1201 tablet_bootstrap.cc:492] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.377547 1200 tablet_bootstrap.cc:654] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.378919 1201 tablet_bootstrap.cc:654] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.387534 1201 tablet_bootstrap.cc:492] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:58.387712 1201 ts_tablet_manager.cc:1403] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260619 19:53:58.388875 1201 raft_consensus.cc:359] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.389091 1201 raft_consensus.cc:385] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.389243 1201 raft_consensus.cc:740] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.389513 1201 consensus_queue.cc:260] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.398244 1200 tablet_bootstrap.cc:492] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.398485 1200 ts_tablet_manager.cc:1403] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.001s
I20260619 19:53:58.399407 1200 raft_consensus.cc:359] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.399619 1200 raft_consensus.cc:385] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.399685 1200 raft_consensus.cc:740] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.399956 1200 consensus_queue.cc:260] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.401345 1109 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:53:58.409758 1200 ts_tablet_manager.cc:1434] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260619 19:53:58.410169 1200 tablet_bootstrap.cc:492] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.416811 1200 tablet_bootstrap.cc:654] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:58.427672 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8bc11c632b514118856ea4c11b431142 has no consensus state
I20260619 19:53:58.433666 1695 consensus_queue.cc:1048] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.448776 2000 tablet.cc:1724] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:58.456073 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1b1eebd6048a4df78f905c5f2d1959c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.456811 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b1eebd6048a4df78f905c5f2d1959c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.458637 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2dc810dbe0264b59aed3d2f2186ea1dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.459378 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dc810dbe0264b59aed3d2f2186ea1dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.462658 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c89d6514dbcb43c0b65132772e18e5ee" } modify_external_catalogs: true
I20260619 19:53:58.462720 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_299b0539a019486f9ab66bb6e24975a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.462949 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c89d6514dbcb43c0b65132772e18e5ee" } modify_external_catalogs: true
W20260619 19:53:58.463493 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_299b0539a019486f9ab66bb6e24975a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.468217 1201 ts_tablet_manager.cc:1434] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260619 19:53:58.474601 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 8bc11c632b514118856ea4c11b431142 (table default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8bc11c632b514118856ea4c11b431142 has no consensus state
I20260619 19:53:58.477538 1807 raft_consensus.cc:493] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.477736 1807 raft_consensus.cc:515] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.478413 1807 leader_election.cc:290] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.480988 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:58.483879 859 consensus_peers.cc:597] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ef20e35c612400bbbf1c707a36ced8c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:58.487021 1201 tablet_bootstrap.cc:492] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:58.488207 1840 consensus_queue.cc:1048] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260619 19:53:58.490747 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_baef1a6b19f94884934f0c54a4dda5d0" } modify_external_catalogs: true
I20260619 19:53:58.492825 1807 consensus_queue.cc:1048] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.492892 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbe466eee2f43359181a1d26d6e761e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.494737 918 raft_consensus.cc:2393] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:58.496768 996 leader_election.cc:304] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:58.497138 1807 raft_consensus.cc:3060] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.499969 1807 raft_consensus.cc:2749] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:58.502154 1807 raft_consensus.cc:493] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.502432 1807 raft_consensus.cc:515] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.503371 1807 leader_election.cc:290] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:58.491012 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_baef1a6b19f94884934f0c54a4dda5d0" } modify_external_catalogs: true
I20260619 19:53:58.504974 1807 raft_consensus.cc:493] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.505185 1807 raft_consensus.cc:515] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.505448 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_62d0e0d461a74b99bac5c2251f7f7f63" } modify_external_catalogs: true
I20260619 19:53:58.505610 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_62d0e0d461a74b99bac5c2251f7f7f63" } modify_external_catalogs: true
I20260619 19:53:58.506053 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_89e0d67d36c34443a92db1e8c7031834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.506647 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89e0d67d36c34443a92db1e8c7031834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.507485 1807 leader_election.cc:290] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:53:58.508901 996 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
I20260619 19:53:58.507122 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c7454e0f284d4da3b90876e9c49da830" } modify_external_catalogs: true
I20260619 19:53:58.511329 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 83452ce6b5b3479b98ea312db05dc651 (DEFAULT_TABLE table=default.Table_33d4ef8901924ac38b9500db539f2257 [id=b0c20277b82e48e096fc0ea8d3053c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.511354 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 3064bd01ced9429d82ce449e8afc4999 (DEFAULT_TABLE table=default.Table_89e0d67d36c34443a92db1e8c7031834 [id=ee7da39dc2234901a52a8835d106ffc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.511471 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c7454e0f284d4da3b90876e9c49da830" } modify_external_catalogs: true
I20260619 19:53:58.511476 1630 consensus_queue.cc:1048] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260619 19:53:58.511780 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83452ce6b5b3479b98ea312db05dc651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.511756 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a (DEFAULT_TABLE table=default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.511915 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5ab0c5d77506466ebc58898ec783e478"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.512413 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ab0c5d77506466ebc58898ec783e478 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.512835 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9d38a479e3ed4d649131e8582f437265" } new_table_name: "default.Table_5e75d9e9320b476995a29d678ae6be45" modify_external_catalogs: true
I20260619 19:53:58.513270 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.513728 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.514086 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f2b7aed4e720476cb97127ea1b58db50" } modify_external_catalogs: true
I20260619 19:53:58.514240 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f2b7aed4e720476cb97127ea1b58db50" } modify_external_catalogs: true
I20260619 19:53:58.515527 757 tablet_service.cc:1511] Processing CreateTablet for tablet 83452ce6b5b3479b98ea312db05dc651 (DEFAULT_TABLE table=default.Table_33d4ef8901924ac38b9500db539f2257 [id=b0c20277b82e48e096fc0ea8d3053c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.515957 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83452ce6b5b3479b98ea312db05dc651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.519567 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6ec149e1ac475f8038b328dae4af2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.520179 1036 tablet_service.cc:1511] Processing CreateTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 (DEFAULT_TABLE table=default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.520556 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc57b42a97fa437b93842f7cd379dbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.514539 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 304e1eed89f54b809ac52efe2226dc35 from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.521054 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 33935217c1f44ce0ad5b8610d368f2eb from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.522418 758 tablet_service.cc:1511] Processing CreateTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 (DEFAULT_TABLE table=default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.522832 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc57b42a97fa437b93842f7cd379dbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.523396 747 tablet_service.cc:1511] Processing CreateTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 (DEFAULT_TABLE table=default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.523855 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 (DEFAULT_TABLE table=default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.523937 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4b88dd7d19514e83857e2c6108291b9f (DEFAULT_TABLE table=default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.524451 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc11c632b514118856ea4c11b431142 (DEFAULT_TABLE table=default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.524974 760 tablet_service.cc:1511] Processing CreateTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (DEFAULT_TABLE table=default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.525453 751 tablet_service.cc:1511] Processing CreateTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (DEFAULT_TABLE table=default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.526934 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 4b88dd7d19514e83857e2c6108291b9f (DEFAULT_TABLE table=default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.527226 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 997cd0b5a8d24b56a2d5b95ab877d95f from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.527396 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3064bd01ced9429d82ce449e8afc4999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.531469 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3354ae6dd46bd9c5414d4c4a720a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.531462 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 46dcf2293e2d461ca1be171069867d1f from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.538709 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.542145 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc11c632b514118856ea4c11b431142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.547349 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6ad82f0c94e27b2eb4dbf185fab66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.550700 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b88dd7d19514e83857e2c6108291b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.554973 1807 raft_consensus.cc:493] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.555507 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc11c632b514118856ea4c11b431142 (DEFAULT_TABLE table=default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.556252 1200 tablet_bootstrap.cc:492] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.556427 1200 ts_tablet_manager.cc:1403] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.146s user 0.010s sys 0.012s
I20260619 19:53:58.557080 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b88dd7d19514e83857e2c6108291b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.557243 2011 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:53:58.557427 2011 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:58.558656 749 tablet_service.cc:1511] Processing CreateTablet for tablet 68788824224b426bb433b87763073bae (DEFAULT_TABLE table=default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.559113 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68788824224b426bb433b87763073bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.560906 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (DEFAULT_TABLE table=default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.562440 763 tablet_service.cc:1511] Processing CreateTablet for tablet f8e48a3e5c1642f6b12adb0033f74404 (DEFAULT_TABLE table=default.Table_13a373b0df95461581e1325a78c25c13 [id=55b6b9eae3ed41a487ea1b9468cd518f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.562891 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e48a3e5c1642f6b12adb0033f74404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.564754 2011 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.567503 752 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc1a472e7aa49639212a41619eabff3 (DEFAULT_TABLE table=default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 [id=7f1a06b87720448aba53d5447e938e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.568071 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc1a472e7aa49639212a41619eabff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.570868 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc11c632b514118856ea4c11b431142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.572490 1200 raft_consensus.cc:359] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.572772 1200 raft_consensus.cc:385] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.562196 1807 raft_consensus.cc:515] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.579234 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75baa585102481fa0ea01e87e394e32" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.579823 781 raft_consensus.cc:2468] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.582438 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6ad82f0c94e27b2eb4dbf185fab66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.585491 759 tablet_service.cc:1511] Processing CreateTablet for tablet 801f08f4daa842238460506ccd0c466f (DEFAULT_TABLE table=default.Table_28205fd1dd524e6b8aa7a105f1a9638f [id=e21bf9fe2c944b2b801fe5304ec7f99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.586242 1832 raft_consensus.cc:493] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.586521 1832 raft_consensus.cc:515] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.587334 746 tablet_service.cc:1511] Processing CreateTablet for tablet 3064bd01ced9429d82ce449e8afc4999 (DEFAULT_TABLE table=default.Table_89e0d67d36c34443a92db1e8c7031834 [id=ee7da39dc2234901a52a8835d106ffc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.587482 1832 leader_election.cc:290] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.588070 1024 tablet_service.cc:1511] Processing CreateTablet for tablet c2f9e5a4dedd4c81901cb99fecff0919 (DEFAULT_TABLE table=default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.588620 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb6712fc0994154aa5022ec16cec1ae (DEFAULT_TABLE table=default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.588665 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (DEFAULT_TABLE table=default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.590140 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3064bd01ced9429d82ce449e8afc4999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.590579 1659 raft_consensus.cc:493] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.590755 1659 raft_consensus.cc:515] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.593218 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a (DEFAULT_TABLE table=default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.602496 1201 tablet_bootstrap.cc:654] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.604655 996 leader_election.cc:304] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.605077 1860 raft_consensus.cc:2804] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.605197 1860 raft_consensus.cc:493] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.605367 1860 raft_consensus.cc:3060] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.606696 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83c093717ef4424b56d49e2689a6d0b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.607380 1200 raft_consensus.cc:740] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.608557 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.609529 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f9e5a4dedd4c81901cb99fecff0919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.610313 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb6712fc0994154aa5022ec16cec1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.611670 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3354ae6dd46bd9c5414d4c4a720a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.614162 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd210e843db4f58a976af5c28dabc9c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.615792 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 68788824224b426bb433b87763073bae (DEFAULT_TABLE table=default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.617719 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 801f08f4daa842238460506ccd0c466f (DEFAULT_TABLE table=default.Table_28205fd1dd524e6b8aa7a105f1a9638f [id=e21bf9fe2c944b2b801fe5304ec7f99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.618134 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 098d5bd070b54889905539f1fa1a47e6 (DEFAULT_TABLE table=default.Table_20dc9175b4c84bc6ac2546afae733eca [id=52998f068e554dd7b19f353a041fda6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.618516 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64ccbb2f2840f4ac51cf8556da4a2c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.602445 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd210e843db4f58a976af5c28dabc9c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.618897 1029 tablet_service.cc:1511] Processing CreateTablet for tablet f8e48a3e5c1642f6b12adb0033f74404 (DEFAULT_TABLE table=default.Table_13a373b0df95461581e1325a78c25c13 [id=55b6b9eae3ed41a487ea1b9468cd518f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.619563 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc1a472e7aa49639212a41619eabff3 (DEFAULT_TABLE table=default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 [id=7f1a06b87720448aba53d5447e938e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.619874 1060 raft_consensus.cc:2468] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:58.621343 1807 leader_election.cc:290] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:53:58.621774 720 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:53:58.627410 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68788824224b426bb433b87763073bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.626559 1200 consensus_queue.cc:260] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.630985 751 tablet_service.cc:1511] Processing CreateTablet for tablet c2f9e5a4dedd4c81901cb99fecff0919 (DEFAULT_TABLE table=default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.632455 747 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb6712fc0994154aa5022ec16cec1ae (DEFAULT_TABLE table=default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.632738 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801f08f4daa842238460506ccd0c466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.633720 755 tablet_service.cc:1511] Processing CreateTablet for tablet 098d5bd070b54889905539f1fa1a47e6 (DEFAULT_TABLE table=default.Table_20dc9175b4c84bc6ac2546afae733eca [id=52998f068e554dd7b19f353a041fda6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.633962 1659 leader_election.cc:290] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.634876 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098d5bd070b54889905539f1fa1a47e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.637861 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801f08f4daa842238460506ccd0c466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.638163 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e48a3e5c1642f6b12adb0033f74404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.638646 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc1a472e7aa49639212a41619eabff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.639927 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83c093717ef4424b56d49e2689a6d0b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:53:58.641557 996 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.639837 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:53:58.645586 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:53:58.645763 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:53:58.646034 532 catalog_manager.cc:5696] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:53:58.646798 532 catalog_manager.cc:5696] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:53:58.647411 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]). Expected version 1 got 0
I20260619 19:53:58.647681 532 catalog_manager.cc:5696] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.648175 532 catalog_manager.cc:5696] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:53:58.648501 1200 ts_tablet_manager.cc:1434] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.080s user 0.003s sys 0.000s
I20260619 19:53:58.648548 532 catalog_manager.cc:5696] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.648820 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]). Expected version 3 got 0
I20260619 19:53:58.649230 532 catalog_manager.cc:5696] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:58.649621 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:53:58.649855 532 catalog_manager.cc:5696] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.650144 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f]). Expected version 1 got 0
I20260619 19:53:58.650333 532 catalog_manager.cc:5696] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:53:58.651268 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6ec149e1ac475f8038b328dae4af2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.651185 532 catalog_manager.cc:5696] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:53:58.652244 532 catalog_manager.cc:5696] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:53:58.652621 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]). Expected version 1 got 0
I20260619 19:53:58.634464 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 997cd0b5a8d24b56a2d5b95ab877d95f
I20260619 19:53:58.652838 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098d5bd070b54889905539f1fa1a47e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.653378 525 catalog_manager.cc:6784] ReplaceTablet: tablet 997cd0b5a8d24b56a2d5b95ab877d95f deleted and replaced by tablet e6dcf87d57044279a218cbb21c383352
I20260619 19:53:58.653714 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fd5f53962cfd4900a0a79ba7de140a88" } modify_external_catalogs: true
I20260619 19:53:58.653788 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:53:58.653995 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fd5f53962cfd4900a0a79ba7de140a88" } modify_external_catalogs: true
I20260619 19:53:58.654165 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb6712fc0994154aa5022ec16cec1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.654284 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_747e9c8819a64b7fae8a5ece57035907 [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 1 got 0
I20260619 19:53:58.654644 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]). Expected version 2 got 0
I20260619 19:53:58.654927 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:53:58.655158 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f9e5a4dedd4c81901cb99fecff0919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.655397 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:53:58.656037 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:53:58.656229 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:53:58.656234 1832 consensus_queue.cc:1048] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260619 19:53:58.656479 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:53:58.656749 532 catalog_manager.cc:5696] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.657104 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]). Expected version 1 got 0
I20260619 19:53:58.657393 532 catalog_manager.cc:5696] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.657819 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7adec89ed984837a8cf3544679ca617" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.658039 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (table default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8]). Expected version 3 got 0
I20260619 19:53:58.659207 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:53:58.659565 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75baa585102481fa0ea01e87e394e32" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.659703 1200 tablet_bootstrap.cc:492] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.660704 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 2 got 0
I20260619 19:53:58.662317 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:53:58.662776 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:53:58.663730 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:53:58.664831 532 catalog_manager.cc:5696] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.665772 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 108f1b2e9ec74271889ffff65d8e852e (table default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d]). Expected version 1 got 0
I20260619 19:53:58.666234 532 catalog_manager.cc:5696] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } }
I20260619 19:53:58.667603 921 raft_consensus.cc:2468] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.669768 2004 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:53:58.670673 919 raft_consensus.cc:2468] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.671178 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]). Expected version 1 got 0
I20260619 19:53:58.673259 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.675557 2001 tablet.cc:1724] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:58.675907 996 leader_election.cc:304] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:58.676980 1807 raft_consensus.cc:2804] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.658645 2003 raft_consensus.cc:493] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.678786 2003 raft_consensus.cc:515] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.690114 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_92408f2035484b0a9ae4690e46cf66f2" } modify_external_catalogs: true
I20260619 19:53:58.690389 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_92408f2035484b0a9ae4690e46cf66f2" } modify_external_catalogs: true
I20260619 19:53:58.671564 2004 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:58.707835 526 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet d3e000cad68f468d87f291795a437609
I20260619 19:53:58.708323 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1d74433076a3413f90471ec48b668e5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.708959 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d74433076a3413f90471ec48b668e5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.709717 1807 raft_consensus.cc:493] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.710441 720 leader_election.cc:304] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:53:58.710683 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 88554.4us
I20260619 19:53:58.711483 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.711701 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:58.712103 2012 raft_consensus.cc:2804] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.712208 2012 raft_consensus.cc:493] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.712313 2012 raft_consensus.cc:3060] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.715446 2012 raft_consensus.cc:515] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.716627 2012 leader_election.cc:290] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.717213 1208 tablet_bootstrap.cc:492] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.717485 1208 ts_tablet_manager.cc:1403] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.386s user 0.002s sys 0.010s
I20260619 19:53:58.718639 1208 raft_consensus.cc:359] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.719008 1208 raft_consensus.cc:385] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.719193 1208 raft_consensus.cc:740] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.719615 1208 consensus_queue.cc:260] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.720234 1208 ts_tablet_manager.cc:1434] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260619 19:53:58.720393 858 leader_election.cc:343] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:58.720669 859 leader_election.cc:343] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.720893 859 leader_election.cc:304] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:58.721202 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 100542us
I20260619 19:53:58.721634 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a5548affccc643a2af2409af28583af9" } modify_external_catalogs: true
I20260619 19:53:58.721989 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a5548affccc643a2af2409af28583af9" } modify_external_catalogs: true
I20260619 19:53:58.722227 922 raft_consensus.cc:2468] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:58.725369 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64ccbb2f2840f4ac51cf8556da4a2c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:58.725582 1059 raft_consensus.cc:3060] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.729035 1208 tablet_bootstrap.cc:492] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.730237 1807 raft_consensus.cc:3060] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.724306 996 leader_election.cc:304] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:53:58.731874 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 997cd0b5a8d24b56a2d5b95ab877d95f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 997cd0b5a8d24b56a2d5b95ab877d95f already in progress: creating tablet
W20260619 19:53:58.736260 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 46260.8us
I20260619 19:53:58.740639 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]). Expected version 1 got 0
I20260619 19:53:58.745544 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ead8fa6263094ddbb60465a7ba503ce3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.746300 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ead8fa6263094ddbb60465a7ba503ce3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.747993 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 46dcf2293e2d461ca1be171069867d1f
I20260619 19:53:58.748669 530 catalog_manager.cc:6784] ReplaceTablet: tablet 46dcf2293e2d461ca1be171069867d1f deleted and replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca
I20260619 19:53:58.748895 1860 raft_consensus.cc:515] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.749169 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_813fc3596f604c7a99d0ac0c6c42a5e0" } new_table_name: "default.Table_cb2d44091aa541459ddc23620b508b4e" modify_external_catalogs: true
I20260619 19:53:58.749415 1200 tablet_bootstrap.cc:654] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.749782 1860 leader_election.cc:290] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.752381 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:58.755718 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 46dcf2293e2d461ca1be171069867d1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcf2293e2d461ca1be171069867d1f already in progress: creating tablet
W20260619 19:53:58.756583 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 997cd0b5a8d24b56a2d5b95ab877d95f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 997cd0b5a8d24b56a2d5b95ab877d95f already in progress: creating tablet
I20260619 19:53:58.756824 1835 raft_consensus.cc:493] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.757035 1835 raft_consensus.cc:515] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.757867 1835 leader_election.cc:290] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.758055 1832 raft_consensus.cc:493] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.758190 1832 raft_consensus.cc:515] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.758385 1695 raft_consensus.cc:2804] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.758734 1832 leader_election.cc:290] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.758950 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64ccbb2f2840f4ac51cf8556da4a2c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.759205 923 raft_consensus.cc:2468] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:58.759479 1840 raft_consensus.cc:2749] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:58.760167 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 81833.6us
I20260619 19:53:58.760702 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41455237399b45efbe8190dcb01e764c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.760833 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.760957 1840 raft_consensus.cc:493] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.766467 1840 raft_consensus.cc:515] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.766929 918 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:58.768710 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.769691 1695 raft_consensus.cc:493] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.771200 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5e38109b2d8b496290d95d8b61a1512b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.772171 1208 tablet_bootstrap.cc:654] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:53:58.772486 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e38109b2d8b496290d95d8b61a1512b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.774133 2004 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:58.774276 2003 leader_election.cc:290] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.775341 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d64ccbb2f2840f4ac51cf8556da4a2c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:58.776589 919 raft_consensus.cc:3060] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:58.782811 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 46dcf2293e2d461ca1be171069867d1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcf2293e2d461ca1be171069867d1f already in progress: creating tablet
I20260619 19:53:58.785087 2011 consensus_queue.cc:1048] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.787086 719 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:58.787660 2012 raft_consensus.cc:2804] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:53:58.787773 2012 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:53:58.787855 2012 raft_consensus.cc:3060] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:53:58.789974 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_02d1f42490804c6ea53f8e922447bfc5" } modify_external_catalogs: true
I20260619 19:53:58.790306 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_02d1f42490804c6ea53f8e922447bfc5" } modify_external_catalogs: true
I20260619 19:53:58.790693 2012 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:58.791096 1695 raft_consensus.cc:3060] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.791517 2012 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:53:58.792768 903 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:58.793370 901 tablet_service.cc:1511] Processing CreateTablet for tablet 3064bd01ced9429d82ce449e8afc4999 (DEFAULT_TABLE table=default.Table_89e0d67d36c34443a92db1e8c7031834 [id=ee7da39dc2234901a52a8835d106ffc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.793764 2016 raft_consensus.cc:493] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.794030 2016 raft_consensus.cc:515] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.794759 2016 leader_election.cc:290] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.796391 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3064bd01ced9429d82ce449e8afc4999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.795945 1840 leader_election.cc:290] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.798661 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a (DEFAULT_TABLE table=default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.799611 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6ec149e1ac475f8038b328dae4af2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.800588 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:53:58.800843 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:53:58.801532 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]). Expected version 1 got 0
I20260619 19:53:58.801775 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f]). Expected version 1 got 0
I20260619 19:53:58.801998 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]). Expected version 1 got 0
I20260619 19:53:58.802453 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:53:58.802714 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 2 got 0
I20260619 19:53:58.802937 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (table default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8]). Expected version 3 got 0
I20260619 19:53:58.805276 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41455237399b45efbe8190dcb01e764c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.803951 1208 tablet_bootstrap.cc:492] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.806871 1208 ts_tablet_manager.cc:1403] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.078s user 0.001s sys 0.005s
I20260619 19:53:58.807971 894 tablet_service.cc:1511] Processing CreateTablet for tablet 83452ce6b5b3479b98ea312db05dc651 (DEFAULT_TABLE table=default.Table_33d4ef8901924ac38b9500db539f2257 [id=b0c20277b82e48e096fc0ea8d3053c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.808090 1840 raft_consensus.cc:493] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.808066 1208 raft_consensus.cc:359] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.808342 1208 raft_consensus.cc:385] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.808248 1840 raft_consensus.cc:515] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:58.808420 1208 raft_consensus.cc:740] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.808497 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83452ce6b5b3479b98ea312db05dc651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.809291 1840 leader_election.cc:290] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:58.810091 1208 consensus_queue.cc:260] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.811815 885 tablet_service.cc:1511] Processing CreateTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 (DEFAULT_TABLE table=default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.812505 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc57b42a97fa437b93842f7cd379dbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.812731 1208 ts_tablet_manager.cc:1434] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260619 19:53:58.813153 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:53:58.812664 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.815932 1208 tablet_bootstrap.cc:492] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:58.816398 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]). Expected version 2 got 0
I20260619 19:53:58.816411 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e151dc97ad13456ba35708d50c9d7b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.816902 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031a45cf534814bbece8d271c0420e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.819747 1208 tablet_bootstrap.cc:654] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:58.820443 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:53:58.821719 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:53:58.822748 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
W20260619 19:53:58.823203 858 leader_election.cc:343] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.823433 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
W20260619 19:53:58.823731 858 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.823781 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c0ffb4629a46349ccfe473cc20cdfc" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.823942 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:53:58.824110 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_747e9c8819a64b7fae8a5ece57035907 [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 1 got 0
I20260619 19:53:58.824568 884 tablet_service.cc:1511] Processing CreateTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 (DEFAULT_TABLE table=default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.824720 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:53:58.824772 970 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:53:58.825035 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3354ae6dd46bd9c5414d4c4a720a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.825352 523 catalog_manager.cc:5696] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:58.825944 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:53:58.826359 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:53:58.826727 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:53:58.827829 890 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc11c632b514118856ea4c11b431142 (DEFAULT_TABLE table=default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.828069 897 tablet_service.cc:1511] Processing CreateTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (DEFAULT_TABLE table=default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.828303 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc11c632b514118856ea4c11b431142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.829042 898 tablet_service.cc:1511] Processing CreateTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (DEFAULT_TABLE table=default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:58.821121 720 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:53:58.829329 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.829526 900 tablet_service.cc:1511] Processing CreateTablet for tablet 4b88dd7d19514e83857e2c6108291b9f (DEFAULT_TABLE table=default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.829874 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b88dd7d19514e83857e2c6108291b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.831960 1056 raft_consensus.cc:2468] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:58.832304 1060 raft_consensus.cc:2468] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:53:58.833158 1807 raft_consensus.cc:515] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.827066 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]). Expected version 3 got 0
I20260619 19:53:58.834081 720 leader_election.cc:304] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.833931 523 catalog_manager.cc:5696] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:53:58.834416 2016 raft_consensus.cc:2804] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:58.834537 2016 raft_consensus.cc:493] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:58.834628 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 108f1b2e9ec74271889ffff65d8e852e (table default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d]). Expected version 1 got 0
I20260619 19:53:58.834692 2016 raft_consensus.cc:3060] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.835054 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e151dc97ad13456ba35708d50c9d7b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.836329 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.836601 784 raft_consensus.cc:2393] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 2: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:53:58.836815 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c0ffb4629a46349ccfe473cc20cdfc" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:58.836313 1208 tablet_bootstrap.cc:492] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:58.837610 1208 ts_tablet_manager.cc:1403] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260619 19:53:58.838696 1208 raft_consensus.cc:359] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.838904 1208 raft_consensus.cc:385] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.839027 1208 raft_consensus.cc:740] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:58.798293 919 raft_consensus.cc:2468] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:58.840071 896 tablet_service.cc:1511] Processing CreateTablet for tablet c2f9e5a4dedd4c81901cb99fecff0919 (DEFAULT_TABLE table=default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.842798 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]). Expected version 1 got 0
I20260619 19:53:58.844985 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:53:58.846050 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c6ad82f0c94e27b2eb4dbf185fab66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.848120 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e3031a45cf534814bbece8d271c0420e
I20260619 19:53:58.849064 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_69117f2dee814224aae2f87b67f524be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.849726 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69117f2dee814224aae2f87b67f524be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.854959 747 tablet_service.cc:1558] Processing DeleteTablet for tablet e3031a45cf534814bbece8d271c0420e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:58.855333 1973 tablet_replica.cc:333] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:58.855783 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 40e1b92467a44737bfabb6ec1c924ea1
I20260619 19:53:58.856613 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.857249 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.861537 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:58.862183 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1202fe45d0964d368989f969e95f880d consensus state has no leader
I20260619 19:53:58.862597 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_33d4ef8901924ac38b9500db539f2257" } new_table_name: "default.Table_b507e37123084d588652be39a96875c4" modify_external_catalogs: true
I20260619 19:53:58.863978 2012 raft_consensus.cc:493] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.864136 2012 raft_consensus.cc:515] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.864804 2012 leader_election.cc:290] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:58.867003 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_384d87b1154345fd9feaa4bac544af49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.868062 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_384d87b1154345fd9feaa4bac544af49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.868261 1807 leader_election.cc:290] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:53:58.876657 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83452ce6b5b3479b98ea312db05dc651 consensus state has no leader
I20260619 19:53:58.860363 1059 raft_consensus.cc:2468] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:58.850759 1695 raft_consensus.cc:515] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.877131 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_acb740f517fd4c61bff72f7ceafb5f75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.877516 1695 leader_election.cc:290] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:53:58.877768 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acb740f517fd4c61bff72f7ceafb5f75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:58.881613 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11e9d0ae96db4388a39a8b8f9c87187e consensus state has no leader
I20260619 19:53:58.881924 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 82d2dd6eedd24f44a6a17aceb20e62bb from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:58.881929 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e1877af4dc434ff5a38408207ea93c47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.882001 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4d84da14868f41e5afe84ea58bd57ab9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.882526 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1877af4dc434ff5a38408207ea93c47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:58.882711 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d84da14868f41e5afe84ea58bd57ab9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.882717 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:53:58.890030 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_562ea43e7e234e69b6f21e17e277a855"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.890846 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_562ea43e7e234e69b6f21e17e277a855 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.893381 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:58.893999 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b8e3354ae6dd46bd9c5414d4c4a720a1
I20260619 19:53:58.903566 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.904512 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.904953 1994 tablet_replica.cc:333] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:58.905241 1994 raft_consensus.cc:2243] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:58.905534 1994 raft_consensus.cc:2272] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:58.906245 1994 ts_tablet_manager.cc:1916] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:58.912712 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d19624f3c0944eaaa5c1417bc0ebca2f" } modify_external_catalogs: true
I20260619 19:53:58.912933 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d19624f3c0944eaaa5c1417bc0ebca2f" } modify_external_catalogs: true
W20260619 19:53:58.914310 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fde2b5d12ab7465791f26d214c2dc2f5 consensus state has no leader
W20260619 19:53:58.915629 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8e3354ae6dd46bd9c5414d4c4a720a1 already in progress: creating tablet
I20260619 19:53:58.916775 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet e3031a45cf534814bbece8d271c0420e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.919472 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.922165 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_249c2339f026459ca9576edb3239bafb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.922854 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_249c2339f026459ca9576edb3239bafb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.924567 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:53:58.925168 1994 ts_tablet_manager.cc:1929] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:53:58.925328 1994 log.cc:1199] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:53:58.926544 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:58.937152 720 leader_election.cc:304] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:58.938568 1994 ts_tablet_manager.cc:1950] T d8c889f13fbe49c3aab1e7f0d0d08e98 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:58.942817 889 tablet_service.cc:1511] Processing CreateTablet for tablet 68788824224b426bb433b87763073bae (DEFAULT_TABLE table=default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:58.943120 859 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:58.943406 2003 raft_consensus.cc:493] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.944625 1200 tablet_bootstrap.cc:492] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:58.944674 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]) successfully deleted
I20260619 19:53:58.945060 2004 raft_consensus.cc:493] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.945255 1994 tablet_replica.cc:333] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:58.945564 1994 raft_consensus.cc:2243] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:58.945535 1200 ts_tablet_manager.cc:1403] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.297s user 0.010s sys 0.056s
I20260619 19:53:58.946230 887 tablet_service.cc:1511] Processing CreateTablet for tablet 5fb6712fc0994154aa5022ec16cec1ae (DEFAULT_TABLE table=default.Table_e015b3b2661b46f5a24476b50a6616b5 [id=e609ecfc781f4164a11f7b02e3dfbe26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.946357 1200 raft_consensus.cc:359] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.946664 1200 raft_consensus.cc:385] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:58.946756 1994 raft_consensus.cc:2272] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:58.946805 1200 raft_consensus.cc:740] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:53:58.948915 858 leader_election.cc:343] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:58.954330 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 98986.6us
I20260619 19:53:58.954561 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f9e5a4dedd4c81901cb99fecff0919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:58.957309 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:58.957509 891 tablet_service.cc:1511] Processing CreateTablet for tablet 801f08f4daa842238460506ccd0c466f (DEFAULT_TABLE table=default.Table_28205fd1dd524e6b8aa7a105f1a9638f [id=e21bf9fe2c944b2b801fe5304ec7f99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:58.957897 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:58.958104 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:58.958271 893 tablet_service.cc:1558] Processing DeleteTablet for tablet e3031a45cf534814bbece8d271c0420e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:58.958844 899 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:58.960014 1840 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:58.959987 1200 consensus_queue.cc:260] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:58.960251 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 217186us
I20260619 19:53:58.960609 1200 ts_tablet_manager.cc:1434] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260619 19:53:58.960638 1994 ts_tablet_manager.cc:1916] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:58.972563 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413] alter complete (version 1)
I20260619 19:53:58.974433 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a3a01d252a2541dd95002687f46086cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:58.975057 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3a01d252a2541dd95002687f46086cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.980538 2018 raft_consensus.cc:2804] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:58.980746 2018 raft_consensus.cc:697] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:58.980791 1200 tablet_bootstrap.cc:492] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:58.983675 2012 consensus_queue.cc:1048] T 2b1fdec7ead34f9188d73507cf1c620a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:58.971627 1208 consensus_queue.cc:260] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:58.989810 755 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:58.991403 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6c755150293e4861b3e1403d72ead695"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:58.991582 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:58.992031 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c755150293e4861b3e1403d72ead695 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:58.993227 747 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:58.993752 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75baa585102481fa0ea01e87e394e32" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:58.997584 782 raft_consensus.cc:3060] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:58.999558 2012 consensus_queue.cc:1048] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260619 19:53:58.993103 2018 consensus_queue.cc:237] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.006656 1208 ts_tablet_manager.cc:1434] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.169s user 0.003s sys 0.000s
I20260619 19:53:59.007701 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83c093717ef4424b56d49e2689a6d0b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:59.007988 781 raft_consensus.cc:3060] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.007990 1208 tablet_bootstrap.cc:492] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:59.015429 781 raft_consensus.cc:2468] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:59.023471 903 tablet_service.cc:1511] Processing CreateTablet for tablet f8e48a3e5c1642f6b12adb0033f74404 (DEFAULT_TABLE table=default.Table_13a373b0df95461581e1325a78c25c13 [id=55b6b9eae3ed41a487ea1b9468cd518f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.029953 894 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc1a472e7aa49639212a41619eabff3 (DEFAULT_TABLE table=default.Table_8bafbe96b7ea46a1b7e90f5cf6be9f48 [id=7f1a06b87720448aba53d5447e938e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.024194 2003 raft_consensus.cc:515] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.031584 2004 raft_consensus.cc:515] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.032272 2004 leader_election.cc:290] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.032483 2026 tablet_replica.cc:333] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:59.032524 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb6712fc0994154aa5022ec16cec1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.032712 2026 raft_consensus.cc:2243] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.032939 2026 raft_consensus.cc:2272] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.033190 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e48a3e5c1642f6b12adb0033f74404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.033385 885 tablet_service.cc:1511] Processing CreateTablet for tablet 098d5bd070b54889905539f1fa1a47e6 (DEFAULT_TABLE table=default.Table_20dc9175b4c84bc6ac2546afae733eca [id=52998f068e554dd7b19f353a041fda6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.033586 2026 ts_tablet_manager.cc:1916] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.033893 917 raft_consensus.cc:2393] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:53:59.034159 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.034363 886 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.037568 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.037819 1840 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.038569 1840 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.038724 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2f73871161488dbad7a19fc9e20b9c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:59.038919 919 raft_consensus.cc:3060] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:53:59.039856 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031a45cf534814bbece8d271c0420e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:59.040084 923 raft_consensus.cc:2468] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:59.040930 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75baa585102481fa0ea01e87e394e32" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:59.041570 920 raft_consensus.cc:3060] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.042213 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7adec89ed984837a8cf3544679ca617" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:53:59.042446 916 raft_consensus.cc:3060] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:59.043252 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 55684b109a03488a88efd45a067159a0 consensus state has no leader
I20260619 19:53:59.043498 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83c093717ef4424b56d49e2689a6d0b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:53:59.043555 858 leader_election.cc:343] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.043668 921 raft_consensus.cc:3060] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:53:59.043807 858 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:53:59.044899 1835 raft_consensus.cc:493] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.045046 1835 raft_consensus.cc:515] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.045591 1835 leader_election.cc:290] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.045974 2024 tablet.cc:1724] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:59.047475 859 leader_election.cc:304] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.050616 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c08fc0181e5642d0a2b7967ff30d4eaa (DEFAULT_TABLE table=default.Table_1b1eebd6048a4df78f905c5f2d1959c3 [id=1debae55f0e7477db2e2285641220a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.052742 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b (DEFAULT_TABLE table=default.Table_6d1f0f1124cb46138d7584cfd183ea34 [id=8eaf4a5b0ebb448bbb0fdd09953c2bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.053138 1031 tablet_service.cc:1511] Processing CreateTablet for tablet bf175c80483346788a148b7277b9ca9d (DEFAULT_TABLE table=default.Table_9359939c44674491aed56c5ad7d71e13 [id=14dbea33ca974c8fa94e99d0d9f79272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.054579 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_287609e30d09421a9d7a5126eef7ad2f" } modify_external_catalogs: true
I20260619 19:53:59.052376 1695 consensus_queue.cc:1048] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260619 19:53:59.054781 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_287609e30d09421a9d7a5126eef7ad2f" } modify_external_catalogs: true
I20260619 19:53:59.056070 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 (DEFAULT_TABLE table=default.Table_299b0539a019486f9ab66bb6e24975a3 [id=0d428bc351c644c49601058ab8da82d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.056097 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 (DEFAULT_TABLE table=default.Table_2dc810dbe0264b59aed3d2f2186ea1dd [id=003a72dcde564d29b771f069509c99cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.056676 2016 raft_consensus.cc:515] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.057526 2016 leader_election.cc:290] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.057914 782 raft_consensus.cc:2468] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:59.061537 1973 raft_consensus.cc:2243] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.066494 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.068647 755 tablet_service.cc:1511] Processing CreateTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 (DEFAULT_TABLE table=default.Table_2dc810dbe0264b59aed3d2f2186ea1dd [id=003a72dcde564d29b771f069509c99cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.069084 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4023cceb8d9447c9952951c1d6bcdf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.071316 751 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.071537 2003 leader_election.cc:290] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.071501 760 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 (DEFAULT_TABLE table=default.Table_299b0539a019486f9ab66bb6e24975a3 [id=0d428bc351c644c49601058ab8da82d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.071830 1973 raft_consensus.cc:2272] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.076725 719 leader_election.cc:304] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.077965 2012 raft_consensus.cc:3060] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.078207 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.078511 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.080619 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7babf9e56d174c6abc66c591fff1eace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.081348 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7babf9e56d174c6abc66c591fff1eace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.082813 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ff9ca3289e4b45ba86c2ab483ea08d30" } new_table_name: "default.Table_5d100ac0078e402e8b7ad4b65c4de9f5" modify_external_catalogs: true
I20260619 19:53:59.083214 1973 ts_tablet_manager.cc:1916] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.083434 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_768b98dd2476482fafa6579ecca2a1b6" } modify_external_catalogs: true
I20260619 19:53:59.083609 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_768b98dd2476482fafa6579ecca2a1b6" } modify_external_catalogs: true
I20260619 19:53:59.083765 751 tablet_service.cc:1511] Processing CreateTablet for tablet c08fc0181e5642d0a2b7967ff30d4eaa (DEFAULT_TABLE table=default.Table_1b1eebd6048a4df78f905c5f2d1959c3 [id=1debae55f0e7477db2e2285641220a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.085258 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5315cb7e69284c01ab36267884d6abf5" } new_table_name: "default.Table_b6efadaef25c49f19f72b09c08e1b25a" modify_external_catalogs: true
I20260619 19:53:59.085806 2017 raft_consensus.cc:493] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.085949 2017 raft_consensus.cc:515] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.086491 748 tablet_service.cc:1511] Processing CreateTablet for tablet bf175c80483346788a148b7277b9ca9d (DEFAULT_TABLE table=default.Table_9359939c44674491aed56c5ad7d71e13 [id=14dbea33ca974c8fa94e99d0d9f79272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.086658 2017 leader_election.cc:290] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.087155 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098d5bd070b54889905539f1fa1a47e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.087764 746 tablet_service.cc:1511] Processing CreateTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 (DEFAULT_TABLE table=default.Table_64d25d0d86ef4a70a981ebed6a29e834 [id=2269d802204a4c9189f2eda909734b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.088901 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb547965fc7e4aa29d427b1acc7d6e51" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.089856 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 376dfca0b54d4c689c96242566869717 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.090288 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.090123 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.092087 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.093583 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_67e54c144d6b452ba54c47f8e63dbbcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.094302 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67e54c144d6b452ba54c47f8e63dbbcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.094308 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.094707 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3e4abf806ba34d899b138fb50dc5a60f" } new_table_name: "default.Table_280eef239dc74f4fb396427d2ca18a6f" modify_external_catalogs: true
I20260619 19:53:59.095897 1208 tablet_bootstrap.cc:654] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.096076 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fa6e27c7a16c411e91a2913fda307afb" } new_table_name: "default.Table_4957c483382c45d7a305c7b4fd2ea6c8" modify_external_catalogs: true
I20260619 19:53:59.097468 747 tablet_service.cc:1511] Processing CreateTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b (DEFAULT_TABLE table=default.Table_6d1f0f1124cb46138d7584cfd183ea34 [id=8eaf4a5b0ebb448bbb0fdd09953c2bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.097882 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08fc0181e5642d0a2b7967ff30d4eaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.097934 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8522f562665540ce99490ab90e02d801 consensus state has no leader
W20260619 19:53:59.103191 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 983faf8557814093bc427291711f3fce consensus state has no leader
I20260619 19:53:59.105748 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet cbec819571854db8a46daae15b9127bd
I20260619 19:53:59.106734 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_64d25d0d86ef4a70a981ebed6a29e834" } modify_external_catalogs: true
I20260619 19:53:59.106956 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_64d25d0d86ef4a70a981ebed6a29e834" } modify_external_catalogs: true
I20260619 19:53:59.110780 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b65f88b43b4e45c481aa7d43ef59fe7a
I20260619 19:53:59.110791 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 (DEFAULT_TABLE table=default.Table_64d25d0d86ef4a70a981ebed6a29e834 [id=2269d802204a4c9189f2eda909734b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.111315 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f6e202e8fd4a7292774d5eb4c7266b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.112208 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_29f6e1631fc74719994ace470407f3e7" } modify_external_catalogs: true
I20260619 19:53:59.112433 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_29f6e1631fc74719994ace470407f3e7" } modify_external_catalogs: true
I20260619 19:53:59.112375 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_953dc7c447e340df89e3d8ffa53c6f9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.112988 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_953dc7c447e340df89e3d8ffa53c6f9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.115079 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.117185 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e9d0ae96db4388a39a8b8f9c87187e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.117583 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f6e202e8fd4a7292774d5eb4c7266b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.119295 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33935217c1f44ce0ad5b8610d368f2eb" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.123435 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.125644 2012 raft_consensus.cc:2749] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.127203 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf175c80483346788a148b7277b9ca9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.128768 765 tablet_service.cc:1558] Processing DeleteTablet for tablet cbec819571854db8a46daae15b9127bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.129525 1200 tablet_bootstrap.cc:654] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.129709 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c71f92f4e3040c09b67e287a19eea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.133093 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.138989 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet cbec819571854db8a46daae15b9127bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.139279 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031a45cf534814bbece8d271c0420e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:59.139557 1059 raft_consensus.cc:2393] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:59.139341 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.140057 765 tablet_service.cc:1558] Processing DeleteTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.140688 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08fc0181e5642d0a2b7967ff30d4eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.141081 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4023cceb8d9447c9952951c1d6bcdf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.143302 1201 tablet_bootstrap.cc:492] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:59.143862 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c71f92f4e3040c09b67e287a19eea74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.145609 720 leader_election.cc:343] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: Tablet not RUNNING: STOPPED
W20260619 19:53:59.148464 858 leader_election.cc:343] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:59.148635 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 55827.8us
I20260619 19:53:59.149642 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf175c80483346788a148b7277b9ca9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.149932 858 leader_election.cc:343] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:59.150163 858 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.150843 902 tablet_service.cc:1511] Processing CreateTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 (DEFAULT_TABLE table=default.Table_2dc810dbe0264b59aed3d2f2186ea1dd [id=003a72dcde564d29b771f069509c99cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.156024 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc1a472e7aa49639212a41619eabff3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.166281 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 9f33c2c00b414fbebf1965510e1e2b96 consensus state has no leader
W20260619 19:53:59.150758 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 285518us
I20260619 19:53:59.173069 2004 raft_consensus.cc:2749] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.176312 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:59.178591 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 9a4c335fc5ca4885b5482c6b749f76f9 consensus state has no leader
W20260619 19:53:59.178798 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_747e9c8819a64b7fae8a5ece57035907 [id=d0f3320ba06b47b38830db7ad44b766c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fe14a1f35cf14ca480221ee412c087da consensus state has no leader
I20260619 19:53:59.178745 919 raft_consensus.cc:2468] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
W20260619 19:53:59.178980 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet c54b2e4f657245c2aa23d138968b3b0d consensus state has no leader
W20260619 19:53:59.179522 859 leader_election.cc:343] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.179673 859 leader_election.cc:304] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.179888 859 raft_consensus.cc:2686] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:53:59.180061 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c396a42add84c62acecb9bbb5d57f1d consensus state has no leader
W20260619 19:53:59.180199 859 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:53:59.180352 859 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.180724 859 leader_election.cc:343] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.180845 859 leader_election.cc:304] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.181181 859 leader_election.cc:304] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:59.181201 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:59.181551 859 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:53:59.181651 859 leader_election.cc:304] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.182160 1832 raft_consensus.cc:2749] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:53:59.180475 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet bb547965fc7e4aa29d427b1acc7d6e51 consensus state has no leader
I20260619 19:53:59.182392 1832 raft_consensus.cc:2749] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.182544 1832 raft_consensus.cc:2804] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:59.182631 1832 raft_consensus.cc:493] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:59.182722 1832 raft_consensus.cc:3060] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.183552 2006 raft_consensus.cc:2749] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.183593 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.183760 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.185345 1994 ts_tablet_manager.cc:1929] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:59.185472 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:56684
W20260619 19:53:59.186483 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 991c877feeae43c580d9471c25c4424c consensus state has no leader
W20260619 19:53:59.186733 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet a33cb04fdb8944e8817d51bd56806665 consensus state has no leader
I20260619 19:53:59.188113 1832 raft_consensus.cc:515] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:59.188385 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 56ba47943b9d4123985ea6ca1478cd93 consensus state has no leader
W20260619 19:53:59.188679 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e8c3aef303b94d58aaa24917399ac240 consensus state has no leader
I20260619 19:53:59.189427 1832 leader_election.cc:290] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.190918 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e9d0ae96db4388a39a8b8f9c87187e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:53:59.191322 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet d0a9c96d9c034a4a8a4d05d8518ebcec consensus state has no leader
I20260619 19:53:59.191653 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_81965bd42e674af7a540c53e595dc804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.192328 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81965bd42e674af7a540c53e595dc804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:59.192363 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_3e4abf806ba34d899b138fb50dc5a60f [id=c03d7a64db6041eab96f911cc605a472], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 365c0bb1e9ac480e96e7f4d604048663 consensus state has no leader
W20260619 19:53:59.194032 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5fcb1050f57246feb65f7e8948856c21 consensus state has no leader
W20260619 19:53:59.194697 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fade40bf3e7145f29076821f091677bd consensus state has no leader
I20260619 19:53:59.194993 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.195633 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb547965fc7e4aa29d427b1acc7d6e51" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.197104 1994 log.cc:1199] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/e3031a45cf534814bbece8d271c0420e
W20260619 19:53:59.198963 532 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 42b0e811cf2a4bf4a23351f9ba5b6173 consensus state has no leader
I20260619 19:53:59.199015 1200 tablet_bootstrap.cc:492] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:59.199220 1200 ts_tablet_manager.cc:1403] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.235s user 0.004s sys 0.001s
I20260619 19:53:59.200465 1835 raft_consensus.cc:493] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.200636 1835 raft_consensus.cc:515] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.201256 1835 leader_election.cc:290] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:59.202113 532 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 194) took 1039 ms (client timeout 1000 ms). Trace:
I20260619 19:53:59.202349 2003 raft_consensus.cc:493] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.202522 2003 raft_consensus.cc:515] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.203270 2003 leader_election.cc:290] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:59.202232 532 rpcz_store.cc:269] 0619 19:53:58.163073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.295456 (+132383us) service_pool.cc:224] Handling call
0619 19:53:59.202050 (+906594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:58.676396 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:53:58.676556 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:53:58.676565 (+ 9us) write_op.cc:435] Acquired schema lock
0619 19:53:58.676568 (+ 3us) tablet.cc:662] Decoding operations
0619 19:53:58.676951 (+ 383us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:53:58.676969 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0619 19:53:58.676975 (+ 6us) tablet.cc:685] Acquiring locks for 14 operations
0619 19:53:58.677282 (+ 307us) tablet.cc:701] Row locks acquired
0619 19:53:58.677286 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:53:58.677332 (+ 46us) write_op.cc:270] Start()
0619 19:53:58.677375 (+ 43us) write_op.cc:276] Timestamp: P: 1781898838677263 usec, L: 0
0619 19:53:58.677379 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:53:58.677607 (+ 228us) log.cc:844] Serialized 5474 byte log entry
0619 19:53:58.683743 (+ 6136us) op_driver.cc:464] REPLICATION: finished
0619 19:53:58.683913 (+ 170us) write_op.cc:301] APPLY: starting
0619 19:53:58.683932 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0619 19:53:58.684027 (+ 95us) tablet.cc:1370] finished BulkCheckPresence
0619 19:53:58.684070 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:53:58.684340 (+ 270us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:53:58.684393 (+ 53us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0619 19:53:58.684401 (+ 8us) write_op.cc:312] APPLY: finished
0619 19:53:58.684529 (+ 128us) log.cc:844] Serialized 101 byte log entry
0619 19:53:58.684607 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:58.684648 (+ 41us) write_op.cc:454] Released schema lock
0619 19:53:58.684657 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0619 19:53:58.684753 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:58.684760 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:53:58.927060 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:53:58.927253 (+ 193us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:53:58.927263 (+ 10us) write_op.cc:435] Acquired schema lock
0619 19:53:58.927266 (+ 3us) tablet.cc:662] Decoding operations
0619 19:53:58.927398 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:53:58.927415 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0619 19:53:58.927423 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:53:58.927505 (+ 82us) tablet.cc:701] Row locks acquired
0619 19:53:58.927509 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:53:58.927569 (+ 60us) write_op.cc:270] Start()
0619 19:53:58.927611 (+ 42us) write_op.cc:276] Timestamp: P: 1781898838927521 usec, L: 0
0619 19:53:58.927618 (+ 7us) op_driver.cc:348] REPLICATION: starting
0619 19:53:58.928044 (+ 426us) log.cc:844] Serialized 356 byte log entry
0619 19:53:58.968997 (+ 40953us) op_driver.cc:464] REPLICATION: finished
0619 19:53:58.970686 (+ 1689us) write_op.cc:301] APPLY: starting
0619 19:53:58.970708 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0619 19:53:58.970757 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0619 19:53:58.970795 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:53:58.970877 (+ 82us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:53:58.970919 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:53:58.970929 (+ 10us) write_op.cc:312] APPLY: finished
0619 19:53:58.971017 (+ 88us) log.cc:844] Serialized 23 byte log entry
0619 19:53:58.971091 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:58.971114 (+ 23us) write_op.cc:454] Released schema lock
0619 19:53:58.971122 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:53:58.971264 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:58.971270 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":113,"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":818,"apply.run_wall_time_us":818,"num_ops":14,"prepare.queue_time_us":1127,"prepare.run_cpu_time_us":1338,"prepare.run_wall_time_us":1339,"raft.queue_time_us":1233,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":340,"replication_time_us":6327}],["op",{"apply.queue_time_us":1587,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":588,"mutex_wait_us":467,"num_ops":1,"prepare.queue_time_us":4584,"prepare.run_cpu_time_us":1000,"prepare.run_wall_time_us":10794,"raft.queue_time_us":1500,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":241,"replication_time_us":41339}]]}
I20260619 19:53:59.206607 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801f08f4daa842238460506ccd0c466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.207105 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.208240 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2eddd2ecabf543a7b170898e84e5a3d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.209681 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2eddd2ecabf543a7b170898e84e5a3d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.211320 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4023cceb8d9447c9952951c1d6bcdf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.210445 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41455237399b45efbe8190dcb01e764c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:59.212649 1994 ts_tablet_manager.cc:1950] T e3031a45cf534814bbece8d271c0420e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:59.215304 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68788824224b426bb433b87763073bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.217453 1200 raft_consensus.cc:359] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.217969 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet e3031a45cf534814bbece8d271c0420e (table default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]) successfully deleted
I20260619 19:53:59.219202 1059 raft_consensus.cc:3060] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.224762 2026 ts_tablet_manager.cc:1929] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:59.229116 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.230705 1200 raft_consensus.cc:385] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.233137 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.233376 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.234231 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.235113 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27342783a5641d7a324e71183269308" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.235508 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.235620 1994 tablet_replica.cc:333] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:59.235673 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.235853 1994 raft_consensus.cc:2243] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.236454 1994 raft_consensus.cc:2272] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.237146 1994 ts_tablet_manager.cc:1916] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.240134 1973 ts_tablet_manager.cc:1929] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:59.240458 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.240458 1200 raft_consensus.cc:740] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.237680 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.240774 1200 consensus_queue.cc:260] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.241022 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.241505 765 tablet_service.cc:1558] Processing DeleteTablet for tablet d29506dab4c84850ad79b8b7a0340987 with delete_type TABLET_DATA_DELETED (replaced by tablet 991c877feeae43c580d9471c25c4424c) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.242362 746 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.242568 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.242668 765 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.242997 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.243204 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.243243 1973 log.cc:1199] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/e3031a45cf534814bbece8d271c0420e
I20260619 19:53:59.243991 1973 ts_tablet_manager.cc:1950] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:59.244607 1973 tablet_replica.cc:333] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:59.244879 1973 raft_consensus.cc:2243] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.245144 1973 raft_consensus.cc:2272] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.245942 1973 ts_tablet_manager.cc:1916] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.247268 1200 ts_tablet_manager.cc:1434] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.042s user 0.003s sys 0.000s
I20260619 19:53:59.247964 2026 log.cc:1199] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/e151dc97ad13456ba35708d50c9d7b26
W20260619 19:53:59.236197 859 consensus_peers.cc:597] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8c889f13fbe49c3aab1e7f0d0d08e98. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:59.251281 765 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.251529 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.251891 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.252281 765 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.254129 1059 raft_consensus.cc:2468] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:59.254457 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.254738 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.257422 747 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.257658 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.257979 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.258152 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 7e3a8c4b651545c9ad620be798c63b53) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.258478 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c379d780b294b9a863576f53f79ee7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.258798 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 37393d7c16594032bf2a69abb0ab5931 with delete_type TABLET_DATA_DELETED (replaced by tablet a75baa585102481fa0ea01e87e394e32) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.258978 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.259317 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.260139 888 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 (DEFAULT_TABLE table=default.Table_299b0539a019486f9ab66bb6e24975a3 [id=0d428bc351c644c49601058ab8da82d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.260373 719 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.260723 892 tablet_service.cc:1511] Processing CreateTablet for tablet c08fc0181e5642d0a2b7967ff30d4eaa (DEFAULT_TABLE table=default.Table_1b1eebd6048a4df78f905c5f2d1959c3 [id=1debae55f0e7477db2e2285641220a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.260867 760 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.261912 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet e3031a45cf534814bbece8d271c0420e (table default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]) successfully deleted
I20260619 19:53:59.263200 1659 raft_consensus.cc:2804] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:53:59.263372 1659 raft_consensus.cc:697] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:59.263686 1659 consensus_queue.cc:237] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:59.260593 886 tablet_service.cc:1511] Processing CreateTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b (DEFAULT_TABLE table=default.Table_6d1f0f1124cb46138d7584cfd183ea34 [id=8eaf4a5b0ebb448bbb0fdd09953c2bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.263691 832 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
W20260619 19:53:59.265183 858 leader_election.cc:343] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.266363 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.273377 1200 tablet_bootstrap.cc:492] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:59.277841 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f6e202e8fd4a7292774d5eb4c7266b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.279965 1835 raft_consensus.cc:493] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.281176 1208 tablet_bootstrap.cc:492] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:59.281363 1208 ts_tablet_manager.cc:1403] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.274s user 0.010s sys 0.002s
I20260619 19:53:59.282212 1208 raft_consensus.cc:359] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.282408 1208 raft_consensus.cc:385] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.282475 1208 raft_consensus.cc:740] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.288127 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33935217c1f44ce0ad5b8610d368f2eb" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:59.290817 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 115032us
I20260619 19:53:59.293917 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.294814 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3031a45cf534814bbece8d271c0420e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:53:59.295548 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:46791, user_credentials={real_user=slave}} blocked reactor thread for 65436.5us
I20260619 19:53:59.297354 1200 tablet_bootstrap.cc:654] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.299247 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c08fc0181e5642d0a2b7967ff30d4eaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.299548 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 365c0bb1e9ac480e96e7f4d604048663 consensus state has no leader
I20260619 19:53:59.304327 2016 raft_consensus.cc:493] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.304524 2016 raft_consensus.cc:515] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.305234 2016 leader_election.cc:290] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.305403 921 raft_consensus.cc:2468] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:59.306015 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41455237399b45efbe8190dcb01e764c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.306313 1059 raft_consensus.cc:2393] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:59.308387 1835 raft_consensus.cc:515] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.308954 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.309093 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.309283 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.309616 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.309980 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 376dfca0b54d4c689c96242566869717 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.310379 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.310724 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.311074 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.311439 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.311779 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.311870 919 raft_consensus.cc:3060] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.312186 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.312700 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet e3031a45cf534814bbece8d271c0420e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.312950 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.313513 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.313745 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.314133 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.314468 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:33622
W20260619 19:53:59.314774 523 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 220) took 889 ms (client timeout 1000 ms). Trace:
I20260619 19:53:59.314800 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.315253 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.316082 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.316423 1973 ts_tablet_manager.cc:1929] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:59.316567 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.317298 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.317502 1973 log.cc:1199] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/40e1b92467a44737bfabb6ec1c924ea1
I20260619 19:53:59.317741 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.318097 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:53:59.317713 523 rpcz_store.cc:269] 0619 19:53:58.425499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.428220 (+ 2721us) service_pool.cc:224] Handling call
0619 19:53:58.461370 (+ 33150us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:53:59.314713 (+853343us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:58.949929 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:53:58.950057 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:53:58.950066 (+ 9us) write_op.cc:435] Acquired schema lock
0619 19:53:58.950069 (+ 3us) tablet.cc:662] Decoding operations
0619 19:53:58.950192 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:53:58.950204 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0619 19:53:58.950211 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:53:58.950328 (+ 117us) tablet.cc:701] Row locks acquired
0619 19:53:58.950332 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:53:58.950372 (+ 40us) write_op.cc:270] Start()
0619 19:53:58.950413 (+ 41us) write_op.cc:276] Timestamp: P: 1781898838950326 usec, L: 0
0619 19:53:58.950418 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 19:53:58.950626 (+ 208us) log.cc:844] Serialized 913 byte log entry
0619 19:53:58.975024 (+ 24398us) op_driver.cc:464] REPLICATION: finished
0619 19:53:58.975820 (+ 796us) write_op.cc:301] APPLY: starting
0619 19:53:58.975843 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0619 19:53:58.975872 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0619 19:53:58.975913 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:53:58.975958 (+ 45us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:53:58.975981 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:53:58.975988 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:53:58.976035 (+ 47us) log.cc:844] Serialized 29 byte log entry
0619 19:53:58.976072 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:58.976085 (+ 13us) write_op.cc:454] Released schema lock
0619 19:53:58.976090 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0619 19:53:58.976151 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:58.976154 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":97,"spinlock_wait_cycles":45120256,"child_traces":[["op",{"apply.queue_time_us":770,"apply.run_cpu_time_us":319,"apply.run_wall_time_us":319,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":773,"prepare.run_wall_time_us":1109,"replication_time_us":24591}]]}
I20260619 19:53:59.318393 1973 ts_tablet_manager.cc:1950] T 40e1b92467a44737bfabb6ec1c924ea1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:59.318567 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c379d780b294b9a863576f53f79ee7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.319005 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.322235 1973 tablet_replica.cc:333] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:59.322537 1973 raft_consensus.cc:2243] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.322731 1835 leader_election.cc:290] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.322781 1973 raft_consensus.cc:2272] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.324082 1208 consensus_queue.cc:260] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.326426 1208 ts_tablet_manager.cc:1434] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.045s user 0.002s sys 0.001s
I20260619 19:53:59.327723 1208 tablet_bootstrap.cc:492] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:59.329257 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.329723 1208 tablet_bootstrap.cc:654] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.330963 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.331725 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.332911 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]) successfully deleted
W20260619 19:53:59.333210 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8e3354ae6dd46bd9c5414d4c4a720a1 already in progress: creating tablet
W20260619 19:53:59.333457 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6c6ad82f0c94e27b2eb4dbf185fab66 already in progress: creating tablet
I20260619 19:53:59.334503 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6fd994ad984e43798d665d87cf37c8f1" } modify_external_catalogs: true
I20260619 19:53:59.334618 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7a1b2d870fc840db98f41ddb6dedc0fa" } new_table_name: "default.Table_68c5aafd2b074c8cb05af88820d8fb40" modify_external_catalogs: true
I20260619 19:53:59.334725 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6fd994ad984e43798d665d87cf37c8f1" } modify_external_catalogs: true
I20260619 19:53:59.336359 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d7e665d3d76f4453b1daa939934eb82b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.337072 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7e665d3d76f4453b1daa939934eb82b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.338508 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_543df7cf4dd94f00b3cb83082b6941d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.339072 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_543df7cf4dd94f00b3cb83082b6941d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.339058 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.339529 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.351671 1994 ts_tablet_manager.cc:1929] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:59.351879 1994 log.cc:1199] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/40e1b92467a44737bfabb6ec1c924ea1
I20260619 19:53:59.352380 1994 ts_tablet_manager.cc:1950] T 40e1b92467a44737bfabb6ec1c924ea1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:59.353551 1994 tablet_replica.cc:333] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:59.353842 1994 raft_consensus.cc:2243] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.354084 1994 raft_consensus.cc:2272] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.354581 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]) successfully deleted
W20260619 19:53:59.355010 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6c6ad82f0c94e27b2eb4dbf185fab66 already in progress: creating tablet
I20260619 19:53:59.356964 1200 tablet_bootstrap.cc:492] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:59.357193 1200 ts_tablet_manager.cc:1403] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.084s user 0.006s sys 0.002s
I20260619 19:53:59.357971 1200 raft_consensus.cc:359] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.358265 1200 raft_consensus.cc:385] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.358368 1200 raft_consensus.cc:740] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.358695 1200 consensus_queue.cc:260] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:59.360546 859 leader_election.cc:343] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.332583 719 leader_election.cc:304] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.363155 2018 raft_consensus.cc:3060] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.364557 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41455237399b45efbe8190dcb01e764c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:53:59.364765 781 raft_consensus.cc:3060] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.368297 781 raft_consensus.cc:2468] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:59.368970 1200 ts_tablet_manager.cc:1434] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260619 19:53:59.369064 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27342783a5641d7a324e71183269308" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.369850 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.370645 2018 raft_consensus.cc:2749] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.370853 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb56767231db42bebb75a45b5d512de3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.362775 1973 ts_tablet_manager.cc:1916] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.376962 1208 tablet_bootstrap.cc:492] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:59.383028 1208 ts_tablet_manager.cc:1403] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.004s
I20260619 19:53:59.389998 1208 raft_consensus.cc:359] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.390641 1208 raft_consensus.cc:385] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.393450 1200 tablet_bootstrap.cc:492] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:59.392915 1208 raft_consensus.cc:740] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.395725 1200 tablet_bootstrap.cc:654] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.396096 1208 consensus_queue.cc:260] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.398288 1208 ts_tablet_manager.cc:1434] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260619 19:53:59.355077 1994 ts_tablet_manager.cc:1916] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:59.404031 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 362747us
W20260619 19:53:59.404489 996 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
W20260619 19:53:59.405493 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0dd210e843db4f58a976af5c28dabc9c consensus state has no leader
I20260619 19:53:59.405781 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 74949d09466f42e2852389e10192989d from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:59.409942 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_828ae87da1244552a87a9526a110dd46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:59.411616 859 leader_election.cc:304] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.403442 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41455237399b45efbe8190dcb01e764c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:59.415149 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_828ae87da1244552a87a9526a110dd46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:53:59.416249 1652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s user 0.002s sys 0.032s
I20260619 19:53:59.415170 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b88dd7d19514e83857e2c6108291b9f from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:59.419062 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a690a4fdf60947acb271abe588d4b5c0
I20260619 19:53:59.420028 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c96959e2ef2748848e2d44f338764f43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.420656 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c96959e2ef2748848e2d44f338764f43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.422557 919 raft_consensus.cc:2468] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:59.424757 760 tablet_service.cc:1511] Processing CreateTablet for tablet fe814880d9984bbd83fa121cb2a34eac (DEFAULT_TABLE table=default.Table_6c755150293e4861b3e1403d72ead695 [id=55ec6de1c2744eb39dba9656343893b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.425300 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe814880d9984bbd83fa121cb2a34eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.437569 748 tablet_service.cc:1511] Processing CreateTablet for tablet 47ace991ad1a4d52ab609940aacf6681 (DEFAULT_TABLE table=default.Table_249c2339f026459ca9576edb3239bafb [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.437631 1860 consensus_queue.cc:1048] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:59.438043 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ace991ad1a4d52ab609940aacf6681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.438064 2035 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.438215 2035 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.438915 2035 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:59.439702 1022 tablet_service.cc:1511] Processing CreateTablet for tablet fe814880d9984bbd83fa121cb2a34eac (DEFAULT_TABLE table=default.Table_6c755150293e4861b3e1403d72ead695 [id=55ec6de1c2744eb39dba9656343893b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.440133 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe814880d9984bbd83fa121cb2a34eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.440655 1023 tablet_service.cc:1511] Processing CreateTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c (DEFAULT_TABLE table=default.Table_a3a01d252a2541dd95002687f46086cf [id=9a77efaee2cd4b07aa78d2910aeeab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.441042 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6bc52ee1fa4ac8967f937e59b4550c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.441110 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 9d905e7076014c818e1fb1ef09c15342 (DEFAULT_TABLE table=default.Table_4d84da14868f41e5afe84ea58bd57ab9 [id=6e5582a72f36485783705cfb2f671ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.441443 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d905e7076014c818e1fb1ef09c15342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.443539 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 97b365df01054338a056cb0d469bc8db (DEFAULT_TABLE table=default.Table_562ea43e7e234e69b6f21e17e277a855 [id=e22019f0806e4540a6ee0c9cb0442838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.445025 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 47ace991ad1a4d52ab609940aacf6681 (DEFAULT_TABLE table=default.Table_249c2339f026459ca9576edb3239bafb [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.445344 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b365df01054338a056cb0d469bc8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.446606 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ace991ad1a4d52ab609940aacf6681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.446848 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9d905e7076014c818e1fb1ef09c15342 (DEFAULT_TABLE table=default.Table_4d84da14868f41e5afe84ea58bd57ab9 [id=6e5582a72f36485783705cfb2f671ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.447293 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d905e7076014c818e1fb1ef09c15342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.454177 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 5aaf38b6b7b14298ae0e73bc421de988 (DEFAULT_TABLE table=default.Table_69117f2dee814224aae2f87b67f524be [id=b43183cd974741569d498459af5b94e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.454627 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aaf38b6b7b14298ae0e73bc421de988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.457567 765 tablet_service.cc:1558] Processing DeleteTablet for tablet a690a4fdf60947acb271abe588d4b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:53:59.458349 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5aaf38b6b7b14298ae0e73bc421de988 (DEFAULT_TABLE table=default.Table_69117f2dee814224aae2f87b67f524be [id=b43183cd974741569d498459af5b94e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.459188 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aaf38b6b7b14298ae0e73bc421de988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.463174 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 774938222588473e90c513232c82aece (DEFAULT_TABLE table=default.Table_acb740f517fd4c61bff72f7ceafb5f75 [id=7f73d9f5b89c4d5798cb7f9d95595c8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.463315 1037 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d (DEFAULT_TABLE table=default.Table_384d87b1154345fd9feaa4bac544af49 [id=282cf765f9e04a38a724e2d4a6f3245c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.463593 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774938222588473e90c513232c82aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.463814 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.468016 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 (DEFAULT_TABLE table=default.Table_ead8fa6263094ddbb60465a7ba503ce3 [id=07abbfb4efc94a4a9104ba6600121313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.469012 748 tablet_service.cc:1511] Processing CreateTablet for tablet 97b365df01054338a056cb0d469bc8db (DEFAULT_TABLE table=default.Table_562ea43e7e234e69b6f21e17e277a855 [id=e22019f0806e4540a6ee0c9cb0442838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.470024 1038 tablet_service.cc:1511] Processing CreateTablet for tablet f305a99e3481419196532cb5c62c2500 (DEFAULT_TABLE table=default.Table_1d74433076a3413f90471ec48b668e5f [id=7020f678d0034cd59f74dce2a0ecf0bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.470454 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f305a99e3481419196532cb5c62c2500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.471328 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 (DEFAULT_TABLE table=default.Table_ead8fa6263094ddbb60465a7ba503ce3 [id=07abbfb4efc94a4a9104ba6600121313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.471421 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 (DEFAULT_TABLE table=default.Table_e1877af4dc434ff5a38408207ea93c47 [id=9217b336b73943539d0822ba734db057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.471454 765 tablet_service.cc:1511] Processing CreateTablet for tablet b2902c7f67a1402987315ee426ddf1d2 (DEFAULT_TABLE table=default.Table_5e38109b2d8b496290d95d8b61a1512b [id=902aaad2317e43f891464a10dd2e334f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.471721 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8614b0ab1a3749a1a0aa441574f79ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.471786 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8614b0ab1a3749a1a0aa441574f79ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.471925 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e6dcf87d57044279a218cbb21c383352 (DEFAULT_TABLE table=default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.472680 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6dcf87d57044279a218cbb21c383352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.475597 760 tablet_service.cc:1511] Processing CreateTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c (DEFAULT_TABLE table=default.Table_a3a01d252a2541dd95002687f46086cf [id=9a77efaee2cd4b07aa78d2910aeeab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.475683 1024 tablet_service.cc:1511] Processing CreateTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.476218 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0cd4cd0661415d8b2b2339363e7aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.476729 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6bc52ee1fa4ac8967f937e59b4550c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.477170 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8522f562665540ce99490ab90e02d801 consensus state has no leader
I20260619 19:53:59.479534 747 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d (DEFAULT_TABLE table=default.Table_384d87b1154345fd9feaa4bac544af49 [id=282cf765f9e04a38a724e2d4a6f3245c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.479952 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.481106 1029 tablet_service.cc:1511] Processing CreateTablet for tablet b2902c7f67a1402987315ee426ddf1d2 (DEFAULT_TABLE table=default.Table_5e38109b2d8b496290d95d8b61a1512b [id=902aaad2317e43f891464a10dd2e334f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.481472 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2902c7f67a1402987315ee426ddf1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.482580 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c9a91f95bb4bcdafe493bab8c393b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.487473 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 82690.2us
I20260619 19:53:59.487864 1860 consensus_queue.cc:1048] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:59.489229 996 leader_election.cc:304] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:59.489533 1860 raft_consensus.cc:2804] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:59.489810 1860 raft_consensus.cc:697] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:59.490578 1860 consensus_queue.cc:237] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.495365 755 tablet_service.cc:1511] Processing CreateTablet for tablet f305a99e3481419196532cb5c62c2500 (DEFAULT_TABLE table=default.Table_1d74433076a3413f90471ec48b668e5f [id=7020f678d0034cd59f74dce2a0ecf0bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.495980 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f305a99e3481419196532cb5c62c2500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.504288 746 tablet_service.cc:1511] Processing CreateTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 (DEFAULT_TABLE table=default.Table_e1877af4dc434ff5a38408207ea93c47 [id=9217b336b73943539d0822ba734db057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.504841 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c9a91f95bb4bcdafe493bab8c393b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.512004 996 leader_election.cc:304] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:59.512501 2021 raft_consensus.cc:2804] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:59.512648 2021 raft_consensus.cc:697] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:59.512952 2021 consensus_queue.cc:237] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.514210 1994 ts_tablet_manager.cc:1929] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:53:59.514478 1994 log.cc:1199] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b65f88b43b4e45c481aa7d43ef59fe7a
I20260619 19:53:59.512059 757 tablet_service.cc:1511] Processing CreateTablet for tablet e6dcf87d57044279a218cbb21c383352 (DEFAULT_TABLE table=default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.518407 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6dcf87d57044279a218cbb21c383352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.528056 747 tablet_service.cc:1511] Processing CreateTablet for tablet 774938222588473e90c513232c82aece (DEFAULT_TABLE table=default.Table_acb740f517fd4c61bff72f7ceafb5f75 [id=7f73d9f5b89c4d5798cb7f9d95595c8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.528505 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774938222588473e90c513232c82aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.529570 757 tablet_service.cc:1511] Processing CreateTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.530057 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0cd4cd0661415d8b2b2339363e7aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.530788 1994 ts_tablet_manager.cc:1950] T b65f88b43b4e45c481aa7d43ef59fe7a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:59.531281 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b365df01054338a056cb0d469bc8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.534981 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2902c7f67a1402987315ee426ddf1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.535810 755 tablet_service.cc:1511] Processing CreateTablet for tablet 710fae36dd674b1786aa75013284684e (DEFAULT_TABLE table=default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c [id=a60f9d6abee04893a759c7913479216f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.536249 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710fae36dd674b1786aa75013284684e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.542847 1652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s user 0.002s sys 0.032s
I20260619 19:53:59.542994 1994 tablet_replica.cc:333] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:59.543285 1994 raft_consensus.cc:2243] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.543527 922 raft_consensus.cc:2393] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:53:59.545334 1994 raft_consensus.cc:2272] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.545989 1994 ts_tablet_manager.cc:1916] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:59.546442 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 245652us
I20260619 19:53:59.546775 2012 raft_consensus.cc:493] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:59.555940 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 43984.6us
I20260619 19:53:59.564529 1200 tablet_bootstrap.cc:492] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:53:59.564867 1200 ts_tablet_manager.cc:1403] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.172s user 0.003s sys 0.017s
I20260619 19:53:59.569449 1200 raft_consensus.cc:359] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.569834 1200 raft_consensus.cc:385] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.570001 1200 raft_consensus.cc:740] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.570345 1200 consensus_queue.cc:260] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.571265 1200 ts_tablet_manager.cc:1434] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260619 19:53:59.571628 1200 tablet_bootstrap.cc:492] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:53:59.571808 891 tablet_service.cc:1511] Processing CreateTablet for tablet bf175c80483346788a148b7277b9ca9d (DEFAULT_TABLE table=default.Table_9359939c44674491aed56c5ad7d71e13 [id=14dbea33ca974c8fa94e99d0d9f79272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.574386 1200 tablet_bootstrap.cc:654] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.577176 858 leader_election.cc:304] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:53:59.578892 916 raft_consensus.cc:2468] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:59.579185 920 raft_consensus.cc:2468] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:53:59.583088 2012 raft_consensus.cc:515] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.583889 2012 leader_election.cc:290] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.579254 2026 ts_tablet_manager.cc:1950] T e151dc97ad13456ba35708d50c9d7b26 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:53:59.587226 1652 raft_consensus.cc:2804] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:59.587409 1652 raft_consensus.cc:697] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:53:59.587689 1652 consensus_queue.cc:237] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.593364 1832 raft_consensus.cc:2749] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.594544 885 tablet_service.cc:1558] Processing DeleteTablet for tablet cbec819571854db8a46daae15b9127bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:53:59.587055 2024 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.407s user 0.000s sys 0.000s
I20260619 19:53:59.600970 887 tablet_service.cc:1511] Processing CreateTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c (DEFAULT_TABLE table=default.Table_a3a01d252a2541dd95002687f46086cf [id=9a77efaee2cd4b07aa78d2910aeeab77]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:59.602866 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 210931us
I20260619 19:53:59.606415 888 tablet_service.cc:1511] Processing CreateTablet for tablet 47ace991ad1a4d52ab609940aacf6681 (DEFAULT_TABLE table=default.Table_249c2339f026459ca9576edb3239bafb [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.606484 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b65f88b43b4e45c481aa7d43ef59fe7a (table default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]) successfully deleted
W20260619 19:53:59.606745 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cbec819571854db8a46daae15b9127bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbec819571854db8a46daae15b9127bd already in progress: creating tablet
I20260619 19:53:59.608433 1835 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.608584 1835 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:59.609053 2004 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.609457 885 tablet_service.cc:1511] Processing CreateTablet for tablet 97b365df01054338a056cb0d469bc8db (DEFAULT_TABLE table=default.Table_562ea43e7e234e69b6f21e17e277a855 [id=e22019f0806e4540a6ee0c9cb0442838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.609968 2004 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:59.610661 2026 tablet_replica.cc:333] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:53:59.612306 889 tablet_service.cc:1511] Processing CreateTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 (DEFAULT_TABLE table=default.Table_64d25d0d86ef4a70a981ebed6a29e834 [id=2269d802204a4c9189f2eda909734b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.618749 898 tablet_service.cc:1511] Processing CreateTablet for tablet fe814880d9984bbd83fa121cb2a34eac (DEFAULT_TABLE table=default.Table_6c755150293e4861b3e1403d72ead695 [id=55ec6de1c2744eb39dba9656343893b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:53:59.619004 859 leader_election.cc:343] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.619148 859 leader_election.cc:304] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.619587 859 leader_election.cc:343] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.619724 859 leader_election.cc:304] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.620226 859 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.620324 859 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:53:59.621021 2023 raft_consensus.cc:2749] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.621239 2023 raft_consensus.cc:2749] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.621404 2023 raft_consensus.cc:2749] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.621850 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 45c0ffb4629a46349ccfe473cc20cdfc from {username='slave'} at 127.0.0.1:37030
W20260619 19:53:59.622970 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11e9d0ae96db4388a39a8b8f9c87187e consensus state has no leader
I20260619 19:53:59.623207 1201 ts_tablet_manager.cc:1403] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.675s user 0.024s sys 0.007s
I20260619 19:53:59.623958 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf175c80483346788a148b7277b9ca9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.628364 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6bc52ee1fa4ac8967f937e59b4550c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.628692 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b365df01054338a056cb0d469bc8db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.631270 890 consensus_meta.cc:287] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.589s user 0.000s sys 0.004s
I20260619 19:53:59.631829 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe814880d9984bbd83fa121cb2a34eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.658622 2004 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:59.659641 2026 raft_consensus.cc:2243] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:53:59.660514 886 tablet_service.cc:1558] Processing DeleteTablet for tablet a690a4fdf60947acb271abe588d4b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.665850 2003 raft_consensus.cc:493] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.602183 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 710fae36dd674b1786aa75013284684e (DEFAULT_TABLE table=default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c [id=a60f9d6abee04893a759c7913479216f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.666489 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710fae36dd674b1786aa75013284684e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.666412 1201 raft_consensus.cc:359] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.606251 2021 raft_consensus.cc:493] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.669317 2021 raft_consensus.cc:515] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.670006 2021 leader_election.cc:290] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:59.670378 2021 consensus_queue.cc:1048] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:59.674665 2067 raft_consensus.cc:493] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.674974 2067 raft_consensus.cc:515] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.605748 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a690a4fdf60947acb271abe588d4b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.628808 1994 ts_tablet_manager.cc:1929] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:53:59.636059 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.659963 1695 consensus_queue.cc:1048] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:59.661041 2035 consensus_queue.cc:1048] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:53:59.678479 1994 log.cc:1199] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/2d64ccbb2f2840f4ac51cf8556da4a2c
I20260619 19:53:59.681352 2026 raft_consensus.cc:2272] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.684440 885 tablet_service.cc:1511] Processing CreateTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 (DEFAULT_TABLE table=default.Table_ead8fa6263094ddbb60465a7ba503ce3 [id=07abbfb4efc94a4a9104ba6600121313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.686108 1059 raft_consensus.cc:2468] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:59.684440 896 tablet_service.cc:1511] Processing CreateTablet for tablet f305a99e3481419196532cb5c62c2500 (DEFAULT_TABLE table=default.Table_1d74433076a3413f90471ec48b668e5f [id=7020f678d0034cd59f74dce2a0ecf0bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.686641 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:53:59.688292 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 997cd0b5a8d24b56a2d5b95ab877d95f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 997cd0b5a8d24b56a2d5b95ab877d95f already in progress: creating tablet
W20260619 19:53:59.688601 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 46dcf2293e2d461ca1be171069867d1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcf2293e2d461ca1be171069867d1f already in progress: creating tablet
I20260619 19:53:59.689491 1208 tablet_bootstrap.cc:492] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:59.689810 719 leader_election.cc:304] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.690516 719 raft_consensus.cc:2686] T e3031a45cf534814bbece8d271c0420e P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:53:59.690505 902 tablet_service.cc:1511] Processing CreateTablet for tablet e6dcf87d57044279a218cbb21c383352 (DEFAULT_TABLE table=default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.690811 887 tablet_service.cc:1511] Processing CreateTablet for tablet 9d905e7076014c818e1fb1ef09c15342 (DEFAULT_TABLE table=default.Table_4d84da14868f41e5afe84ea58bd57ab9 [id=6e5582a72f36485783705cfb2f671ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.691365 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.692689 783 raft_consensus.cc:2468] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:59.693586 1835 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:59.693740 2003 raft_consensus.cc:515] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:59.694000 1201 raft_consensus.cc:385] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.694149 1201 raft_consensus.cc:740] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.694862 886 tablet_service.cc:1511] Processing CreateTablet for tablet b2902c7f67a1402987315ee426ddf1d2 (DEFAULT_TABLE table=default.Table_5e38109b2d8b496290d95d8b61a1512b [id=902aaad2317e43f891464a10dd2e334f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.695027 1201 consensus_queue.cc:260] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.695374 884 tablet_service.cc:1511] Processing CreateTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 (DEFAULT_TABLE table=default.Table_e1877af4dc434ff5a38408207ea93c47 [id=9217b336b73943539d0822ba734db057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.694658 2003 leader_election.cc:290] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:59.696857 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7a804e38bb484833a00aecd12f4ad7e0" } modify_external_catalogs: true
I20260619 19:53:59.697078 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7a804e38bb484833a00aecd12f4ad7e0" } modify_external_catalogs: true
W20260619 19:53:59.698915 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 46785.7us
I20260619 19:53:59.698966 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b7a85268c6354f84a478e25b647e5d43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.699605 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7a85268c6354f84a478e25b647e5d43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.701038 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f033cfea20b845c1b3c6e07f0ace5248"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.701602 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f033cfea20b845c1b3c6e07f0ace5248 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.701692 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e253cf6ca249466ebb47d8d6022e8287" } modify_external_catalogs: true
I20260619 19:53:59.701900 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e253cf6ca249466ebb47d8d6022e8287" } modify_external_catalogs: true
I20260619 19:53:59.704818 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 74949d09466f42e2852389e10192989d
I20260619 19:53:59.704849 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 2c71f92f4e3040c09b67e287a19eea74
I20260619 19:53:59.705405 529 catalog_manager.cc:6784] ReplaceTablet: tablet 74949d09466f42e2852389e10192989d deleted and replaced by tablet 5482cf46c91d426484938c387b785d61
I20260619 19:53:59.705664 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 68788824224b426bb433b87763073bae from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:59.705688 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b88dd7d19514e83857e2c6108291b9f from {username='slave'} at 127.0.0.1:37030
I20260619 19:53:59.707381 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:53:59.708256 1994 ts_tablet_manager.cc:1950] T 2d64ccbb2f2840f4ac51cf8556da4a2c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:53:59.711311 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 4b88dd7d19514e83857e2c6108291b9f
I20260619 19:53:59.711916 525 catalog_manager.cc:6784] ReplaceTablet: tablet 4b88dd7d19514e83857e2c6108291b9f deleted and replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d
I20260619 19:53:59.716393 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a8fb8233cb894c4c8307e05b0c6a3ba4" } new_table_name: "default.Table_93a36817c65c48b5b2e86a7b7a2937be" modify_external_catalogs: true
I20260619 19:53:59.716482 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a3a01d252a2541dd95002687f46086cf" } new_table_name: "default.Table_2418879ae8fc4eadb945b509d8234ae2" modify_external_catalogs: true
I20260619 19:53:59.717933 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d2c62460bd8d448584fc4e76100e5fea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.718585 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2c62460bd8d448584fc4e76100e5fea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.720067 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_09a6a4004a244d5087ee5476d0d28299" } new_table_name: "default.Table_0761528dd12f4e449282247241577e72" modify_external_catalogs: true
W20260619 19:53:59.681558 858 leader_election.cc:343] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.732105 894 tablet_service.cc:1558] Processing DeleteTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.734131 1201 ts_tablet_manager.cc:1434] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.072s user 0.002s sys 0.001s
I20260619 19:53:59.734192 901 tablet_service.cc:1511] Processing CreateTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.734918 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ace991ad1a4d52ab609940aacf6681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.737797 1201 tablet_bootstrap.cc:492] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:59.738538 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:59.739650 922 raft_consensus.cc:2468] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:53:59.742345 719 leader_election.cc:304] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.742832 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 44593.8us
I20260619 19:53:59.743170 890 tablet_service.cc:1511] Processing CreateTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d (DEFAULT_TABLE table=default.Table_384d87b1154345fd9feaa4bac544af49 [id=282cf765f9e04a38a724e2d4a6f3245c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.743332 2016 raft_consensus.cc:2749] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:53:59.744241 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 125600us
I20260619 19:53:59.746284 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0cd4cd0661415d8b2b2339363e7aca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.748097 858 leader_election.cc:343] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:53:59.748461 858 leader_election.cc:343] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.751722 2018 raft_consensus.cc:493] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:53:59.752215 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e6dcf87d57044279a218cbb21c383352
I20260619 19:53:59.753285 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_953dc7c447e340df89e3d8ffa53c6f9d" } new_table_name: "default.Table_133d7ea5230b46b39f99d27ceeef20c8" modify_external_catalogs: true
I20260619 19:53:59.753458 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b79ac240d4f14940b5676186655549bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.754173 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b79ac240d4f14940b5676186655549bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.755667 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4c7e1ad3890d4f9dbc9f41258e5d20b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.756244 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c7e1ad3890d4f9dbc9f41258e5d20b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.758244 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8bc11c632b514118856ea4c11b431142
I20260619 19:53:59.759058 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3c367a8e42c347f890d88beca48e6c25" } modify_external_catalogs: true
I20260619 19:53:59.759305 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3c367a8e42c347f890d88beca48e6c25" } modify_external_catalogs: true
W20260619 19:53:59.762230 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 53241.4us
I20260619 19:53:59.762539 996 leader_election.cc:304] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:53:59.767011 720 leader_election.cc:304] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:59.770603 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.786119 892 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.786679 1201 tablet_bootstrap.cc:654] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.788071 1973 ts_tablet_manager.cc:1929] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:53:59.788443 2017 raft_consensus.cc:2804] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260619 19:53:59.789232 2052 log.cc:927] Time spent T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20260619 19:53:59.791577 2018 raft_consensus.cc:515] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:53:59.791911 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb6bc52ee1fa4ac8967f937e59b4550c consensus state has no leader
I20260619 19:53:59.795604 1973 log.cc:1199] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:53:59.796132 2017 raft_consensus.cc:493] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:59.796298 2017 raft_consensus.cc:3060] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.798431 2035 raft_consensus.cc:2804] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:59.798630 2035 raft_consensus.cc:697] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:53:59.799059 2067 leader_election.cc:290] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:53:59.799598 895 tablet_service.cc:1511] Processing CreateTablet for tablet 5aaf38b6b7b14298ae0e73bc421de988 (DEFAULT_TABLE table=default.Table_69117f2dee814224aae2f87b67f524be [id=b43183cd974741569d498459af5b94e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.806349 2026 ts_tablet_manager.cc:1916] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:53:59.806572 859 leader_election.cc:343] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:53:59.806797 859 leader_election.cc:304] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:53:59.807123 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 186308us
I20260619 19:53:59.807247 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.807976 2018 leader_election.cc:290] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.808696 1840 raft_consensus.cc:2749] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:53:59.810657 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.810850 897 tablet_service.cc:1511] Processing CreateTablet for tablet 774938222588473e90c513232c82aece (DEFAULT_TABLE table=default.Table_acb740f517fd4c61bff72f7ceafb5f75 [id=7f73d9f5b89c4d5798cb7f9d95595c8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.811076 918 raft_consensus.cc:2468] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:53:59.811194 900 tablet_service.cc:1511] Processing CreateTablet for tablet 710fae36dd674b1786aa75013284684e (DEFAULT_TABLE table=default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c [id=a60f9d6abee04893a759c7913479216f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.811380 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f305a99e3481419196532cb5c62c2500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.812064 2003 consensus_queue.cc:1048] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260619 19:53:59.812561 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.812733 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 74949d09466f42e2852389e10192989d with delete_type TABLET_DATA_DELETED (replaced by tablet 5482cf46c91d426484938c387b785d61) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.816313 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2902c7f67a1402987315ee426ddf1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.818107 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8614b0ab1a3749a1a0aa441574f79ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.818436 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05c9a91f95bb4bcdafe493bab8c393b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.820298 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6dcf87d57044279a218cbb21c383352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.824167 1973 ts_tablet_manager.cc:1950] T d8c889f13fbe49c3aab1e7f0d0d08e98 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:53:59.824553 1201 tablet_bootstrap.cc:492] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:53:59.824560 1994 tablet_replica.cc:333] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:53:59.824780 2035 consensus_queue.cc:237] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.824911 2017 raft_consensus.cc:515] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.825110 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dac857d85b7e4b748ff854769df04686"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:59.825752 2017 leader_election.cc:290] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:53:59.825819 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dac857d85b7e4b748ff854769df04686 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.826565 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d905e7076014c818e1fb1ef09c15342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.827175 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.828250 1201 ts_tablet_manager.cc:1403] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.090s user 0.001s sys 0.005s
I20260619 19:53:59.828486 1208 tablet_bootstrap.cc:654] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.829226 1201 raft_consensus.cc:359] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.829404 1201 raft_consensus.cc:385] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.829571 1201 raft_consensus.cc:740] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.829815 1201 consensus_queue.cc:260] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.830066 1973 tablet_replica.cc:333] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:53:59.830277 1973 raft_consensus.cc:2243] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:59.831013 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c71f92f4e3040c09b67e287a19eea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.831398 1973 raft_consensus.cc:2272] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.831687 1201 ts_tablet_manager.cc:1434] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:53:59.832116 1973 ts_tablet_manager.cc:1916] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.837596 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:53:59.838532 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774938222588473e90c513232c82aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.839248 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710fae36dd674b1786aa75013284684e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.838637 1201 tablet_bootstrap.cc:492] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:53:59.840548 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 2d64ccbb2f2840f4ac51cf8556da4a2c (table default.Table_e4f08490c62f47249298bc6684dd80bb [id=7018bca0519c45289b5131c3e4484774]) successfully deleted
I20260619 19:53:59.841482 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.842592 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.843766 1994 raft_consensus.cc:2243] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:53:59.844082 1994 pending_rounds.cc:70] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:53:59.844875 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.849606 1994 pending_rounds.cc:77] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657646648393728 op_type: NO_OP noop_request { }
I20260619 19:53:59.849799 1994 raft_consensus.cc:2889] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:53:59.851949 1994 raft_consensus.cc:2272] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:53:59.854311 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.856632 1060 raft_consensus.cc:2468] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
W20260619 19:53:59.857786 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e65ca84182d40c280ec2b0555c0de86 has no consensus state
I20260619 19:53:59.858172 720 leader_election.cc:304] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:59.858703 2018 raft_consensus.cc:2804] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:53:59.858827 2018 raft_consensus.cc:493] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:53:59.858964 2018 raft_consensus.cc:3060] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.862392 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.862692 1994 ts_tablet_manager.cc:1916] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:53:59.866204 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb56767231db42bebb75a45b5d512de3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:53:59.883559 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:59.884341 1059 raft_consensus.cc:3060] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.885740 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e0ce0d7cc0c64198a4c44d4bbd6a154f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.886407 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0ce0d7cc0c64198a4c44d4bbd6a154f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.888123 1059 raft_consensus.cc:2468] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:59.889557 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_00c1932320834358a5d2177cce3bd429"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.890148 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00c1932320834358a5d2177cce3bd429 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.892243 1024 tablet_service.cc:1511] Processing CreateTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd (DEFAULT_TABLE table=default.Table_7babf9e56d174c6abc66c591fff1eace [id=3000203e95cc423cb4ab88f7c33f76c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.893926 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 2943333e572e4f1384b78d96a27d9c63 (DEFAULT_TABLE table=default.Table_67e54c144d6b452ba54c47f8e63dbbcf [id=1741c78878ea424ebd539cb6fb4aaccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.894424 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2943333e572e4f1384b78d96a27d9c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.895848 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_747e9c8819a64b7fae8a5ece57035907" } new_table_name: "default.Table_3923e0337ed14a129044a3b03ac340df" modify_external_catalogs: true
I20260619 19:53:59.899502 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d703c5c2820642aab6dd1e500ce1e9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.902940 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aaf38b6b7b14298ae0e73bc421de988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.903505 893 tablet_service.cc:1511] Processing CreateTablet for tablet 1e65ca84182d40c280ec2b0555c0de86 (DEFAULT_TABLE table=default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.903488 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 1e65ca84182d40c280ec2b0555c0de86 (DEFAULT_TABLE table=default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.903960 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e65ca84182d40c280ec2b0555c0de86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.907685 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce (DEFAULT_TABLE table=default.Table_81965bd42e674af7a540c53e595dc804 [id=47800ee54fac40698e9f6cbf26219788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.908085 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c9073ef30d456d8dc8609ddf1335ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.914918 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ddb7644529644ea3ab7f8fcca9fdfc34" } modify_external_catalogs: true
I20260619 19:53:59.915198 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ddb7644529644ea3ab7f8fcca9fdfc34" } modify_external_catalogs: true
I20260619 19:53:59.918370 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6ce0d03b39e0413b802982083364ec9e" } modify_external_catalogs: true
I20260619 19:53:59.918553 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6ce0d03b39e0413b802982083364ec9e" } modify_external_catalogs: true
I20260619 19:53:59.919330 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3197bcf4217d49889e1beb721a00a0df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.920011 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3197bcf4217d49889e1beb721a00a0df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.921648 720 leader_election.cc:304] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:59.922004 2012 raft_consensus.cc:2804] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:59.922142 2012 raft_consensus.cc:697] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:59.922483 2012 consensus_queue.cc:237] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.923408 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e65ca84182d40c280ec2b0555c0de86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.923722 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 180402us
W20260619 19:53:59.924288 720 consensus_peers.cc:597] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d64ccbb2f2840f4ac51cf8556da4a2c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:53:59.922948 899 tablet_service.cc:1511] Processing CreateTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce (DEFAULT_TABLE table=default.Table_81965bd42e674af7a540c53e595dc804 [id=47800ee54fac40698e9f6cbf26219788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.925596 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]) successfully deleted
W20260619 19:53:59.925860 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 550297c4d14f4d679d11fded97b671ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 550297c4d14f4d679d11fded97b671ae already in progress: creating tablet
I20260619 19:53:59.926044 1659 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:53:59.926082 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e151dc97ad13456ba35708d50c9d7b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e151dc97ad13456ba35708d50c9d7b26 already in progress: creating tablet
I20260619 19:53:59.926191 1659 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:53:59.926848 1659 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.927424 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:53:59.927655 782 raft_consensus.cc:2468] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:53:59.933816 1208 tablet_bootstrap.cc:492] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:53:59.934087 1208 ts_tablet_manager.cc:1403] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.531s user 0.001s sys 0.010s
I20260619 19:53:59.934935 1208 raft_consensus.cc:359] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.935631 1208 raft_consensus.cc:385] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:53:59.935768 1208 raft_consensus.cc:740] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:53:59.935909 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 68788824224b426bb433b87763073bae
I20260619 19:53:59.936249 1208 consensus_queue.cc:260] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.936491 529 catalog_manager.cc:6784] ReplaceTablet: tablet 68788824224b426bb433b87763073bae deleted and replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e
I20260619 19:53:59.936901 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d7ba1a44bb894e6c96ae35d7fcc4c8da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.937618 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7ba1a44bb894e6c96ae35d7fcc4c8da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.937896 1208 ts_tablet_manager.cc:1434] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:53:59.944796 2018 raft_consensus.cc:515] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.945642 2018 leader_election.cc:290] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:53:59.951860 1208 tablet_bootstrap.cc:492] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:53:59.957603 2024 tablet.cc:1724] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:53:59.958545 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 74949d09466f42e2852389e10192989d with delete_type TABLET_DATA_DELETED (replaced by tablet 5482cf46c91d426484938c387b785d61) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.958060 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2943333e572e4f1384b78d96a27d9c63 (DEFAULT_TABLE table=default.Table_67e54c144d6b452ba54c47f8e63dbbcf [id=1741c78878ea424ebd539cb6fb4aaccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.959192 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c9073ef30d456d8dc8609ddf1335ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.959509 1208 tablet_bootstrap.cc:654] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:53:59.964097 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2943333e572e4f1384b78d96a27d9c63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:53:59.964306 720 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1bc12bcf50074b46860899a82dc0b46e
I20260619 19:53:59.964967 898 tablet_service.cc:1511] Processing CreateTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd (DEFAULT_TABLE table=default.Table_7babf9e56d174c6abc66c591fff1eace [id=3000203e95cc423cb4ab88f7c33f76c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:53:59.965495 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d703c5c2820642aab6dd1e500ce1e9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:53:59.966193 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:53:59.966413 1057 raft_consensus.cc:3060] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:53:59.970422 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 68788824224b426bb433b87763073bae with delete_type TABLET_DATA_DELETED (replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:53:59.974244 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_384d87b1154345fd9feaa4bac544af49" } modify_external_catalogs: true
I20260619 19:53:59.974512 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_384d87b1154345fd9feaa4bac544af49" } modify_external_catalogs: true
I20260619 19:53:59.976006 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f1436f5ff9b34985976f95675a904bc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:53:59.976579 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1436f5ff9b34985976f95675a904bc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.980540 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:53:59.982302 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5f333b129935494783c07771a7db1b73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:53:59.982744 917 raft_consensus.cc:2468] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
W20260619 19:53:59.982920 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f333b129935494783c07771a7db1b73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:53:59.984442 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f033cfea20b845c1b3c6e07f0ace5248" } modify_external_catalogs: true
I20260619 19:53:59.984652 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f033cfea20b845c1b3c6e07f0ace5248" } modify_external_catalogs: true
I20260619 19:53:59.988476 1057 raft_consensus.cc:2468] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:53:59.988989 720 leader_election.cc:304] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:53:59.989403 2073 raft_consensus.cc:2804] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:53:59.989583 2073 raft_consensus.cc:697] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:53:59.989925 2073 consensus_queue.cc:237] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:53:59.993459 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
I20260619 19:53:59.994261 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_67e54c144d6b452ba54c47f8e63dbbcf" } new_table_name: "default.Table_9e763837fe2d46c9b0f859d4e159a2af" modify_external_catalogs: true
I20260619 19:53:59.996652 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.002331 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:00.002681 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 235057us
I20260619 19:54:00.003436 996 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:00.003952 917 raft_consensus.cc:3060] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.004179 2068 raft_consensus.cc:2804] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:00.004287 2068 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:00.004429 2068 raft_consensus.cc:3060] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.008570 2068 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.009500 2068 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:00.010385 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 68788824224b426bb433b87763073bae with delete_type TABLET_DATA_DELETED (replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.012892 527 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 09811647aae74b3cb7f00e44ec95042e
I20260619 19:54:00.012952 1994 ts_tablet_manager.cc:1929] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.013111 1994 log.cc:1199] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a75baa585102481fa0ea01e87e394e32
I20260619 19:54:00.013834 1994 ts_tablet_manager.cc:1950] T a75baa585102481fa0ea01e87e394e32 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:00.014446 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_249c2339f026459ca9576edb3239bafb" } new_table_name: "default.Table_56811bb5e790417e951fd640a650768a" modify_external_catalogs: true
I20260619 19:54:00.015419 892 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.015662 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet a75baa585102481fa0ea01e87e394e32 (table default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]) successfully deleted
W20260619 19:54:00.016058 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d651c8fb8ff244a5a09dd9ea593ecb14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d651c8fb8ff244a5a09dd9ea593ecb14 already in progress: creating tablet
I20260619 19:54:00.016172 1994 tablet_replica.cc:333] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:00.017771 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2943333e572e4f1384b78d96a27d9c63 consensus state has no leader
W20260619 19:54:00.027712 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47ace991ad1a4d52ab609940aacf6681 consensus state has no leader
I20260619 19:54:00.027709 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:00.029039 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:00.033278 1201 tablet_bootstrap.cc:654] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:00.035445 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:00.036314 918 raft_consensus.cc:2468] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:00.037842 1200 tablet_bootstrap.cc:492] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:00.038059 1200 ts_tablet_manager.cc:1403] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.466s user 0.006s sys 0.003s
I20260619 19:54:00.038930 1200 raft_consensus.cc:359] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.039211 1200 raft_consensus.cc:385] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.039306 1200 raft_consensus.cc:740] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.040874 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fade40bf3e7145f29076821f091677bd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:00.041483 1860 consensus_queue.cc:1048] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:00.052292 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8e1f6da4a6cf4417813e688ab868bfe5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.053256 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e1f6da4a6cf4417813e688ab868bfe5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.059875 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_721d0ea740aa432590e6d491422cd791" } new_table_name: "default.Table_83bb8d4286d24179baa0a9b7155f15d7" modify_external_catalogs: true
I20260619 19:54:00.063380 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ed1a0bb02c91457586c92240d93721dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.064152 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed1a0bb02c91457586c92240d93721dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.066591 1973 ts_tablet_manager.cc:1929] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.066859 1973 log.cc:1199] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/1d0fe0c67fe84e5b866fd2553ea26d91
I20260619 19:54:00.073381 2077 consensus_queue.cc:1048] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:00.073637 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_732f4648a45146c285ecb6717c1de396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.074337 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_732f4648a45146c285ecb6717c1de396 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.081393 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c682fd0a9e8b4654b45a9c3705b5eb92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.082154 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.090539 2024 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 21) took 1134 ms. Trace:
I20260619 19:54:00.103886 1200 consensus_queue.cc:260] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.104710 1200 ts_tablet_manager.cc:1434] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
I20260619 19:54:00.105132 1200 tablet_bootstrap.cc:492] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:00.106357 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:00.106585 913 raft_consensus.cc:3060] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.106986 1200 tablet_bootstrap.cc:654] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:00.107863 1820 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:54:00.108343 1820 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:54:00.108498 1820 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260619 19:54:00.091418 2024 rpcz_store.cc:276] 0619 19:53:58.955776 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.958403 (+ 2627us) service_pool.cc:224] Handling call
0619 19:54:00.090456 (+1132053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:58.963259 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:58.963358 (+ 99us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:58.963367 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:58.963375 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:58.963416 (+ 41us) alter_schema_op.cc:128] START. Timestamp: 1781898838963387
0619 19:53:58.963419 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:53:58.963665 (+ 246us) log.cc:844] Serialized 173 byte log entry
0619 19:53:59.927270 (+963605us) op_driver.cc:464] REPLICATION: finished
0619 19:53:59.927429 (+ 159us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:53:59.964451 (+ 37022us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.089817 (+125366us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.090091 (+ 274us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.090395 (+ 304us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.090400 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":100,"prepare.queue_time_us":4525,"prepare.run_cpu_time_us":79160,"prepare.run_wall_time_us":362824,"replication_time_us":963817,"thread_start_us":362267,"threads_started":1,"wal-append.queue_time_us":283413}]]}
W20260619 19:54:00.124922 1820 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 19:54:00.125087 1820 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:54:00.125214 1820 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 19:54:00.125313 1820 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 19:54:00.127348 2077 raft_consensus.cc:493] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:00.130825 913 raft_consensus.cc:2468] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:00.130893 2077 raft_consensus.cc:515] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.138406 2026 ts_tablet_manager.cc:1929] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:00.139959 917 raft_consensus.cc:2468] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:00.139832 2077 leader_election.cc:290] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:00.142566 996 leader_election.cc:304] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:00.143584 996 leader_election.cc:304] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:00.143834 1860 raft_consensus.cc:2749] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:00.144083 2077 raft_consensus.cc:2764] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260619 19:54:00.144250 996 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:00.144490 2077 raft_consensus.cc:2804] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:00.144656 2077 raft_consensus.cc:697] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:00.145125 2077 consensus_queue.cc:237] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.149577 524 catalog_manager.cc:5696] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:00.151033 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
W20260619 19:54:00.097381 720 consensus_peers.cc:597] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:00.097995 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:00.147810 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e9d0ae96db4388a39a8b8f9c87187e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:00.160404 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 63043.1us
I20260619 19:54:00.160617 778 raft_consensus.cc:2468] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:00.160701 779 raft_consensus.cc:3060] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.071112 1973 ts_tablet_manager.cc:1950] T 1d0fe0c67fe84e5b866fd2553ea26d91 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:00.161757 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 36) took 1085 ms. Trace:
I20260619 19:54:00.172468 2026 log.cc:1199] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/e3031a45cf534814bbece8d271c0420e
I20260619 19:54:00.167055 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 74949d09466f42e2852389e10192989d with delete_type TABLET_DATA_DELETED (replaced by tablet 5482cf46c91d426484938c387b785d61) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.167459 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.167843 779 raft_consensus.cc:2468] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:00.167889 755 tablet_service.cc:1558] Processing DeleteTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.168215 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.168656 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.168975 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.169493 748 tablet_service.cc:1511] Processing CreateTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce (DEFAULT_TABLE table=default.Table_81965bd42e674af7a540c53e595dc804 [id=47800ee54fac40698e9f6cbf26219788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.175765 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e9d0ae96db4388a39a8b8f9c87187e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:00.176026 913 raft_consensus.cc:2468] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:00.176234 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c9073ef30d456d8dc8609ddf1335ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.170207 746 tablet_service.cc:1511] Processing CreateTablet for tablet 1e65ca84182d40c280ec2b0555c0de86 (DEFAULT_TABLE table=default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.179545 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e65ca84182d40c280ec2b0555c0de86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.185446 2101 tablet.cc:1724] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.189826 1820 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:44433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=42109
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
I20260619 19:54:00.192471 2110 tablet.cc:1724] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.196702 2116 tablet.cc:1724] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:00.199033 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 51118.8us
I20260619 19:54:00.199653 996 leader_election.cc:304] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:00.200471 2035 raft_consensus.cc:2804] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:00.200649 2035 raft_consensus.cc:493] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:00.200799 1820 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:54:00.202770 2035 raft_consensus.cc:3060] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.202819 2026 ts_tablet_manager.cc:1950] T e3031a45cf534814bbece8d271c0420e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:00.206974 2035 raft_consensus.cc:515] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.207391 2101 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.212121 2101 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33622 (request call id 32) took 1008 ms. Trace:
I20260619 19:54:00.212321 2101 rpcz_store.cc:276] 0619 19:53:59.204127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.204259 (+ 132us) service_pool.cc:224] Handling call
0619 19:54:00.212051 (+1007792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.209633 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.209729 (+ 96us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.209739 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.209746 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.209788 (+ 42us) alter_schema_op.cc:128] START. Timestamp: 1781898839209704
0619 19:53:59.209791 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.210958 (+ 1167us) log.cc:844] Serialized 173 byte log entry
0619 19:53:59.605334 (+394376us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x60c000436d00. stack: 00007f40a7fb2496 00007f40a7fb2250 00007f40a6fdd3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f40bbdf5a05 00007f40b3902210 00007f40a7fd73e0 0000000000a932a6 00007f40a7ff669a 00007f40a7ff20bc 00007f40a7ff73ee 00007f40b38e743c 00007f40b38f476b 00007f40b38f51a0
0619 19:54:00.200490 (+595156us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.207325 (+ 6835us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:00.207824 (+ 499us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.211433 (+ 3609us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.211791 (+ 358us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.212013 (+ 222us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.212018 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":6758,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":34963,"prepare.run_wall_time_us":395812,"raft.queue_time_us":499,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":255,"replication_time_us":990655,"spinlock_wait_cycles":96881024,"thread_start_us":351837,"threads_started":1,"wal-append.queue_time_us":351562}]]}
I20260619 19:54:00.214347 1973 rpcz_store.cc:276] 0619 19:53:59.076175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.078151 (+ 1976us) service_pool.cc:224] Handling call
0619 19:53:59.829995 (+751844us) ts_tablet_manager.cc:1151] Deleting tablet 1d0fe0c67fe84e5b866fd2553ea26d91
0619 19:53:59.830002 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:53:59.835879 (+ 5877us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.066461 (+230582us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.161716 (+ 95255us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":751639}
I20260619 19:54:00.157624 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_49b9db84d9d64b3bbde7236a42fef5df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.220456 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49b9db84d9d64b3bbde7236a42fef5df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.158840 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_443e720ca25543829dd293413d08f95e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.221858 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_443e720ca25543829dd293413d08f95e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.223428 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:54:00.224203 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]). Expected version 1 got 0
I20260619 19:54:00.224659 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]). Expected version 3 got 0
I20260619 19:54:00.225154 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2943333e572e4f1384b78d96a27d9c63 (DEFAULT_TABLE table=default.Table_67e54c144d6b452ba54c47f8e63dbbcf [id=1741c78878ea424ebd539cb6fb4aaccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.226016 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:54:00.226740 748 tablet_service.cc:1511] Processing CreateTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd (DEFAULT_TABLE table=default.Table_7babf9e56d174c6abc66c591fff1eace [id=3000203e95cc423cb4ab88f7c33f76c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.227957 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e4132f28c434492cbddc8da7d8075c43 (table default.Table_93a36817c65c48b5b2e86a7b7a2937be [id=a57b082016f14ff48e4194fcbd7b63c1]). Expected version 1 got 0
I20260619 19:54:00.228371 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 68788824224b426bb433b87763073bae with delete_type TABLET_DATA_DELETED (replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.228901 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]). Expected version 1 got 0
I20260619 19:54:00.229174 746 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.229678 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 108f1b2e9ec74271889ffff65d8e852e (table default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d]). Expected version 1 got 0
I20260619 19:54:00.230898 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:00.231201 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 19) took 1248 ms. Trace:
I20260619 19:54:00.231403 2026 rpcz_store.cc:276] 0619 19:53:58.955618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.958229 (+ 2611us) service_pool.cc:224] Handling call
0619 19:53:59.605473 (+647244us) ts_tablet_manager.cc:1151] Deleting tablet e3031a45cf534814bbece8d271c0420e
0619 19:53:59.605482 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.000975 (+395493us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.138296 (+137321us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.204034 (+ 65738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48507,"tablet-delete.queue_time_us":647133}
I20260619 19:54:00.232133 2026 tablet_replica.cc:333] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:00.232425 2026 raft_consensus.cc:2243] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:00.232692 1973 tablet_replica.cc:333] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:00.233045 1973 raft_consensus.cc:2243] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.233407 1973 raft_consensus.cc:2272] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.234022 1973 ts_tablet_manager.cc:1916] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.234941 858 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:00.235242 1840 raft_consensus.cc:2804] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:00.235867 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2943333e572e4f1384b78d96a27d9c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.236672 1840 raft_consensus.cc:493] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:00.236809 1840 raft_consensus.cc:3060] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:00.232597 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e63e4a6a46584565bd00b07e52fa0580"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.237444 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63e4a6a46584565bd00b07e52fa0580 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.233843 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet e3031a45cf534814bbece8d271c0420e (table default.Table_c89d6514dbcb43c0b65132772e18e5ee [id=10d956a0835944e6b4712fae4359d41d]) successfully deleted
I20260619 19:54:00.235352 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_91c7ddb413964d86bfad6243e684a682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:00.238971 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:00.239310 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91c7ddb413964d86bfad6243e684a682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.239984 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202]). Expected version 2 got 0
I20260619 19:54:00.240178 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:00.240404 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_d81fd5ddf99c4cc69b837400b6c4722a [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 1 got 0
I20260619 19:54:00.240619 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 0dd210e843db4f58a976af5c28dabc9c (table default.Table_4957c483382c45d7a305c7b4fd2ea6c8 [id=2daa177012434787b804b7721c3f91d2]). Expected version 1 got 0
W20260619 19:54:00.240796 858 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:54:00.240849 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]). Expected version 1 got 0
I20260619 19:54:00.241035 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:00.241216 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:00.241379 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 3 got 0
I20260619 19:54:00.242817 2026 raft_consensus.cc:2272] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.243281 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184d655694434b0bbfa178fcd3110405" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:00.243508 913 raft_consensus.cc:3060] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.244042 2026 ts_tablet_manager.cc:1916] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.215375 1994 raft_consensus.cc:2243] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:00.248512 1994 raft_consensus.cc:2272] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.249409 1994 ts_tablet_manager.cc:1916] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.245039 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4957c483382c45d7a305c7b4fd2ea6c8" } modify_external_catalogs: true
I20260619 19:54:00.250053 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4957c483382c45d7a305c7b4fd2ea6c8" } modify_external_catalogs: true
I20260619 19:54:00.241621 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (table default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8]). Expected version 3 got 0
I20260619 19:54:00.251291 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]). Expected version 2 got 0
I20260619 19:54:00.251469 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_747e9c8819a64b7fae8a5ece57035907 [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 1 got 0
I20260619 19:54:00.251667 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:00.251824 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:54:00.252013 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_5d100ac0078e402e8b7ad4b65c4de9f5 [id=96dda797fa474e119e765b5d9946bfb7]). Expected version 1 got 0
I20260619 19:54:00.252331 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:00.252594 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:00.252772 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:54:00.253187 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]). Expected version 1 got 0
I20260619 19:54:00.253476 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (table default.Table_d911a0e8835847cb9ccf9d5d192872fe [id=57b57ad63a674bf08da4cf6d7bcd1b4e]). Expected version 1 got 0
I20260619 19:54:00.254053 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:00.254505 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:00.254788 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:00.255394 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 58e9d98ec1084b2ea9c087238686ed38
I20260619 19:54:00.256150 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a666e5f020f94fbbbb4aeb87d9f180fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:00.256568 1994 ts_tablet_manager.cc:1929] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.256696 1994 log.cc:1199] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/12258d3bcc714f34857d7362c49ee787
W20260619 19:54:00.256798 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a666e5f020f94fbbbb4aeb87d9f180fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.257141 1994 ts_tablet_manager.cc:1950] T 12258d3bcc714f34857d7362c49ee787 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:00.257788 1994 tablet_replica.cc:333] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:00.257997 1994 raft_consensus.cc:2243] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:00.258505 1994 raft_consensus.cc:2272] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.258980 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 12258d3bcc714f34857d7362c49ee787 (table default.Table_9a70fe99a1294387a1ac81cbd29c2647 [id=1bb7a7cd9bca4a98b3138955924f8eac]) successfully deleted
I20260619 19:54:00.259222 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.259698 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet bb56767231db42bebb75a45b5d512de3
W20260619 19:54:00.260008 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe14a1f35cf14ca480221ee412c087da consensus state has no leader
I20260619 19:54:00.261201 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet bb56767231db42bebb75a45b5d512de3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.261422 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_107d4f6ff8314ea1b5ea10925d7f52bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:00.261782 2024 tablet.cc:1724] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:00.261999 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_107d4f6ff8314ea1b5ea10925d7f52bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.263338 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e1877af4dc434ff5a38408207ea93c47" } modify_external_catalogs: true
W20260619 19:54:00.263541 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3091dd1a525a4f779c68b8b77afa5b26 consensus state has no leader
I20260619 19:54:00.263888 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1b1eebd6048a4df78f905c5f2d1959c3" } new_table_name: "default.Table_83323de24e23497a9cec6d92ad957bc1" modify_external_catalogs: true
I20260619 19:54:00.264967 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e1877af4dc434ff5a38408207ea93c47" } modify_external_catalogs: true
I20260619 19:54:00.266338 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 33cfbae501de432cbcb34d2a6365f806 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:00.217985 1200 tablet_bootstrap.cc:492] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:00.234014 2035 leader_election.cc:290] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:00.267405 1200 ts_tablet_manager.cc:1403] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.162s user 0.000s sys 0.006s
W20260619 19:54:00.267665 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 67496.4us
I20260619 19:54:00.268675 1200 raft_consensus.cc:359] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.268975 1200 raft_consensus.cc:385] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.269114 1200 raft_consensus.cc:740] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:00.269405 858 consensus_peers.cc:597] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40e1b92467a44737bfabb6ec1c924ea1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:00.269413 1200 consensus_queue.cc:260] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:00.269632 858 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:54:00.270162 1200 ts_tablet_manager.cc:1434] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:00.271034 1994 ts_tablet_manager.cc:1916] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.271647 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e9d0ae96db4388a39a8b8f9c87187e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:00.272174 1652 raft_consensus.cc:493] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:00.271253 913 raft_consensus.cc:2468] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:00.273680 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b7a85268c6354f84a478e25b647e5d43" } new_table_name: "default.Table_45a3ba7b76404715ae3b943580b8077d" modify_external_catalogs: true
I20260619 19:54:00.278481 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 1d0fe0c67fe84e5b866fd2553ea26d91 (table default.Table_a40ad9bc744448b78938f33623ed8d56 [id=f848b07a0fe748fe9168a487db41e041]) successfully deleted
I20260619 19:54:00.280007 1200 tablet_bootstrap.cc:492] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:00.280486 902 tablet_service.cc:1558] Processing DeleteTablet for tablet bb56767231db42bebb75a45b5d512de3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:00.281401 859 leader_election.cc:343] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:00.283552 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d703c5c2820642aab6dd1e500ce1e9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.287262 1200 tablet_bootstrap.cc:654] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:00.292662 2073 consensus_queue.cc:1048] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:00.312299 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a54231986cca44258942dbc3373870b2 has no consensus state
I20260619 19:54:00.312880 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b266c44afc08423a88490ec2db873941"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.313565 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b266c44afc08423a88490ec2db873941 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.315510 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202]). Expected version 2 got 0
I20260619 19:54:00.315860 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:00.316552 525 catalog_manager.cc:5696] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:00.316293 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 33cfbae501de432cbcb34d2a6365f806
I20260619 19:54:00.319633 528 catalog_manager.cc:6784] ReplaceTablet: tablet 33cfbae501de432cbcb34d2a6365f806 deleted and replaced by tablet 6532bdfd3c844ff2a25bee6ff1e0c25e
I20260619 19:54:00.319913 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 33cfbae501de432cbcb34d2a6365f806 with delete_type TABLET_DATA_DELETED (replaced by tablet 6532bdfd3c844ff2a25bee6ff1e0c25e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.320216 1994 ts_tablet_manager.cc:1929] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.320361 1994 log.cc:1199] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/376dfca0b54d4c689c96242566869717
I20260619 19:54:00.320777 1994 ts_tablet_manager.cc:1950] T 376dfca0b54d4c689c96242566869717 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:00.320684 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_59c7af4cbfdf4ef5a7bae5b388ec0a2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.321599 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59c7af4cbfdf4ef5a7bae5b388ec0a2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.327980 1820 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260619 19:54:00.330417 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6fd43f965fb445cfbc8018f1ed9adfaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.341320 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 64360.9us
I20260619 19:54:00.344908 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 41) took 1035 ms. Trace:
I20260619 19:54:00.345145 1994 rpcz_store.cc:276] 0619 19:53:59.309881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.309923 (+ 42us) service_pool.cc:224] Handling call
0619 19:54:00.257712 (+947789us) ts_tablet_manager.cc:1151] Deleting tablet 376dfca0b54d4c689c96242566869717
0619 19:54:00.257720 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.301891 (+ 44171us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.320121 (+ 18230us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.344865 (+ 24744us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":947631}
I20260619 19:54:00.345885 1994 tablet_replica.cc:333] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:00.340016 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fd43f965fb445cfbc8018f1ed9adfaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.345921 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 376dfca0b54d4c689c96242566869717 (table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]) successfully deleted
I20260619 19:54:00.346361 1994 raft_consensus.cc:2243] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.346629 1994 raft_consensus.cc:2272] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.347316 1994 ts_tablet_manager.cc:1916] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.358652 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_599b6bc9158b48d4848732a5c03bc7d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.359510 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_599b6bc9158b48d4848732a5c03bc7d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.361310 1208 tablet_bootstrap.cc:492] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:00.364322 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.365193 2116 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.368403 757 tablet_service.cc:1558] Processing DeleteTablet for tablet bb56767231db42bebb75a45b5d512de3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.373880 1208 ts_tablet_manager.cc:1403] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.428s user 0.002s sys 0.012s
I20260619 19:54:00.374241 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 33cfbae501de432cbcb34d2a6365f806 with delete_type TABLET_DATA_DELETED (replaced by tablet 6532bdfd3c844ff2a25bee6ff1e0c25e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:00.371424 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11e9d0ae96db4388a39a8b8f9c87187e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:00.379426 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.382396 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 8bc11c632b514118856ea4c11b431142 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:00.384203 783 raft_consensus.cc:3060] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.385661 920 raft_consensus.cc:3060] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.388594 783 raft_consensus.cc:2468] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:00.390230 920 raft_consensus.cc:2468] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:00.390569 1652 raft_consensus.cc:515] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.391948 1652 leader_election.cc:290] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:00.398924 915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s user 0.013s sys 0.022s
W20260619 19:54:00.399072 915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s user 0.013s sys 0.022s
I20260619 19:54:00.399634 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 33cfbae501de432cbcb34d2a6365f806 with delete_type TABLET_DATA_DELETED (replaced by tablet 6532bdfd3c844ff2a25bee6ff1e0c25e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.399547 2110 tablet.cc:1724] T 32665a93ee5b4f8290c79e2a1d4b1db1 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:00.400584 2122 tablet.cc:1724] T 32665a93ee5b4f8290c79e2a1d4b1db1 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:00.402154 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 56ba47943b9d4123985ea6ca1478cd93 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:00.401230 859 leader_election.cc:304] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:00.408386 1208 raft_consensus.cc:359] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.408648 1208 raft_consensus.cc:385] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.409138 1208 raft_consensus.cc:740] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.409458 1208 consensus_queue.cc:260] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.410980 1208 ts_tablet_manager.cc:1434] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260619 19:54:00.411486 1208 tablet_bootstrap.cc:492] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:00.412374 1201 tablet_bootstrap.cc:492] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:00.413290 2119 tablet.cc:1724] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:00.415671 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 142313us
I20260619 19:54:00.417009 2006 raft_consensus.cc:2749] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:00.413324 1840 raft_consensus.cc:515] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:00.420048 917 raft_consensus.cc:2393] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 2: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:00.420089 919 raft_consensus.cc:1275] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260619 19:54:00.432432 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 128599us
I20260619 19:54:00.434165 996 leader_election.cc:304] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:00.434990 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.436340 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.437119 1860 raft_consensus.cc:2804] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:00.437305 1860 raft_consensus.cc:697] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:00.437659 1860 consensus_queue.cc:237] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.438721 1200 tablet_bootstrap.cc:492] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:00.438908 1200 ts_tablet_manager.cc:1403] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.159s user 0.003s sys 0.006s
I20260619 19:54:00.441082 2125 tablet.cc:1724] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:00.441711 1200 raft_consensus.cc:359] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.441977 1200 raft_consensus.cc:385] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.443261 1200 raft_consensus.cc:740] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.443814 1200 consensus_queue.cc:260] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.446094 1200 ts_tablet_manager.cc:1434] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260619 19:54:00.447403 1200 tablet_bootstrap.cc:492] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:00.448501 1840 leader_election.cc:290] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:00.448992 859 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:54:00.449147 859 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:00.449383 1200 tablet_bootstrap.cc:654] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:00.439313 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 48322.4us
I20260619 19:54:00.451809 1201 ts_tablet_manager.cc:1403] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.576s user 0.009s sys 0.017s
W20260619 19:54:00.457851 859 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:54:00.458142 859 leader_election.cc:304] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:00.458911 1835 raft_consensus.cc:2749] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:00.460060 2114 consensus_queue.cc:1048] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:00.473930 2006 consensus_queue.cc:1048] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260619 19:54:00.474721 2035 raft_consensus.cc:493] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:00.474901 2035 raft_consensus.cc:515] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.476102 2035 leader_election.cc:290] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:00.480890 2026 ts_tablet_manager.cc:1929] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:00.434350 719 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:00.488539 2073 raft_consensus.cc:3060] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:00.489384 1994 ts_tablet_manager.cc:1929] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.489564 1994 log.cc:1199] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/620f3a56e57e49b7b520012857e71187
I20260619 19:54:00.490025 1994 ts_tablet_manager.cc:1950] T 620f3a56e57e49b7b520012857e71187 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:00.493767 859 consensus_peers.cc:597] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40e1b92467a44737bfabb6ec1c924ea1. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:00.494170 859 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1bc12bcf50074b46860899a82dc0b46e
I20260619 19:54:00.495857 2026 log.cc:1199] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d8c889f13fbe49c3aab1e7f0d0d08e98
W20260619 19:54:00.498353 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e8c3aef303b94d58aaa24917399ac240 consensus state has no leader
I20260619 19:54:00.509006 2122 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 37) took 1259 ms. Trace:
I20260619 19:54:00.509501 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 35) took 1244 ms. Trace:
I20260619 19:54:00.520110 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 42) took 1209 ms. Trace:
W20260619 19:54:00.520174 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 55658us
I20260619 19:54:00.518162 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:00.521445 1208 tablet_bootstrap.cc:654] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:00.523000 2017 consensus_queue.cc:1048] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260619 19:54:00.518103 2124 tablet.cc:1724] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.529026 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cae61bfa5a3c4fa8b9eb4ab07b327be0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.529819 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cae61bfa5a3c4fa8b9eb4ab07b327be0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.540843 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:00.541473 531 catalog_manager.cc:6784] ReplaceTablet: tablet 56ba47943b9d4123985ea6ca1478cd93 deleted and replaced by tablet e4688dc20317479e9c80f6f41b3ea35e
I20260619 19:54:00.541878 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d2fb548e74874865afb85ec54f4c2999"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.542395 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2fb548e74874865afb85ec54f4c2999 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.542884 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 05c9a91f95bb4bcdafe493bab8c393b4
I20260619 19:54:00.545642 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9911df524f8948ea8ecce55df0fdd0d6 (DEFAULT_TABLE table=default.Table_d2c62460bd8d448584fc4e76100e5fea [id=1150e278fd3646d9b0897243ff2524d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.546085 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1d2d8281aa5c41a6870b4654f9ac2811"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:00.546272 893 tablet_service.cc:1511] Processing CreateTablet for tablet a54231986cca44258942dbc3373870b2 (DEFAULT_TABLE table=default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:00.546587 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d2d8281aa5c41a6870b4654f9ac2811 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.518407 1840 raft_consensus.cc:2749] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:00.550272 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7d5f049a07fe4b8f9e0ea01960b23386" } modify_external_catalogs: true
I20260619 19:54:00.550504 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7d5f049a07fe4b8f9e0ea01960b23386" } modify_external_catalogs: true
I20260619 19:54:00.551915 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 with delete_type TABLET_DATA_DELETED (replaced by tablet e4688dc20317479e9c80f6f41b3ea35e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.531718 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d77de42bb514452a8dc6a4a71289dc59 (DEFAULT_TABLE table=default.Table_4c7e1ad3890d4f9dbc9f41258e5d20b9 [id=94a5aa43010a4086a2b9f24ceeaf4013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.555460 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb4005068684928b3b27ff73b108d1b (DEFAULT_TABLE table=default.Table_543df7cf4dd94f00b3cb83082b6941d2 [id=50dcec72e2094942804e8252af3f7566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.555838 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77de42bb514452a8dc6a4a71289dc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.557451 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_56811bb5e790417e951fd640a650768a" } new_table_name: "default.Table_cce54de4f5f84cd982118d476870dea9" modify_external_catalogs: true
I20260619 19:54:00.557714 902 tablet_service.cc:1511] Processing CreateTablet for tablet d77de42bb514452a8dc6a4a71289dc59 (DEFAULT_TABLE table=default.Table_4c7e1ad3890d4f9dbc9f41258e5d20b9 [id=94a5aa43010a4086a2b9f24ceeaf4013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.558262 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb4005068684928b3b27ff73b108d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.535211 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 9911df524f8948ea8ecce55df0fdd0d6 (DEFAULT_TABLE table=default.Table_d2c62460bd8d448584fc4e76100e5fea [id=1150e278fd3646d9b0897243ff2524d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.559540 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911df524f8948ea8ecce55df0fdd0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.538581 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a54231986cca44258942dbc3373870b2 (DEFAULT_TABLE table=default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.560856 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54231986cca44258942dbc3373870b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.561982 1201 raft_consensus.cc:359] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.540951 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 4841d03189e84deaa036f235946e877a (DEFAULT_TABLE table=default.Table_828ae87da1244552a87a9526a110dd46 [id=6618e222b126441bb6127b256ea32421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.563464 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841d03189e84deaa036f235946e877a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.565497 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e38109b2d8b496290d95d8b61a1512b" } modify_external_catalogs: true
I20260619 19:54:00.565713 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e38109b2d8b496290d95d8b61a1512b" } modify_external_catalogs: true
I20260619 19:54:00.542083 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 with delete_type TABLET_DATA_DELETED (replaced by tablet e4688dc20317479e9c80f6f41b3ea35e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.545876 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.551625 1038 tablet_service.cc:1511] Processing CreateTablet for tablet e7a19f43793b4440b7a9d2652a75e6bd (DEFAULT_TABLE table=default.Table_d7e665d3d76f4453b1daa939934eb82b [id=37dfe7b7dbe8482890ea073e0c9a42da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.567590 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a19f43793b4440b7a9d2652a75e6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.569643 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:00.569896 920 raft_consensus.cc:2468] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:00.570384 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.570587 894 tablet_service.cc:1511] Processing CreateTablet for tablet e7a19f43793b4440b7a9d2652a75e6bd (DEFAULT_TABLE table=default.Table_d7e665d3d76f4453b1daa939934eb82b [id=37dfe7b7dbe8482890ea073e0c9a42da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.570264 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911df524f8948ea8ecce55df0fdd0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.571373 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54231986cca44258942dbc3373870b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.573653 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77de42bb514452a8dc6a4a71289dc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.570335 884 tablet_service.cc:1511] Processing CreateTablet for tablet 4841d03189e84deaa036f235946e877a (DEFAULT_TABLE table=default.Table_828ae87da1244552a87a9526a110dd46 [id=6618e222b126441bb6127b256ea32421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.575639 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841d03189e84deaa036f235946e877a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.571200 2026 ts_tablet_manager.cc:1950] T d8c889f13fbe49c3aab1e7f0d0d08e98 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:00.580458 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 22) took 1624 ms. Trace:
I20260619 19:54:00.580644 2026 rpcz_store.cc:276] 0619 19:53:58.955854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.958751 (+ 2897us) service_pool.cc:224] Handling call
0619 19:54:00.231873 (+1273122us) ts_tablet_manager.cc:1151] Deleting tablet d8c889f13fbe49c3aab1e7f0d0d08e98
0619 19:54:00.232003 (+ 130us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.374621 (+142618us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.429846 (+ 55225us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.580099 (+150253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1722,"tablet-delete.queue_time_us":1272919}
I20260619 19:54:00.581275 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d8c889f13fbe49c3aab1e7f0d0d08e98 (table default.Table_a5548affccc643a2af2409af28583af9 [id=787ec176c1fa43a087c8a3226711cfbb]) successfully deleted
I20260619 19:54:00.581779 2101 tablet.cc:1724] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.583360 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a19f43793b4440b7a9d2652a75e6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.584501 1200 tablet_bootstrap.cc:492] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:00.584635 1200 ts_tablet_manager.cc:1403] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.138s user 0.004s sys 0.000s
W20260619 19:54:00.571034 859 leader_election.cc:343] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:00.584836 859 leader_election.cc:304] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:00.585549 2004 raft_consensus.cc:2749] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:00.589071 2101 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33622 (request call id 34) took 1288 ms. Trace:
I20260619 19:54:00.589953 2024 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 33) took 1299 ms. Trace:
I20260619 19:54:00.590072 2024 rpcz_store.cc:276] 0619 19:53:59.249132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.250724 (+ 1592us) service_pool.cc:224] Handling call
0619 19:54:00.548274 (+1297550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.326209 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.326379 (+ 170us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.326391 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.326403 (+ 12us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.326477 (+ 74us) alter_schema_op.cc:128] START. Timestamp: 1781898839326383
0619 19:53:59.326485 (+ 8us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.326755 (+ 270us) log.cc:844] Serialized 173 byte log entry
0619 19:53:59.416651 (+ 89896us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x60c00021fa40. stack: 00007ff028f96496 00007ff028f96250 00007ff027fc13ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ff03cdd9a05 00007ff028fdcbff 00007ff028fdfd1b 00007ff028fdfb98 0000000000aa681c 00007ff028fbbf48 00007ff02c6856da 00007ff02514361e
0619 19:53:59.422869 (+ 6218us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x60c00021fa40. stack: 00007ff028f96496 00007ff028f96250 00007ff027fc13ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ff03cdd9a05 00007ff028fdc88e 00007ff028fdfd1b 00007ff028fdfb98 0000000000aa681c 00007ff028fbbf48 00007ff02c6856da 00007ff02514361e
0619 19:54:00.241842 (+818973us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.242208 (+ 366us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:00.265025 (+ 22817us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.518841 (+253816us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.548021 (+ 29180us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.548238 (+ 217us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.548243 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":305,"prepare.queue_time_us":66231,"prepare.run_cpu_time_us":3587,"prepare.run_wall_time_us":60386,"raft.queue_time_us":43,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":922,"replication_time_us":915323,"spinlock_wait_cycles":141172096,"thread_start_us":487308,"threads_started":2,"wal-append.queue_time_us":59805}]]}
I20260619 19:54:00.571072 1201 raft_consensus.cc:385] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:54:00.591952 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47ace991ad1a4d52ab609940aacf6681 consensus state has no leader
I20260619 19:54:00.592006 1201 raft_consensus.cc:740] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.592298 1201 consensus_queue.cc:260] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.592341 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6597096e540440bb848c3ee8f9c3d828" } new_table_name: "default.Table_e7b911b51485494b87757309f0561405" modify_external_catalogs: true
I20260619 19:54:00.592885 1201 ts_tablet_manager.cc:1434] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.141s user 0.001s sys 0.001s
I20260619 19:54:00.593286 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 23) took 1637 ms. Trace:
I20260619 19:54:00.593393 2026 rpcz_store.cc:276] 0619 19:53:58.955935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.958020 (+ 2085us) service_pool.cc:224] Handling call
0619 19:54:00.593120 (+1635100us) ts_tablet_manager.cc:1151] Deleting tablet b8e3354ae6dd46bd9c5414d4c4a720a1
0619 19:54:00.593128 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.593242 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1558831}
I20260619 19:54:00.594641 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b2902c7f67a1402987315ee426ddf1d2
W20260619 19:54:00.595184 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8e3354ae6dd46bd9c5414d4c4a720a1 already in progress: creating tablet
I20260619 19:54:00.595300 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:00.595484 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4f5e69e26c3542fbaa09da0518fd84c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.596058 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f5e69e26c3542fbaa09da0518fd84c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.569958 2120 tablet.cc:1724] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.570192 2122 rpcz_store.cc:276] 0619 19:53:59.249597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.294092 (+ 44495us) service_pool.cc:224] Handling call
0619 19:54:00.508946 (+1214854us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.636481 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.636664 (+ 183us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.636672 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.636681 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.636726 (+ 45us) alter_schema_op.cc:128] START. Timestamp: 1781898839636676
0619 19:53:59.636731 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.637059 (+ 328us) log.cc:844] Serialized 173 byte log entry
0619 19:54:00.241951 (+604892us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.396424 (+154473us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:00.401017 (+ 4593us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.508318 (+107301us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.508633 (+ 315us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.508899 (+ 266us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.508904 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":154411,"mutex_wait_us":2820,"prepare.queue_time_us":291500,"prepare.run_cpu_time_us":8341,"prepare.run_wall_time_us":21779,"raft.queue_time_us":2953,"raft.run_cpu_time_us":753,"raft.run_wall_time_us":753,"replication_time_us":605197,"thread_start_us":178747,"threads_started":2,"wal-append.queue_time_us":18228}]]}
I20260619 19:54:00.592927 2101 rpcz_store.cc:276] 0619 19:53:59.300644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.300713 (+ 69us) service_pool.cc:224] Handling call
0619 19:54:00.589026 (+1288313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.380704 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.380817 (+ 113us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.380826 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.380845 (+ 19us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.380880 (+ 35us) alter_schema_op.cc:128] START. Timestamp: 1781898839380841
0619 19:53:59.380883 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.381031 (+ 148us) log.cc:844] Serialized 173 byte log entry
0619 19:54:00.581571 (+1200540us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.581707 (+ 136us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:00.582207 (+ 500us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.588689 (+ 6482us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.588948 (+ 259us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.588985 (+ 37us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.588990 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":82,"prepare.queue_time_us":79526,"prepare.run_cpu_time_us":2052,"prepare.run_wall_time_us":12308,"replication_time_us":1200645,"thread_start_us":61419,"threads_started":2,"wal-append.queue_time_us":11405,"wal-append.run_cpu_time_us":494,"wal-append.run_wall_time_us":1000603}]]}
I20260619 19:54:00.598953 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 24) took 1642 ms. Trace:
I20260619 19:54:00.599074 2026 rpcz_store.cc:276] 0619 19:53:58.956017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.958190 (+ 2173us) service_pool.cc:224] Handling call
0619 19:54:00.593644 (+1635454us) ts_tablet_manager.cc:1151] Deleting tablet f6c6ad82f0c94e27b2eb4dbf185fab66
0619 19:54:00.593652 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.598910 (+ 5258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1559189}
I20260619 19:54:00.599440 2122 tablet.cc:1724] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:00.599488 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6c6ad82f0c94e27b2eb4dbf185fab66 already in progress: creating tablet
I20260619 19:54:00.591074 2024 tablet.cc:1724] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.604403 2119 rpcz_store.cc:276] 0619 19:53:59.249365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.250781 (+ 1416us) service_pool.cc:224] Handling call
0619 19:54:00.493525 (+1242744us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.416726 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.416878 (+ 152us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.416887 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.416895 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.416939 (+ 44us) alter_schema_op.cc:128] START. Timestamp: 1781898839416910
0619 19:53:59.416942 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.417140 (+ 198us) log.cc:844] Serialized 173 byte log entry
0619 19:54:00.270447 (+853307us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.396665 (+126218us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:00.429240 (+ 32575us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.474102 (+ 44862us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.493130 (+ 19028us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.493453 (+ 323us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.493475 (+ 22us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":126160,"mutex_wait_us":42327,"prepare.queue_time_us":150815,"prepare.run_cpu_time_us":11696,"prepare.run_wall_time_us":271043,"raft.queue_time_us":1787,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":278,"replication_time_us":853472,"thread_start_us":906042,"threads_started":3,"wal-append.queue_time_us":233882}]]}
I20260619 19:54:00.605216 2119 tablet.cc:1724] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.605880 1201 tablet_bootstrap.cc:492] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:00.606560 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d772e0bd2d4420f836fa14ca2dadb24 consensus state has no leader
I20260619 19:54:00.607043 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b8daa904a52e492d9f9942b151daca0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:00.607353 2101 tablet.cc:1724] T 32665a93ee5b4f8290c79e2a1d4b1db1 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:00.607688 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8daa904a52e492d9f9942b151daca0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.611243 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b507e37123084d588652be39a96875c4" } new_table_name: "default.Table_b8d9dd9528624489b3bef8c57d2df87f" modify_external_catalogs: true
I20260619 19:54:00.613023 894 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.618914 2122 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.621753 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_33d0cb686a25428da2d7a81cf90723b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.622529 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33d0cb686a25428da2d7a81cf90723b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:00.623256 859 consensus_peers.cc:597] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b65f88b43b4e45c481aa7d43ef59fe7a. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:00.623564 859 leader_election.cc:343] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:00.636430 859 leader_election.cc:343] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1bc12bcf50074b46860899a82dc0b46e
I20260619 19:54:00.636926 1832 consensus_queue.cc:1048] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:00.637343 2026 tablet_replica.cc:333] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:00.639348 1973 ts_tablet_manager.cc:1929] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:00.640030 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_96b2c29bad4c4371b337dc4318ef79ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.641973 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96b2c29bad4c4371b337dc4318ef79ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.652145 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f7121ded2ddc495888c7d50e41b52b40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.652956 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7121ded2ddc495888c7d50e41b52b40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.660405 2116 tablet.cc:1724] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.661792 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:00.662065 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc12bcf50074b46860899a82dc0b46e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:00.662104 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_527cf0476cba48df95b0d706d997da42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:00.662474 2124 tablet.cc:1724] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:00.662807 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_527cf0476cba48df95b0d706d997da42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.667241 1973 log.cc:1199] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a75baa585102481fa0ea01e87e394e32
I20260619 19:54:00.667963 2073 raft_consensus.cc:2749] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:00.674661 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:00.675015 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b507e37123084d588652be39a96875c4 [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 1 got 0
I20260619 19:54:00.675268 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:00.675449 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:54:00.676083 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e4132f28c434492cbddc8da7d8075c43 (table default.Table_93a36817c65c48b5b2e86a7b7a2937be [id=a57b082016f14ff48e4194fcbd7b63c1]). Expected version 1 got 0
I20260619 19:54:00.676307 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]). Expected version 3 got 0
I20260619 19:54:00.676648 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:54:00.676905 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]). Expected version 1 got 0
I20260619 19:54:00.677081 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 108f1b2e9ec74271889ffff65d8e852e (table default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d]). Expected version 1 got 0
I20260619 19:54:00.677320 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:00.677579 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_5d100ac0078e402e8b7ad4b65c4de9f5 [id=96dda797fa474e119e765b5d9946bfb7]). Expected version 1 got 0
I20260619 19:54:00.677798 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:54:00.678527 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:00.678692 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:54:00.678897 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]). Expected version 1 got 0
I20260619 19:54:00.679061 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:00.679211 2110 tablet.cc:1724] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.685060 1973 ts_tablet_manager.cc:1950] T a75baa585102481fa0ea01e87e394e32 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:00.686446 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 38) took 1609 ms. Trace:
I20260619 19:54:00.686658 1973 rpcz_store.cc:276] 0619 19:53:59.076402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.078460 (+ 2058us) service_pool.cc:224] Handling call
0619 19:54:00.219926 (+1141466us) ts_tablet_manager.cc:1151] Deleting tablet a75baa585102481fa0ea01e87e394e32
0619 19:54:00.232594 (+ 12668us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.426706 (+194112us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.539490 (+112784us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.685460 (+145970us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1141316}
I20260619 19:54:00.687562 2026 raft_consensus.cc:2243] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:00.688155 2026 pending_rounds.cc:70] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:00.688275 2026 pending_rounds.cc:77] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7298657646918713344 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "40e1b92467a44737bfabb6ec1c924ea1" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_fd5f53962cfd4900a0a79ba7de140a88" dest_uuid: "95181cc281b946c8b81aa825232d9498" new_extra_config { } }
W20260619 19:54:00.688616 2026 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35892: Aborted: Op aborted
I20260619 19:54:00.688823 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 36) took 1439 ms. Trace:
I20260619 19:54:00.688930 2026 rpcz_store.cc:276] 0619 19:53:59.249482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.286221 (+ 36739us) service_pool.cc:224] Handling call
0619 19:54:00.688768 (+1402547us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.579566 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.579744 (+ 178us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.579752 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.579760 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.579808 (+ 48us) alter_schema_op.cc:128] START. Timestamp: 1781898839579764
0619 19:53:59.579811 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.580083 (+ 272us) log.cc:844] Serialized 173 byte log entry
0619 19:54:00.688559 (+1108476us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.688570 (+ 11us) op_driver.cc:389] HandleFailure(Aborted: Op aborted)
0619 19:54:00.688577 (+ 7us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":292877,"prepare.run_cpu_time_us":41166,"prepare.run_wall_time_us":303381,"replication_time_us":1108705,"thread_start_us":703425,"threads_started":2,"wal-append.queue_time_us":182903}]]}
I20260619 19:54:00.689482 2026 raft_consensus.cc:2272] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.690690 2026 ts_tablet_manager.cc:1916] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.690902 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.689287 1994 rpcz_store.cc:276] 0619 19:53:59.310255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.310298 (+ 43us) service_pool.cc:224] Handling call
0619 19:54:00.345817 (+1035519us) ts_tablet_manager.cc:1151] Deleting tablet 620f3a56e57e49b7b520012857e71187
0619 19:54:00.345829 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.375767 (+ 29938us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.489278 (+113511us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.520043 (+ 30765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29100,"tablet-delete.queue_time_us":1035340}
I20260619 19:54:00.694779 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 70184f5fb2bc459682ddbc9e0fc48b8d (DEFAULT_TABLE table=default.Table_c96959e2ef2748848e2d44f338764f43 [id=3d0eba672d4345e8bc4c9d753efb6622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.700335 1973 tablet_replica.cc:333] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:00.700747 1973 raft_consensus.cc:2243] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.702346 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb4005068684928b3b27ff73b108d1b (DEFAULT_TABLE table=default.Table_543df7cf4dd94f00b3cb83082b6941d2 [id=50dcec72e2094942804e8252af3f7566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.702641 1200 raft_consensus.cc:359] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.703002 2101 tablet.cc:1724] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.703343 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb4005068684928b3b27ff73b108d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.703567 1994 tablet_replica.cc:333] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:00.704298 1994 raft_consensus.cc:2243] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.704514 1994 raft_consensus.cc:2272] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.705073 1994 ts_tablet_manager.cc:1916] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.705327 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70184f5fb2bc459682ddbc9e0fc48b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.708840 2138 tablet.cc:1724] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.712544 2026 ts_tablet_manager.cc:1929] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:00.712734 2026 log.cc:1199] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/40e1b92467a44737bfabb6ec1c924ea1
I20260619 19:54:00.713425 2138 tablet.cc:1724] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:00.717629 2101 tablet.cc:1724] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.721580 2138 tablet.cc:1724] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:00.723922 1200 raft_consensus.cc:385] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.724058 1200 raft_consensus.cc:740] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.724299 1200 consensus_queue.cc:260] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.727047 1200 ts_tablet_manager.cc:1434] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.142s user 0.003s sys 0.000s
I20260619 19:54:00.728700 2026 ts_tablet_manager.cc:1950] T 40e1b92467a44737bfabb6ec1c924ea1 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:00.729419 1200 tablet_bootstrap.cc:492] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:00.729661 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 20) took 1773 ms. Trace:
I20260619 19:54:00.729772 2026 rpcz_store.cc:276] 0619 19:53:58.955705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:58.958362 (+ 2657us) service_pool.cc:224] Handling call
0619 19:54:00.637259 (+1678897us) ts_tablet_manager.cc:1151] Deleting tablet 40e1b92467a44737bfabb6ec1c924ea1
0619 19:54:00.637272 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.696775 (+ 59503us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.712429 (+ 15654us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.729614 (+ 17185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1599518}
I20260619 19:54:00.730173 2026 tablet_replica.cc:333] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:00.730410 2026 raft_consensus.cc:2243] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:00.730783 2026 raft_consensus.cc:2272] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.731223 1200 tablet_bootstrap.cc:654] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:00.731803 2026 ts_tablet_manager.cc:1916] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.736322 996 leader_election.cc:304] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:00.742540 1208 tablet_bootstrap.cc:492] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:00.742807 1208 ts_tablet_manager.cc:1403] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.331s user 0.005s sys 0.008s
I20260619 19:54:00.743655 1208 raft_consensus.cc:359] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.743856 1208 raft_consensus.cc:385] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.743920 1208 raft_consensus.cc:740] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.744117 1208 consensus_queue.cc:260] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.744654 1208 ts_tablet_manager.cc:1434] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:00.745169 1208 tablet_bootstrap.cc:492] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:00.746968 1860 raft_consensus.cc:2804] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:00.747298 1973 raft_consensus.cc:2272] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.752769 1201 tablet_bootstrap.cc:654] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:00.754884 858 leader_election.cc:343] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:00.763480 2120 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 34) took 1514 ms. Trace:
I20260619 19:54:00.755070 858 leader_election.cc:304] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:00.765081 1835 raft_consensus.cc:2749] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:00.770251 970 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:54:00.765781 1973 ts_tablet_manager.cc:1916] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.774391 1860 raft_consensus.cc:493] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:00.774569 1860 raft_consensus.cc:3060] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:00.779572 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 116159us
W20260619 19:54:00.689764 518 catalog_manager.cc:5106] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): alter failed for tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]): Aborted: Op aborted
W20260619 19:54:00.780798 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 91077.5us
I20260619 19:54:00.782125 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a75baa585102481fa0ea01e87e394e32 (table default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]) successfully deleted
I20260619 19:54:00.782478 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]) successfully deleted
I20260619 19:54:00.694203 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 620f3a56e57e49b7b520012857e71187 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]) successfully deleted
W20260619 19:54:00.782728 519 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 88512.8us
I20260619 19:54:00.784924 894 tablet_service.cc:1511] Processing CreateTablet for tablet 56640f773efb4123b93f4ca3799ddde7 (DEFAULT_TABLE table=default.Table_dac857d85b7e4b748ff854769df04686 [id=628e260ecd874610b88e42ddd8bf62e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.785436 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56640f773efb4123b93f4ca3799ddde7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.736099 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a0283e721db2406c8c1a487f6cab6f46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.786293 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0283e721db2406c8c1a487f6cab6f46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.786717 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:00.787253 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 2 got 0
I20260619 19:54:00.787503 884 tablet_service.cc:1511] Processing CreateTablet for tablet 9f69d2e3ee384eb9997bed7d594c919d (DEFAULT_TABLE table=default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.787616 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:00.787901 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f69d2e3ee384eb9997bed7d594c919d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.788136 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 1 got 0
I20260619 19:54:00.788332 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_83bb8d4286d24179baa0a9b7155f15d7 [id=ff393d500bb34f318889666cc5650292]). Expected version 1 got 0
I20260619 19:54:00.788503 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_d81fd5ddf99c4cc69b837400b6c4722a [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 1 got 0
I20260619 19:54:00.788720 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:00.789469 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]). Expected version 2 got 0
I20260619 19:54:00.789883 902 tablet_service.cc:1511] Processing CreateTablet for tablet fb26af8ab52d470f8bd1b7c42a57e8a3 (DEFAULT_TABLE table=default.Table_2eddd2ecabf543a7b170898e84e5a3d5 [id=42dc873fe9774544ac2c64a38265e4aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.790342 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb26af8ab52d470f8bd1b7c42a57e8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.791435 898 tablet_service.cc:1511] Processing CreateTablet for tablet f658e85be0c843f2b02e4567a80521c4 (DEFAULT_TABLE table=default.Table_b79ac240d4f14940b5676186655549bc [id=303a823bc9844cc28a07eb1f14617bc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.785295 901 tablet_service.cc:1511] Processing CreateTablet for tablet 5482cf46c91d426484938c387b785d61 (DEFAULT_TABLE table=default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.793335 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f658e85be0c843f2b02e4567a80521c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.797851 1860 raft_consensus.cc:515] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.798662 1860 leader_election.cc:290] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:00.800180 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 56640f773efb4123b93f4ca3799ddde7 (DEFAULT_TABLE table=default.Table_dac857d85b7e4b748ff854769df04686 [id=628e260ecd874610b88e42ddd8bf62e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.801218 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56640f773efb4123b93f4ca3799ddde7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:00.801945 518 catalog_manager.cc:5100] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): alter failed for tablet 40e1b92467a44737bfabb6ec1c924ea1 (table default.Table_fd5f53962cfd4900a0a79ba7de140a88 [id=1cf43945643240d2820b1de8551e394c]),no further retry: Not found: Tablet not found: 40e1b92467a44737bfabb6ec1c924ea1
I20260619 19:54:00.802125 893 tablet_service.cc:1511] Processing CreateTablet for tablet 70184f5fb2bc459682ddbc9e0fc48b8d (DEFAULT_TABLE table=default.Table_c96959e2ef2748848e2d44f338764f43 [id=3d0eba672d4345e8bc4c9d753efb6622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.803203 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5482cf46c91d426484938c387b785d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.803830 2026 ts_tablet_manager.cc:1929] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260619 19:54:00.804728 996 leader_election.cc:343] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:00.809074 777 raft_consensus.cc:2468] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 2.
I20260619 19:54:00.810798 1208 tablet_bootstrap.cc:654] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:00.817029 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6d1f0f1124cb46138d7584cfd183ea34" } modify_external_catalogs: true
I20260619 19:54:00.817373 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6d1f0f1124cb46138d7584cfd183ea34" } modify_external_catalogs: true
I20260619 19:54:00.824877 1024 tablet_service.cc:1511] Processing CreateTablet for tablet f658e85be0c843f2b02e4567a80521c4 (DEFAULT_TABLE table=default.Table_b79ac240d4f14940b5676186655549bc [id=303a823bc9844cc28a07eb1f14617bc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.825333 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f658e85be0c843f2b02e4567a80521c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.826606 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 5482cf46c91d426484938c387b785d61 (DEFAULT_TABLE table=default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.826911 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:00.827018 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]). Expected version 1 got 0
I20260619 19:54:00.827265 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (table default.Table_d911a0e8835847cb9ccf9d5d192872fe [id=57b57ad63a674bf08da4cf6d7bcd1b4e]). Expected version 1 got 0
I20260619 19:54:00.827472 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202]). Expected version 2 got 0
I20260619 19:54:00.827440 1025 tablet_service.cc:1511] Processing CreateTablet for tablet fb26af8ab52d470f8bd1b7c42a57e8a3 (DEFAULT_TABLE table=default.Table_2eddd2ecabf543a7b170898e84e5a3d5 [id=42dc873fe9774544ac2c64a38265e4aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.828362 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9f69d2e3ee384eb9997bed7d594c919d (DEFAULT_TABLE table=default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:00.830135 1860 consensus_queue.cc:1048] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260619 19:54:00.830533 2026 log.cc:1199] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/b65f88b43b4e45c481aa7d43ef59fe7a
I20260619 19:54:00.830973 2026 ts_tablet_manager.cc:1950] T b65f88b43b4e45c481aa7d43ef59fe7a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:00.831357 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 32) took 1582 ms. Trace:
I20260619 19:54:00.831342 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 32665a93ee5b4f8290c79e2a1d4b1db1 (table default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8]). Expected version 3 got 0
I20260619 19:54:00.831456 2026 rpcz_store.cc:276] 0619 19:53:59.248995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.263725 (+ 14730us) service_pool.cc:224] Handling call
0619 19:54:00.730097 (+1466372us) ts_tablet_manager.cc:1151] Deleting tablet b65f88b43b4e45c481aa7d43ef59fe7a
0619 19:54:00.730109 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.735927 (+ 5818us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.803705 (+ 67778us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.831303 (+ 27598us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1436028}
I20260619 19:54:00.831569 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:00.831933 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet b65f88b43b4e45c481aa7d43ef59fe7a (table default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]) successfully deleted
I20260619 19:54:00.832185 919 raft_consensus.cc:3060] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:00.832986 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70184f5fb2bc459682ddbc9e0fc48b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.833124 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb26af8ab52d470f8bd1b7c42a57e8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.834582 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5482cf46c91d426484938c387b785d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.836162 1200 tablet_bootstrap.cc:492] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:00.836660 1994 ts_tablet_manager.cc:1929] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.836853 1994 log.cc:1199] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/2a3fa43017fa4c278111c29d0d22f7da
I20260619 19:54:00.837078 2026 tablet_replica.cc:333] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:00.837301 2026 raft_consensus.cc:2243] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.837447 1994 ts_tablet_manager.cc:1950] T 2a3fa43017fa4c278111c29d0d22f7da P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:00.837491 2026 raft_consensus.cc:2272] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.838037 2026 ts_tablet_manager.cc:1916] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.838200 1200 ts_tablet_manager.cc:1403] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.108s user 0.000s sys 0.007s
I20260619 19:54:00.839242 1200 raft_consensus.cc:359] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.839543 1200 raft_consensus.cc:385] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:00.839676 1200 raft_consensus.cc:740] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:00.841527 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 3 got 0
I20260619 19:54:00.842129 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:00.842442 1835 raft_consensus.cc:493] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:00.842619 1835 raft_consensus.cc:515] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:00.842700 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c08fc0181e5642d0a2b7967ff30d4eaa consensus state has no leader
I20260619 19:54:00.843302 1835 leader_election.cc:290] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:00.843315 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_22aa0ecb6e6d4d81b2b7143514b03ea8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.844018 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22aa0ecb6e6d4d81b2b7143514b03ea8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.845525 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0dd210e843db4f58a976af5c28dabc9c
I20260619 19:54:00.846436 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3a52ed0a914a41d39dbd362b643ed5f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.846971 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a52ed0a914a41d39dbd362b643ed5f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.854506 525 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a] alter complete (version 1)
I20260619 19:54:00.831538 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:00.855366 919 raft_consensus.cc:2468] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:00.855715 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0b55debc1b064192a56d2453364ba260
I20260619 19:54:00.856411 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 1d0fe0c67fe84e5b866fd2553ea26d91 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:00.856673 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d758bed342d14223ac00095546093692"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.857316 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d758bed342d14223ac00095546093692 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.860329 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:00.861011 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83452ce6b5b3479b98ea312db05dc651 consensus state has no leader
I20260619 19:54:00.861492 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d81fd5ddf99c4cc69b837400b6c4722a" } new_table_name: "default.Table_dc77e7b8f63e4fe4924fdae4421075e9" modify_external_catalogs: true
I20260619 19:54:00.865432 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e52c915643548ad8181928b723f114a" } modify_external_catalogs: true
I20260619 19:54:00.865644 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e52c915643548ad8181928b723f114a" } modify_external_catalogs: true
I20260619 19:54:00.867246 523 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:37030 (request call id 129) took 1453 ms. Trace:
I20260619 19:54:00.867376 523 rpcz_store.cc:276] 0619 19:53:59.413753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.707999 (+294246us) service_pool.cc:224] Handling call
0619 19:53:59.720014 (+ 12015us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570d1956 00007fd74db2f146 00007fd74db2ee75 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:53:59.720256 (+ 242us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0619 19:53:59.720473 (+ 217us) catalog_manager.cc:3750] Apply alter schema
0619 19:53:59.720648 (+ 175us) catalog_manager.cc:3782] Acquired catalog manager lock
0619 19:53:59.720739 (+ 91us) catalog_manager.cc:3940] Updating metadata on disk
0619 19:53:59.860202 (+139463us) catalog_manager.cc:3971] Committing alterations to in-memory state
0619 19:54:00.867167 (+1006965us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.801628 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:53:59.801770 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:53:59.801776 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:53:59.801778 (+ 2us) tablet.cc:662] Decoding operations
0619 19:53:59.801874 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:53:59.801885 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0619 19:53:59.801889 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:53:59.801946 (+ 57us) tablet.cc:701] Row locks acquired
0619 19:53:59.801948 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:53:59.801983 (+ 35us) write_op.cc:270] Start()
0619 19:53:59.802014 (+ 31us) write_op.cc:276] Timestamp: P: 1781898839801957 usec, L: 0
0619 19:53:59.802018 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.802223 (+ 205us) log.cc:844] Serialized 405 byte log entry
0619 19:53:59.855794 (+ 53571us) op_driver.cc:464] REPLICATION: finished
0619 19:53:59.856213 (+ 419us) write_op.cc:301] APPLY: starting
0619 19:53:59.856231 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0619 19:53:59.856288 (+ 57us) tablet.cc:1370] finished BulkCheckPresence
0619 19:53:59.856318 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:53:59.856370 (+ 52us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:53:59.856408 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:53:59.856415 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:53:59.856500 (+ 85us) log.cc:844] Serialized 23 byte log entry
0619 19:53:59.856564 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:59.856582 (+ 18us) write_op.cc:454] Released schema lock
0619 19:53:59.856589 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:53:59.857084 (+ 495us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:53:59.857090 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":27000192,"child_traces":[["op",{"apply.queue_time_us":367,"apply.run_cpu_time_us":440,"apply.run_wall_time_us":439,"num_ops":1,"prepare.queue_time_us":80435,"prepare.run_cpu_time_us":752,"prepare.run_wall_time_us":4911,"raft.queue_time_us":143,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":53743}]]}
I20260619 19:54:00.868377 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c73a82d38a4545cc8940056415afdc2b" } new_table_name: "default.Table_6fa059c58932422ab8d776397d5a3379" modify_external_catalogs: true
W20260619 19:54:00.871501 525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 221) took 834 ms (client timeout 1000 ms). Trace:
I20260619 19:54:00.872107 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f0f413b2e81b46ab983274ef921228fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.872766 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0f413b2e81b46ab983274ef921228fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:00.871663 525 rpcz_store.cc:269] 0619 19:54:00.036779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.036871 (+ 92us) service_pool.cc:224] Handling call
0619 19:54:00.871442 (+834571us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:00.318159 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:00.318272 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:00.318277 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:00.318280 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:00.318380 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:00.318388 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:00.318393 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:00.318457 (+ 64us) tablet.cc:701] Row locks acquired
0619 19:54:00.318459 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:00.318490 (+ 31us) write_op.cc:270] Start()
0619 19:54:00.318519 (+ 29us) write_op.cc:276] Timestamp: P: 1781898840318464 usec, L: 0
0619 19:54:00.318523 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:00.318672 (+ 149us) log.cc:844] Serialized 533 byte log entry
0619 19:54:00.340291 (+ 21619us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.340865 (+ 574us) write_op.cc:301] APPLY: starting
0619 19:54:00.340887 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:00.340946 (+ 59us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:00.341002 (+ 56us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:00.341076 (+ 74us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:00.341124 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:00.341135 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:00.341240 (+ 105us) log.cc:844] Serialized 23 byte log entry
0619 19:54:00.341313 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:00.341338 (+ 25us) write_op.cc:454] Released schema lock
0619 19:54:00.341348 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:00.341441 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:00.341448 (+ 7us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:00.344393 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:00.344508 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:00.344514 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:00.344516 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:00.344610 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:00.344621 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:00.344625 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:00.344689 (+ 64us) tablet.cc:701] Row locks acquired
0619 19:54:00.344691 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:00.344726 (+ 35us) write_op.cc:270] Start()
0619 19:54:00.344760 (+ 34us) write_op.cc:276] Timestamp: P: 1781898840344697 usec, L: 0
0619 19:54:00.344763 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:00.344937 (+ 174us) log.cc:844] Serialized 356 byte log entry
0619 19:54:00.366332 (+ 21395us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.366958 (+ 626us) write_op.cc:301] APPLY: starting
0619 19:54:00.367007 (+ 49us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:00.367092 (+ 85us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:00.367183 (+ 91us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:00.367312 (+ 129us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:00.367387 (+ 75us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:00.367424 (+ 37us) write_op.cc:312] APPLY: finished
0619 19:54:00.367590 (+ 166us) log.cc:844] Serialized 23 byte log entry
0619 19:54:00.367716 (+ 126us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:00.367768 (+ 52us) write_op.cc:454] Released schema lock
0619 19:54:00.367778 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:00.367926 (+ 148us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:00.367959 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":477,"apply.run_cpu_time_us":568,"apply.run_wall_time_us":568,"num_ops":1,"prepare.queue_time_us":338,"prepare.run_cpu_time_us":601,"prepare.run_wall_time_us":601,"raft.queue_time_us":78,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":21723}],["op",{"apply.queue_time_us":489,"apply.run_cpu_time_us":728,"apply.run_wall_time_us":957,"num_ops":1,"prepare.queue_time_us":83,"prepare.run_cpu_time_us":650,"prepare.run_wall_time_us":649,"raft.queue_time_us":95,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":21497}]]}
I20260619 19:54:00.874776 525 master_service.cc:960] ReplaceTablet: received request to replace tablet d895be304fcf445e9a4d2d8242becdd5 from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:00.875699 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fde2b5d12ab7465791f26d214c2dc2f5 consensus state has no leader
I20260619 19:54:00.866546 1973 ts_tablet_manager.cc:1929] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:00.876178 1973 log.cc:1199] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/376dfca0b54d4c689c96242566869717
I20260619 19:54:00.876112 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b0a31efd94754d3f8883825db473e0fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.876619 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0a31efd94754d3f8883825db473e0fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.876716 1973 ts_tablet_manager.cc:1950] T 376dfca0b54d4c689c96242566869717 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:00.877091 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 37) took 1800 ms. Trace:
I20260619 19:54:00.877190 1973 rpcz_store.cc:276] 0619 19:53:59.076282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.078401 (+ 2119us) service_pool.cc:224] Handling call
0619 19:54:00.687181 (+1608780us) ts_tablet_manager.cc:1151] Deleting tablet 376dfca0b54d4c689c96242566869717
0619 19:54:00.687193 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.840705 (+153512us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.866403 (+ 25698us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.877059 (+ 10656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1597152}
I20260619 19:54:00.877534 1973 tablet_replica.cc:333] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:00.877751 1973 raft_consensus.cc:2243] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.877907 1973 raft_consensus.cc:2272] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.881353 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:00.882325 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_be05e3d01010443c87fa83b4acde4eed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.882905 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be05e3d01010443c87fa83b4acde4eed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.883085 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e01bf9476bef42e98a895c3e39d404e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.883745 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e01bf9476bef42e98a895c3e39d404e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.887728 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_12c17931f69847b09d4265e736b0ba36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.888916 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12c17931f69847b09d4265e736b0ba36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.895861 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd210e843db4f58a976af5c28dabc9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.896423 1835 raft_consensus.cc:493] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:00.896612 1835 raft_consensus.cc:515] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.897508 1835 leader_election.cc:290] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:00.898751 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.904652 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_34c184c3d7184b60af86c17cf2708721"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:00.905283 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34c184c3d7184b60af86c17cf2708721 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:00.914870 2026 ts_tablet_manager.cc:1929] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:00.917531 2026 log.cc:1199] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/cbec819571854db8a46daae15b9127bd
I20260619 19:54:00.919405 2026 ts_tablet_manager.cc:1950] T cbec819571854db8a46daae15b9127bd P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:00.923661 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 31) took 1674 ms. Trace:
I20260619 19:54:00.931381 2026 rpcz_store.cc:276] 0619 19:53:59.248904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.373463 (+124559us) service_pool.cc:224] Handling call
0619 19:54:00.836984 (+1463521us) ts_tablet_manager.cc:1151] Deleting tablet cbec819571854db8a46daae15b9127bd
0619 19:54:00.836995 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.870251 (+ 33256us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.914768 (+ 44517us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.923627 (+ 8859us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1242266}
I20260619 19:54:00.933888 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet cbec819571854db8a46daae15b9127bd (table default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]) successfully deleted
I20260619 19:54:00.934991 2026 tablet_replica.cc:333] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:00.936457 2026 raft_consensus.cc:2243] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:00.938158 2026 raft_consensus.cc:2272] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:00.841625 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f69d2e3ee384eb9997bed7d594c919d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:00.907234 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:00.918524 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd210e843db4f58a976af5c28dabc9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.918707 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.918773 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcb1050f57246feb65f7e8948856c21" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:00.952557 859 leader_election.cc:343] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:00.953135 859 leader_election.cc:343] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:00.954608 1973 ts_tablet_manager.cc:1916] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:00.920082 1860 raft_consensus.cc:493] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:00.920504 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:00.920836 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:00.922115 996 leader_election.cc:343] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:00.955653 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 49903.9us
I20260619 19:54:00.956068 1860 raft_consensus.cc:515] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.956491 996 leader_election.cc:304] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:00.956851 2117 raft_consensus.cc:2804] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:00.957008 2117 raft_consensus.cc:697] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:00.957095 1860 leader_election.cc:290] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:00.957357 2117 consensus_queue.cc:237] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.960248 1200 consensus_queue.cc:260] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:00.961723 1200 ts_tablet_manager.cc:1434] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.123s user 0.002s sys 0.000s
I20260619 19:54:00.962661 1200 tablet_bootstrap.cc:492] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:00.964350 996 consensus_peers.cc:597] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:00.965191 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 43) took 1654 ms. Trace:
I20260619 19:54:00.965422 1994 rpcz_store.cc:276] 0619 19:53:59.310617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.310661 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:00.692246 (+1381585us) ts_tablet_manager.cc:1151] Deleting tablet 2a3fa43017fa4c278111c29d0d22f7da
0619 19:54:00.692256 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:00.715447 (+ 23191us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.822138 (+106691us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.965154 (+143016us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381432}
I20260619 19:54:00.965540 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27342783a5641d7a324e71183269308" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:00.965795 917 raft_consensus.cc:2468] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:00.966106 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 2a3fa43017fa4c278111c29d0d22f7da (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]) successfully deleted
I20260619 19:54:00.966542 1994 tablet_replica.cc:333] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:00.966827 1994 raft_consensus.cc:2243] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:00.967080 1994 raft_consensus.cc:2272] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:00.967264 2147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:54:00.967321 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27342783a5641d7a324e71183269308" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:00.947383 2143 log.cc:927] Time spent T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260619 19:54:00.968128 1994 ts_tablet_manager.cc:1916] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:00.971558 2151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:54:00.997994 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 2448429656934063887b63d9a6e79894
W20260619 19:54:01.001089 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 241017us
W20260619 19:54:01.002544 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 178013us
I20260619 19:54:01.003453 759 tablet_service.cc:1511] Processing CreateTablet for tablet d77de42bb514452a8dc6a4a71289dc59 (DEFAULT_TABLE table=default.Table_4c7e1ad3890d4f9dbc9f41258e5d20b9 [id=94a5aa43010a4086a2b9f24ceeaf4013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.004014 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77de42bb514452a8dc6a4a71289dc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.004312 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 2448429656934063887b63d9a6e79894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.009301 748 tablet_service.cc:1511] Processing CreateTablet for tablet 9911df524f8948ea8ecce55df0fdd0d6 (DEFAULT_TABLE table=default.Table_d2c62460bd8d448584fc4e76100e5fea [id=1150e278fd3646d9b0897243ff2524d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.009793 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911df524f8948ea8ecce55df0fdd0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.011093 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:01.011795 525 catalog_manager.cc:6784] ReplaceTablet: tablet d895be304fcf445e9a4d2d8242becdd5 deleted and replaced by tablet 10c73b679e394f31b9e5d51681e06976
I20260619 19:54:01.012452 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:01.014735 902 tablet_service.cc:1558] Processing DeleteTablet for tablet d895be304fcf445e9a4d2d8242becdd5 with delete_type TABLET_DATA_DELETED (replaced by tablet 10c73b679e394f31b9e5d51681e06976) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.015183 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.018338 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 with delete_type TABLET_DATA_DELETED (replaced by tablet e4688dc20317479e9c80f6f41b3ea35e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.018805 748 tablet_service.cc:1511] Processing CreateTablet for tablet a54231986cca44258942dbc3373870b2 (DEFAULT_TABLE table=default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.019402 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a54231986cca44258942dbc3373870b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.019459 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7494ac3aaae7481c9ee7fb950cd2d20d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.020188 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7494ac3aaae7481c9ee7fb950cd2d20d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.023970 2158 raft_consensus.cc:493] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.024135 2158 raft_consensus.cc:515] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.024833 2158 leader_election.cc:290] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.025218 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:01.026826 720 consensus_peers.cc:597] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 620f3a56e57e49b7b520012857e71187. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:01.033329 2158 consensus_queue.cc:1048] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:01.028467 1208 tablet_bootstrap.cc:492] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.030241 760 tablet_service.cc:1511] Processing CreateTablet for tablet 4841d03189e84deaa036f235946e877a (DEFAULT_TABLE table=default.Table_828ae87da1244552a87a9526a110dd46 [id=6618e222b126441bb6127b256ea32421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.034216 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841d03189e84deaa036f235946e877a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.031368 746 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.042318 1208 ts_tablet_manager.cc:1403] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.297s user 0.010s sys 0.022s
I20260619 19:54:01.031608 759 tablet_service.cc:1511] Processing CreateTablet for tablet e7a19f43793b4440b7a9d2652a75e6bd (DEFAULT_TABLE table=default.Table_d7e665d3d76f4453b1daa939934eb82b [id=37dfe7b7dbe8482890ea073e0c9a42da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.031826 765 tablet_service.cc:1511] Processing CreateTablet for tablet 70184f5fb2bc459682ddbc9e0fc48b8d (DEFAULT_TABLE table=default.Table_c96959e2ef2748848e2d44f338764f43 [id=3d0eba672d4345e8bc4c9d753efb6622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.032280 755 tablet_service.cc:1511] Processing CreateTablet for tablet fb26af8ab52d470f8bd1b7c42a57e8a3 (DEFAULT_TABLE table=default.Table_2eddd2ecabf543a7b170898e84e5a3d5 [id=42dc873fe9774544ac2c64a38265e4aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.043844 1208 raft_consensus.cc:359] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.032328 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb4005068684928b3b27ff73b108d1b (DEFAULT_TABLE table=default.Table_543df7cf4dd94f00b3cb83082b6941d2 [id=50dcec72e2094942804e8252af3f7566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.044075 1208 raft_consensus.cc:385] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.044162 1208 raft_consensus.cc:740] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.044418 1208 consensus_queue.cc:260] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.044559 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70184f5fb2bc459682ddbc9e0fc48b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.045150 1208 ts_tablet_manager.cc:1434] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:54:01.045488 1208 tablet_bootstrap.cc:492] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.048324 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb4005068684928b3b27ff73b108d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.048003 751 tablet_service.cc:1511] Processing CreateTablet for tablet f658e85be0c843f2b02e4567a80521c4 (DEFAULT_TABLE table=default.Table_b79ac240d4f14940b5676186655549bc [id=303a823bc9844cc28a07eb1f14617bc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.048756 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f658e85be0c843f2b02e4567a80521c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.049013 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb26af8ab52d470f8bd1b7c42a57e8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.047997 746 tablet_service.cc:1511] Processing CreateTablet for tablet 9f69d2e3ee384eb9997bed7d594c919d (DEFAULT_TABLE table=default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.049471 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f69d2e3ee384eb9997bed7d594c919d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.050028 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a19f43793b4440b7a9d2652a75e6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.051055 747 tablet_service.cc:1511] Processing CreateTablet for tablet 5482cf46c91d426484938c387b785d61 (DEFAULT_TABLE table=default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.051530 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5482cf46c91d426484938c387b785d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.052445 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd210e843db4f58a976af5c28dabc9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.053087 1201 tablet_bootstrap.cc:492] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:01.053092 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.053283 1201 ts_tablet_manager.cc:1403] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.448s user 0.002s sys 0.002s
I20260619 19:54:01.054338 760 tablet_service.cc:1511] Processing CreateTablet for tablet 56640f773efb4123b93f4ca3799ddde7 (DEFAULT_TABLE table=default.Table_dac857d85b7e4b748ff854769df04686 [id=628e260ecd874610b88e42ddd8bf62e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.054414 1201 raft_consensus.cc:359] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.054981 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56640f773efb4123b93f4ca3799ddde7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.055583 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e7b911b51485494b87757309f0561405" } new_table_name: "default.Table_b41b3cd479c44f1781a0022aef0bd30f" modify_external_catalogs: true
I20260619 19:54:01.057016 2149 consensus_queue.cc:1048] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:01.067051 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7494ac3aaae7481c9ee7fb950cd2d20d" } modify_external_catalogs: true
I20260619 19:54:01.067265 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.067305 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7494ac3aaae7481c9ee7fb950cd2d20d" } modify_external_catalogs: true
I20260619 19:54:01.067826 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 2448429656934063887b63d9a6e79894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.068223 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d895be304fcf445e9a4d2d8242becdd5 with delete_type TABLET_DATA_DELETED (replaced by tablet 10c73b679e394f31b9e5d51681e06976) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.068630 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.070343 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_12c17931f69847b09d4265e736b0ba36" } new_table_name: "default.Table_b4e382f7a7df4dc5b57ba16132be7f6c" modify_external_catalogs: true
I20260619 19:54:01.071954 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:01.072479 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a5d67c87b793425982fdfaddadd3b827"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.073076 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5d67c87b793425982fdfaddadd3b827 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.073062 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcb1050f57246feb65f7e8948856c21" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:01.077713 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cdf577f46fe04a03b5ee265415239167"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.078492 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdf577f46fe04a03b5ee265415239167 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.080134 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6c755150293e4861b3e1403d72ead695" } modify_external_catalogs: true
I20260619 19:54:01.080369 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6c755150293e4861b3e1403d72ead695" } modify_external_catalogs: true
I20260619 19:54:01.081274 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e015b3b2661b46f5a24476b50a6616b5" } new_table_name: "default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb" modify_external_catalogs: true
I20260619 19:54:01.083915 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f0f413b2e81b46ab983274ef921228fd" } new_table_name: "default.Table_53c4ff46dfa649b29c6dfe8e8af85a17" modify_external_catalogs: true
I20260619 19:54:01.084879 1973 ts_tablet_manager.cc:1929] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.085033 1973 log.cc:1199] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/33935217c1f44ce0ad5b8610d368f2eb
I20260619 19:54:01.085464 1973 ts_tablet_manager.cc:1950] T 33935217c1f44ce0ad5b8610d368f2eb P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.085848 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 35) took 2009 ms. Trace:
I20260619 19:54:01.085950 1973 rpcz_store.cc:276] 0619 19:53:59.076081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.078054 (+ 1973us) service_pool.cc:224] Handling call
0619 19:54:00.877460 (+1799406us) ts_tablet_manager.cc:1151] Deleting tablet 33935217c1f44ce0ad5b8610d368f2eb
0619 19:54:00.877482 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.014614 (+137132us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.084789 (+ 70175us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.085782 (+ 993us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787058}
I20260619 19:54:01.086344 1973 tablet_replica.cc:333] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.086566 1973 raft_consensus.cc:2243] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:01.109256 2170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 19:54:00.973747 996 leader_election.cc:343] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:01.127683 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 153947us
I20260619 19:54:01.128051 996 leader_election.cc:304] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:00.987262 2021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.006s sys 0.006s
I20260619 19:54:01.028769 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d895be304fcf445e9a4d2d8242becdd5 with delete_type TABLET_DATA_DELETED (replaced by tablet 10c73b679e394f31b9e5d51681e06976) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:01.029009 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:01.039538 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbec819571854db8a46daae15b9127bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:01.130617 2021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s user 0.006s sys 0.006s
I20260619 19:54:01.050887 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 2448429656934063887b63d9a6e79894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:01.121905 1056 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.007s sys 0.003s
W20260619 19:54:01.131000 1056 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.522s user 0.007s sys 0.003s
I20260619 19:54:01.131162 2035 raft_consensus.cc:2804] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:01.131296 2035 raft_consensus.cc:493] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:01.131394 2035 raft_consensus.cc:3060] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:01.131493 720 leader_election.cc:343] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.132844 2141 tablet.cc:1724] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:01.134366 2035 raft_consensus.cc:515] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.139685 2035 leader_election.cc:290] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.139750 2117 consensus_queue.cc:1048] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:01.148204 516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260619 19:54:01.149974 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 33935217c1f44ce0ad5b8610d368f2eb (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]) successfully deleted
I20260619 19:54:01.150154 1208 tablet_bootstrap.cc:654] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.100050 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.104802 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.105679 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 376dfca0b54d4c689c96242566869717 with delete_type TABLET_DATA_DELETED (replaced by tablet 9f6ec149e1ac475f8038b328dae4af2a) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.107218 884 tablet_service.cc:1558] Processing DeleteTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.108229 894 tablet_service.cc:1558] Processing DeleteTablet for tablet e3031a45cf534814bbece8d271c0420e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.109155 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.114904 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.118216 897 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.119076 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.121404 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.122045 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.126447 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:00.763650 2120 rpcz_store.cc:276] 0619 19:53:59.249250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.250757 (+ 1507us) service_pool.cc:224] Handling call
0619 19:54:00.763423 (+1512666us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:53:59.361177 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:53:59.361394 (+ 217us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:53:59.361402 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0619 19:53:59.361410 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:53:59.361452 (+ 42us) alter_schema_op.cc:128] START. Timestamp: 1781898839361380
0619 19:53:59.361458 (+ 6us) op_driver.cc:348] REPLICATION: starting
0619 19:53:59.361669 (+ 211us) log.cc:844] Serialized 173 byte log entry
0619 19:54:00.279113 (+917444us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.481695 (+202582us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:00.598306 (+116611us) log.cc:844] Serialized 5 byte log entry
0619 19:54:00.762663 (+164357us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:00.762983 (+ 320us) log.cc:844] Serialized 14 byte log entry
0619 19:54:00.763376 (+ 393us) alter_schema_op.cc:73] Released schema lock
0619 19:54:00.763381 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":202458,"prepare.queue_time_us":96907,"prepare.run_cpu_time_us":9010,"prepare.run_wall_time_us":419787,"raft.queue_time_us":327,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":244,"replication_time_us":917624,"thread_start_us":919452,"threads_started":3,"wal-append.queue_time_us":371163}]]}
I20260619 19:54:01.128154 2122 tablet.cc:1724] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:01.152055 1201 raft_consensus.cc:385] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.152215 1201 raft_consensus.cc:740] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.140357 895 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.141011 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.144330 858 leader_election.cc:304] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:01.152477 1201 consensus_queue.cc:260] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.153868 1201 ts_tablet_manager.cc:1434] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.100s user 0.001s sys 0.001s
W20260619 19:54:01.154165 858 leader_election.cc:343] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.154296 1201 tablet_bootstrap.cc:492] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:01.154435 2004 raft_consensus.cc:2804] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:01.154934 1652 consensus_queue.cc:1048] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:01.156497 2026 ts_tablet_manager.cc:1916] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.154315 858 leader_election.cc:304] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:01.160245 858 leader_election.cc:343] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.160391 858 leader_election.cc:304] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:01.160939 1840 raft_consensus.cc:2749] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:01.161229 1840 raft_consensus.cc:2749] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:01.163622 1820 server_base.cc:1061] running on GCE node
I20260619 19:54:01.165697 2026 ts_tablet_manager.cc:1929] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:01.165879 2026 log.cc:1199] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:01.167603 1820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 19:54:01.167922 2026 ts_tablet_manager.cc:1950] T a690a4fdf60947acb271abe588d4b5c0 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:01.168376 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 42) took 1557 ms. Trace:
I20260619 19:54:01.168481 2026 rpcz_store.cc:276] 0619 19:53:59.610475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.610615 (+ 140us) service_pool.cc:224] Handling call
0619 19:54:00.934901 (+1324286us) ts_tablet_manager.cc:1151] Deleting tablet a690a4fdf60947acb271abe588d4b5c0
0619 19:54:00.934910 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.161589 (+226679us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.165603 (+ 4014us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.168311 (+ 2708us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1274234}
I20260619 19:54:01.168962 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 56) took 1459 ms. Trace:
I20260619 19:54:01.169056 2026 rpcz_store.cc:276] 0619 19:53:59.709021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.731980 (+ 22959us) service_pool.cc:224] Handling call
0619 19:54:01.168755 (+1436775us) ts_tablet_manager.cc:1151] Deleting tablet f8a589ce3ae94cd1bb28b15e4e0e4a22
0619 19:54:01.168764 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.168915 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1436494}
I20260619 19:54:01.169220 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f]) successfully deleted
W20260619 19:54:01.169548 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 already in progress: creating tablet
I20260619 19:54:01.174597 1973 raft_consensus.cc:2272] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:01.175448 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d772e0bd2d4420f836fa14ca2dadb24 consensus state has no leader
I20260619 19:54:01.176018 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_33d0cb686a25428da2d7a81cf90723b9" } new_table_name: "default.Table_122ef08337114140a4943c821d049ffb" modify_external_catalogs: true
I20260619 19:54:01.176433 1208 tablet_bootstrap.cc:492] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.176615 1208 ts_tablet_manager.cc:1403] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.131s user 0.002s sys 0.002s
I20260619 19:54:01.178819 1973 ts_tablet_manager.cc:1916] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.186753 890 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:01.187168 719 leader_election.cc:343] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: cbec819571854db8a46daae15b9127bd
I20260619 19:54:01.187333 719 leader_election.cc:304] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:01.188390 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 59) took 1419 ms. Trace:
I20260619 19:54:01.188634 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:01.188827 719 raft_consensus.cc:2686] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:01.188510 2026 rpcz_store.cc:276] 0619 19:53:59.768782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.770520 (+ 1738us) service_pool.cc:224] Handling call
0619 19:54:01.188143 (+1417623us) ts_tablet_manager.cc:1151] Deleting tablet 8bc11c632b514118856ea4c11b431142
0619 19:54:01.188156 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.188314 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1417372}
W20260619 19:54:01.190217 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 8bc11c632b514118856ea4c11b431142 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8bc11c632b514118856ea4c11b431142 already in progress: creating tablet
I20260619 19:54:01.191052 1208 raft_consensus.cc:359] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.191303 1208 raft_consensus.cc:385] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.191381 1208 raft_consensus.cc:740] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.192072 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 58) took 1424 ms. Trace:
I20260619 19:54:01.192193 2026 rpcz_store.cc:276] 0619 19:53:59.767874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.767983 (+ 109us) service_pool.cc:224] Handling call
0619 19:54:01.191884 (+1423901us) ts_tablet_manager.cc:1151] Deleting tablet e6dcf87d57044279a218cbb21c383352
0619 19:54:01.191898 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.192013 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403969}
W20260619 19:54:01.192687 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e6dcf87d57044279a218cbb21c383352 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6dcf87d57044279a218cbb21c383352 already in progress: creating tablet
I20260619 19:54:01.193419 2073 consensus_queue.cc:1048] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:01.199261 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.201452 1200 tablet_bootstrap.cc:654] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.202015 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 57) took 1488 ms. Trace:
I20260619 19:54:01.202121 2026 rpcz_store.cc:276] 0619 19:53:59.713166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.732276 (+ 19110us) service_pool.cc:224] Handling call
0619 19:54:01.201836 (+1469560us) ts_tablet_manager.cc:1151] Deleting tablet 4b88dd7d19514e83857e2c6108291b9f
0619 19:54:01.201848 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.201947 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1391048}
W20260619 19:54:01.202457 720 consensus_peers.cc:597] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:01.202632 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 4b88dd7d19514e83857e2c6108291b9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b88dd7d19514e83857e2c6108291b9f already in progress: creating tablet
I20260619 19:54:01.203518 1208 consensus_queue.cc:260] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.203985 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.205224 747 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.206511 1208 ts_tablet_manager.cc:1434] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.030s user 0.004s sys 0.000s
I20260619 19:54:01.207813 2173 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.207980 2173 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.206799 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.207726 747 tablet_service.cc:1558] Processing DeleteTablet for tablet a75baa585102481fa0ea01e87e394e32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.211035 757 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.212677 1208 tablet_bootstrap.cc:492] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.215612 1820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260619 19:54:01.217640 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260619 19:54:01.220273 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a16fdee448fb4975861b7cd46cbbc271 has no consensus state
I20260619 19:54:01.221520 525 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 65d7c87aff894ea5ace17e8dabcfdb34
I20260619 19:54:01.222069 1973 ts_tablet_manager.cc:1929] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:01.229816 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 54) took 1502 ms. Trace:
I20260619 19:54:01.230005 2026 rpcz_store.cc:276] 0619 19:53:59.705873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.713264 (+ 7391us) service_pool.cc:224] Handling call
0619 19:54:01.207211 (+1493947us) ts_tablet_manager.cc:1151] Deleting tablet 74949d09466f42e2852389e10192989d
0619 19:54:01.207227 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.208332 (+ 1105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394180}
W20260619 19:54:01.230674 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 74949d09466f42e2852389e10192989d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74949d09466f42e2852389e10192989d already in progress: creating tablet
I20260619 19:54:01.231693 2124 tablet.cc:1724] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:01.232093 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 55) took 1526 ms. Trace:
I20260619 19:54:01.233608 2026 rpcz_store.cc:276] 0619 19:53:59.706008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.713402 (+ 7394us) service_pool.cc:224] Handling call
0619 19:54:01.231825 (+1518423us) ts_tablet_manager.cc:1151] Deleting tablet 2c71f92f4e3040c09b67e287a19eea74
0619 19:54:01.231842 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.232010 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1389201}
W20260619 19:54:01.234335 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2c71f92f4e3040c09b67e287a19eea74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c71f92f4e3040c09b67e287a19eea74 already in progress: creating tablet
I20260619 19:54:01.234961 1208 tablet_bootstrap.cc:654] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.236061 2004 raft_consensus.cc:697] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:01.238000 2160 consensus_queue.cc:1048] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:01.238435 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 107400us
I20260619 19:54:01.239094 1200 tablet_bootstrap.cc:492] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:01.239078 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.239404 1200 ts_tablet_manager.cc:1403] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.277s user 0.001s sys 0.004s
I20260619 19:54:01.239580 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 65) took 1236 ms. Trace:
I20260619 19:54:01.240343 1200 raft_consensus.cc:359] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.241381 2004 consensus_queue.cc:237] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:01.243103 1200 raft_consensus.cc:385] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.244385 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.245136 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.245822 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c379d780b294b9a863576f53f79ee7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.246560 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27342783a5641d7a324e71183269308" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:01.247474 918 raft_consensus.cc:3060] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.239675 2026 rpcz_store.cc:276] 0619 19:54:00.002708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.002903 (+ 195us) service_pool.cc:224] Handling call
0619 19:54:01.239412 (+1236509us) ts_tablet_manager.cc:1151] Deleting tablet 68788824224b426bb433b87763073bae
0619 19:54:01.239424 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.239531 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1228794}
W20260619 19:54:01.248579 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 68788824224b426bb433b87763073bae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68788824224b426bb433b87763073bae already in progress: creating tablet
I20260619 19:54:01.249298 1200 raft_consensus.cc:740] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.249866 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 66) took 1242 ms. Trace:
I20260619 19:54:01.250620 832 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:54:01.251573 1201 tablet_bootstrap.cc:654] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:01.252664 529 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c2f9e5a4dedd4c81901cb99fecff0919 consensus state has no leader
I20260619 19:54:01.249985 2026 rpcz_store.cc:276] 0619 19:54:00.007520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.007720 (+ 200us) service_pool.cc:224] Handling call
0619 19:54:01.249683 (+1241963us) ts_tablet_manager.cc:1151] Deleting tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
0619 19:54:01.249694 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.249804 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234091}
I20260619 19:54:01.254388 2026 tablet_replica.cc:333] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:01.254601 2026 raft_consensus.cc:2243] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.254796 2026 raft_consensus.cc:2272] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.254858 1200 consensus_queue.cc:260] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.255332 2026 ts_tablet_manager.cc:1916] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.255384 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27342783a5641d7a324e71183269308" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:01.256351 1820 hybrid_clock.cc:648] HybridClock initialized: now 1781898841256218 us; error 123 us; skew 500 ppm
I20260619 19:54:01.256728 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 6baa466f30c2460697217f526fc4617f with delete_type TABLET_DATA_DELETED (replaced by tablet 33cfbae501de432cbcb34d2a6365f806) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.257093 1820 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260619 19:54:01.257687 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d already in progress: creating tablet
I20260619 19:54:01.258826 890 tablet_service.cc:1558] Processing DeleteTablet for tablet a690a4fdf60947acb271abe588d4b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.259955 890 tablet_service.cc:1558] Processing DeleteTablet for tablet a868706c23e948e5ba3320ceb4a19cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.261178 1973 log.cc:1199] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/cbec819571854db8a46daae15b9127bd
I20260619 19:54:01.261523 757 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.262914 1973 ts_tablet_manager.cc:1950] T cbec819571854db8a46daae15b9127bd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.263090 890 tablet_service.cc:1558] Processing DeleteTablet for tablet cbec819571854db8a46daae15b9127bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.264645 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 39) took 2136 ms. Trace:
I20260619 19:54:01.265825 757 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.267378 1973 rpcz_store.cc:276] 0619 19:53:59.128326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.128401 (+ 75us) service_pool.cc:224] Handling call
0619 19:54:01.086237 (+1957836us) ts_tablet_manager.cc:1151] Deleting tablet cbec819571854db8a46daae15b9127bd
0619 19:54:01.086246 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.182348 (+ 96102us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.221964 (+ 39616us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.264596 (+ 42632us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3588,"tablet-delete.queue_time_us":1957328}
I20260619 19:54:01.269225 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.270179 1973 tablet_replica.cc:333] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.270545 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet cbec819571854db8a46daae15b9127bd (table default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]) successfully deleted
I20260619 19:54:01.271533 918 raft_consensus.cc:2468] T d27342783a5641d7a324e71183269308 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:01.271821 1973 raft_consensus.cc:2243] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:01.273061 1200 ts_tablet_manager.cc:1434] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260619 19:54:01.274130 1973 raft_consensus.cc:2272] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.275230 1973 ts_tablet_manager.cc:1916] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.278996 2173 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:01.280201 996 leader_election.cc:343] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.281980 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:01.283746 2124 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:01.286146 2141 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:01.286612 1200 tablet_bootstrap.cc:492] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:01.287106 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:01.290959 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 198bde101e7b4eeeb8de58aebe208bb4 has no consensus state
W20260619 19:54:01.291242 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fb6712fc0994154aa5022ec16cec1ae consensus state has no leader
W20260619 19:54:01.292541 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02c5f9405d6a4a16bd49697001c201e1 has no consensus state
I20260619 19:54:01.294018 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1491bf4decd34cceb722de0e75008614"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.294690 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1491bf4decd34cceb722de0e75008614 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.295806 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4987fd27300444088d5b028d1285b62b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.296442 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4987fd27300444088d5b028d1285b62b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.297775 1973 ts_tablet_manager.cc:1929] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.297958 1973 log.cc:1199] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/2d64ccbb2f2840f4ac51cf8556da4a2c
I20260619 19:54:01.298514 1973 ts_tablet_manager.cc:1950] T 2d64ccbb2f2840f4ac51cf8556da4a2c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.298696 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4c7cb900600a4a3187137ce27bd3a8cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:01.302635 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 41) took 2171 ms. Trace:
I20260619 19:54:01.303045 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5916dd401c144d7f9c23431c595e9ba8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.303817 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5916dd401c144d7f9c23431c595e9ba8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.304067 1973 rpcz_store.cc:276] 0619 19:53:59.131306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.131374 (+ 68us) service_pool.cc:224] Handling call
0619 19:54:01.269695 (+2138321us) ts_tablet_manager.cc:1151] Deleting tablet 2d64ccbb2f2840f4ac51cf8556da4a2c
0619 19:54:01.269707 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.290439 (+ 20732us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.297668 (+ 7229us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.302536 (+ 4868us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2136454}
I20260619 19:54:01.304756 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 2d64ccbb2f2840f4ac51cf8556da4a2c (table default.Table_e4f08490c62f47249298bc6684dd80bb [id=7018bca0519c45289b5131c3e4484774]) successfully deleted
I20260619 19:54:01.303207 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d23a54ae1ba943d39d8bee350a57ff40" } modify_external_catalogs: true
I20260619 19:54:01.305511 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d23a54ae1ba943d39d8bee350a57ff40" } modify_external_catalogs: true
I20260619 19:54:01.305711 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.306480 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 42) took 2169 ms. Trace:
W20260619 19:54:01.308398 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c7cb900600a4a3187137ce27bd3a8cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.306592 1973 rpcz_store.cc:276] 0619 19:53:59.136944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.137001 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:01.306042 (+2169041us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:54:01.306056 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.306395 (+ 339us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2165878}
W20260619 19:54:01.309629 996 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.309763 1973 tablet_replica.cc:333] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.310060 2021 consensus_queue.cc:1048] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:01.310268 1973 raft_consensus.cc:2243] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.310672 2021 consensus_queue.cc:1048] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:01.310809 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f011ebcb383f4f73a1766d0990ac9197"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:01.310775 1973 raft_consensus.cc:2272] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.311080 2021 consensus_queue.cc:1048] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:01.311451 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d651c8fb8ff244a5a09dd9ea593ecb14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d651c8fb8ff244a5a09dd9ea593ecb14 already in progress: creating tablet
W20260619 19:54:01.311718 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f011ebcb383f4f73a1766d0990ac9197 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.312188 1973 ts_tablet_manager.cc:1916] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.274740 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.323850 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f25c0378a6f4e9ea1a62d98f27778ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.324617 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.324939 890 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.275490 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.281576 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:01.325459 923 raft_consensus.cc:2468] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:01.294692 2122 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:01.298417 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 40e1b92467a44737bfabb6ec1c924ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.299559 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 68746ca7888e4af891238f79dcfdde10 with delete_type TABLET_DATA_DELETED (replaced by tablet 3091dd1a525a4f779c68b8b77afa5b26) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.299620 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 74949d09466f42e2852389e10192989d with delete_type TABLET_DATA_DELETED (replaced by tablet 5482cf46c91d426484938c387b785d61) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.299701 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.299710 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.299716 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.307715 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.308790 901 tablet_service.cc:1558] Processing DeleteTablet for tablet d29506dab4c84850ad79b8b7a0340987 with delete_type TABLET_DATA_DELETED (replaced by tablet 991c877feeae43c580d9471c25c4424c) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.312194 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.313382 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be5cda43d0b4719a82f33a03e2261d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.313759 902 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.314392 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.314716 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.315099 887 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.315457 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.316123 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.316576 888 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.316921 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.329232 1208 tablet_bootstrap.cc:492] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.329452 1208 ts_tablet_manager.cc:1403] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.011s
I20260619 19:54:01.329519 996 leader_election.cc:304] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:01.329934 996 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:01.330387 1208 raft_consensus.cc:359] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.330607 2117 raft_consensus.cc:2804] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:01.330616 1208 raft_consensus.cc:385] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.330722 1208 raft_consensus.cc:740] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.330749 2035 raft_consensus.cc:2804] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:01.330854 2035 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:01.330956 2035 raft_consensus.cc:3060] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.330968 1208 consensus_queue.cc:260] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.332269 1208 ts_tablet_manager.cc:1434] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 19:54:01.332278 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.332600 1208 tablet_bootstrap.cc:492] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.332867 903 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.333210 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 37393d7c16594032bf2a69abb0ab5931 with delete_type TABLET_DATA_DELETED (replaced by tablet a75baa585102481fa0ea01e87e394e32) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.333629 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 7e3a8c4b651545c9ad620be798c63b53) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.334582 1208 tablet_bootstrap.cc:654] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.335597 2035 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.336351 2035 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.336894 2158 raft_consensus.cc:493] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:01.328927 529 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 195) took 1079 ms (client timeout 1000 ms). Trace:
I20260619 19:54:01.337049 2158 raft_consensus.cc:515] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:01.337392 529 rpcz_store.cc:269] 0619 19:54:00.249457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.251640 (+ 2183us) service_pool.cc:224] Handling call
0619 19:54:01.328841 (+1077201us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":133}
I20260619 19:54:01.330758 2117 raft_consensus.cc:697] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:01.338913 2158 leader_election.cc:290] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.338961 2117 consensus_queue.cc:237] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.342002 1973 ts_tablet_manager.cc:1929] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.342450 1973 log.cc:1199] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b65f88b43b4e45c481aa7d43ef59fe7a
I20260619 19:54:01.343045 1973 ts_tablet_manager.cc:1950] T b65f88b43b4e45c481aa7d43ef59fe7a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.344094 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 40) took 2214 ms. Trace:
I20260619 19:54:01.344321 1973 rpcz_store.cc:276] 0619 19:53:59.130188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.130276 (+ 88us) service_pool.cc:224] Handling call
0619 19:54:01.309669 (+2179393us) ts_tablet_manager.cc:1151] Deleting tablet b65f88b43b4e45c481aa7d43ef59fe7a
0619 19:54:01.309681 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.316424 (+ 6743us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.341877 (+ 25453us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.344051 (+ 2174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2169450}
I20260619 19:54:01.344859 1973 tablet_replica.cc:333] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.345194 1973 raft_consensus.cc:2243] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.345471 1973 raft_consensus.cc:2272] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.346196 1973 ts_tablet_manager.cc:1916] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.349323 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b65f88b43b4e45c481aa7d43ef59fe7a (table default.Table_768b98dd2476482fafa6579ecca2a1b6 [id=f2b1233f36c74ac4837caefb72162656]) successfully deleted
I20260619 19:54:01.350220 1200 tablet_bootstrap.cc:654] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.351485 1201 tablet_bootstrap.cc:492] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:01.351661 1201 ts_tablet_manager.cc:1403] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.197s user 0.002s sys 0.002s
I20260619 19:54:01.352473 1201 raft_consensus.cc:359] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.353149 1201 raft_consensus.cc:385] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.353233 1201 raft_consensus.cc:740] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.353504 1201 consensus_queue.cc:260] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.354408 1201 ts_tablet_manager.cc:1434] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 19:54:01.354421 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd210e843db4f58a976af5c28dabc9c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:01.354739 1201 tablet_bootstrap.cc:492] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:01.354758 1058 raft_consensus.cc:2468] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:01.357283 720 leader_election.cc:304] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:01.358697 2158 raft_consensus.cc:2804] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:01.358862 2158 raft_consensus.cc:493] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:01.358974 2158 raft_consensus.cc:3060] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.355075 1973 ts_tablet_manager.cc:1929] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.361629 1973 log.cc:1199] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/6ef20e35c612400bbbf1c707a36ced8c
I20260619 19:54:01.362428 1973 ts_tablet_manager.cc:1950] T 6ef20e35c612400bbbf1c707a36ced8c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.362623 2158 raft_consensus.cc:515] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.363056 1994 ts_tablet_manager.cc:1929] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.363222 1994 log.cc:1199] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:01.363315 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 44) took 2203 ms. Trace:
I20260619 19:54:01.363632 1994 ts_tablet_manager.cc:1950] T ecbe466eee2f43359181a1d26d6e761e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:01.364529 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 44) took 2053 ms. Trace:
W20260619 19:54:01.364677 524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:53243 (request call id 194) took 1592 ms (client timeout 1000 ms). Trace:
I20260619 19:54:01.364351 2158 leader_election.cc:290] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.364698 1994 rpcz_store.cc:276] 0619 19:53:59.310964 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.311004 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:00.966471 (+1655467us) ts_tablet_manager.cc:1151] Deleting tablet ecbe466eee2f43359181a1d26d6e761e
0619 19:54:00.966482 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.165312 (+198830us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.362958 (+197646us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.364465 (+ 1507us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655250}
I20260619 19:54:01.364887 1973 rpcz_store.cc:276] 0619 19:53:59.160121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.160956 (+ 835us) service_pool.cc:224] Handling call
0619 19:54:01.344783 (+2183827us) ts_tablet_manager.cc:1151] Deleting tablet 6ef20e35c612400bbbf1c707a36ced8c
0619 19:54:01.344793 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.351286 (+ 6493us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.355002 (+ 3716us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.363244 (+ 8242us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2168289}
W20260619 19:54:01.364883 524 rpcz_store.cc:269] 0619 19:53:59.772203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.782909 (+ 10706us) service_pool.cc:224] Handling call
0619 19:54:01.364631 (+1581722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:00.260718 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:00.260834 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:00.260842 (+ 8us) write_op.cc:435] Acquired schema lock
0619 19:54:00.260844 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:00.260938 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:00.260948 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:00.260952 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:00.261014 (+ 62us) tablet.cc:701] Row locks acquired
0619 19:54:00.261016 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:00.261049 (+ 33us) write_op.cc:270] Start()
0619 19:54:00.261084 (+ 35us) write_op.cc:276] Timestamp: P: 1781898840261028 usec, L: 0
0619 19:54:00.261087 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:00.261274 (+ 187us) log.cc:844] Serialized 533 byte log entry
0619 19:54:00.271802 (+ 10528us) op_driver.cc:464] REPLICATION: finished
0619 19:54:00.272018 (+ 216us) write_op.cc:301] APPLY: starting
0619 19:54:00.272033 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:00.272076 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:00.272109 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:00.272163 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:00.272204 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:00.272212 (+ 8us) write_op.cc:312] APPLY: finished
0619 19:54:00.272285 (+ 73us) log.cc:844] Serialized 23 byte log entry
0619 19:54:00.272362 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:00.272381 (+ 19us) write_op.cc:454] Released schema lock
0619 19:54:00.272388 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:00.272461 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:00.272465 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17121,"reported_tablets":115,"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":436,"apply.run_wall_time_us":435,"num_ops":1,"prepare.queue_time_us":452,"prepare.run_cpu_time_us":642,"prepare.run_wall_time_us":643,"raft.queue_time_us":99,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":10683}]]}
I20260619 19:54:01.365546 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet ecbe466eee2f43359181a1d26d6e761e (table default.Table_2a0e967a9ab24a16b767629e2c9c6529 [id=f9c9368e00a44a3cba3399486f27f016]) successfully deleted
I20260619 19:54:01.365685 1973 tablet_replica.cc:333] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.365785 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd210e843db4f58a976af5c28dabc9c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:01.365897 1973 raft_consensus.cc:2243] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.366020 1058 raft_consensus.cc:3060] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.366086 1973 raft_consensus.cc:2272] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.366642 1973 ts_tablet_manager.cc:1916] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.366894 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 12258d3bcc714f34857d7362c49ee787 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:01.368534 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 6ef20e35c612400bbbf1c707a36ced8c (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]) successfully deleted
I20260619 19:54:01.374001 1973 ts_tablet_manager.cc:1929] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.374159 1973 log.cc:1199] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/12258d3bcc714f34857d7362c49ee787
I20260619 19:54:01.374475 2158 raft_consensus.cc:493] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.374650 1973 ts_tablet_manager.cc:1950] T 12258d3bcc714f34857d7362c49ee787 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.375705 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd210e843db4f58a976af5c28dabc9c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:01.375959 918 raft_consensus.cc:2468] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
W20260619 19:54:01.377668 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 47326.7us
I20260619 19:54:01.382261 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd210e843db4f58a976af5c28dabc9c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:01.382547 918 raft_consensus.cc:3060] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.374709 2158 raft_consensus.cc:515] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.385689 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6fd43f965fb445cfbc8018f1ed9adfaf" } modify_external_catalogs: true
I20260619 19:54:01.385897 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6fd43f965fb445cfbc8018f1ed9adfaf" } modify_external_catalogs: true
I20260619 19:54:01.385931 2158 leader_election.cc:290] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.386196 918 raft_consensus.cc:2468] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:01.386854 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 43) took 2227 ms. Trace:
I20260619 19:54:01.387158 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:01.387872 1973 rpcz_store.cc:276] 0619 19:53:59.159375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.159432 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:01.365573 (+2206141us) ts_tablet_manager.cc:1151] Deleting tablet 12258d3bcc714f34857d7362c49ee787
0619 19:54:01.365586 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.369906 (+ 4320us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.373897 (+ 3991us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.386819 (+ 12922us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2184238}
I20260619 19:54:01.388525 1973 tablet_replica.cc:333] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.388756 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 12258d3bcc714f34857d7362c49ee787 (table default.Table_9a70fe99a1294387a1ac81cbd29c2647 [id=1bb7a7cd9bca4a98b3138955924f8eac]) successfully deleted
I20260619 19:54:01.389015 1973 raft_consensus.cc:2243] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:01.389673 719 leader_election.cc:304] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:01.389779 1973 raft_consensus.cc:2272] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.390101 2158 raft_consensus.cc:2804] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:01.390493 2158 raft_consensus.cc:697] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:01.390815 2158 consensus_queue.cc:237] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.392670 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 (DEFAULT_TABLE table=default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.393242 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ddb8412ad145dd85916bf5d756a9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.396306 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 52d01d2d98b64226b619255500498ffe (DEFAULT_TABLE table=default.Table_b8daa904a52e492d9f9942b151daca0f [id=fd2aa005a84e43fcb05b3ddc511c1961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.396870 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d01d2d98b64226b619255500498ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.399067 1973 ts_tablet_manager.cc:1916] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.399439 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 913f4e0c705a494e8f9514f34579ea69 (DEFAULT_TABLE table=default.Table_4f5e69e26c3542fbaa09da0518fd84c4 [id=fc59685337bc433b8f2dc9ec943b5644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.399825 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913f4e0c705a494e8f9514f34579ea69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.403453 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be (DEFAULT_TABLE table=default.Table_d2fb548e74874865afb85ec54f4c2999 [id=3e15f4bd79fd433590d102806c85fed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.403848 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2939b8aa0d44ad2a05a933db4ea64be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.403914 1058 raft_consensus.cc:2468] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:01.405290 2026 ts_tablet_manager.cc:1929] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:01.405457 2026 log.cc:1199] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/bb56767231db42bebb75a45b5d512de3
I20260619 19:54:01.405849 2026 ts_tablet_manager.cc:1950] T bb56767231db42bebb75a45b5d512de3 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:01.406771 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 68) took 1143 ms. Trace:
I20260619 19:54:01.406927 2026 rpcz_store.cc:276] 0619 19:54:00.263032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.265676 (+ 2644us) service_pool.cc:224] Handling call
0619 19:54:01.254295 (+988619us) ts_tablet_manager.cc:1151] Deleting tablet bb56767231db42bebb75a45b5d512de3
0619 19:54:01.254304 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.290429 (+ 36125us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.405164 (+114735us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.406719 (+ 1555us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":973587}
I20260619 19:54:01.407620 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 9c663c06d10e43958ab42dacc11cb486 (DEFAULT_TABLE table=default.Table_1d2d8281aa5c41a6870b4654f9ac2811 [id=f0765e89bb4c4b07bc228650250a6894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.408052 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c663c06d10e43958ab42dacc11cb486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.411787 1820 webserver.cc:533] Webserver started at http://127.0.105.188:42109/ using document root <none> and password file <none>
I20260619 19:54:01.417501 1973 ts_tablet_manager.cc:1929] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.420234 1973 log.cc:1199] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/620f3a56e57e49b7b520012857e71187
I20260619 19:54:01.421128 1973 ts_tablet_manager.cc:1950] T 620f3a56e57e49b7b520012857e71187 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.424542 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 46) took 2242 ms. Trace:
I20260619 19:54:01.425379 1973 rpcz_store.cc:276] 0619 19:53:59.180699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.181157 (+ 458us) service_pool.cc:224] Handling call
0619 19:54:01.388448 (+2207291us) ts_tablet_manager.cc:1151] Deleting tablet 620f3a56e57e49b7b520012857e71187
0619 19:54:01.388460 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.405091 (+ 16631us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.417426 (+ 12335us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.422843 (+ 5417us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2204729}
I20260619 19:54:01.426401 1973 tablet_replica.cc:333] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.427182 1973 raft_consensus.cc:2243] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.428027 1973 raft_consensus.cc:2272] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.429104 1973 ts_tablet_manager.cc:1916] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.430130 1994 tablet_replica.cc:333] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:01.430964 1994 raft_consensus.cc:2243] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:01.432184 1994 pending_rounds.cc:70] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:01.432482 1994 pending_rounds.cc:77] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657652563595264 op_type: NO_OP noop_request { }
I20260619 19:54:01.434325 759 tablet_service.cc:1511] Processing CreateTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 (DEFAULT_TABLE table=default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.434763 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ddb8412ad145dd85916bf5d756a9f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.436314 1820 fs_manager.cc:362] Metadata directory not provided
I20260619 19:54:01.436530 1820 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 19:54:01.438690 1973 ts_tablet_manager.cc:1929] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.438830 1973 log.cc:1199] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/2a3fa43017fa4c278111c29d0d22f7da
I20260619 19:54:01.441150 2026 tablet_replica.cc:333] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:01.442749 2026 raft_consensus.cc:2243] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.443009 2026 raft_consensus.cc:2272] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.444168 2026 ts_tablet_manager.cc:1916] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.446482 1201 tablet_bootstrap.cc:654] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.448611 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:01.449118 918 raft_consensus.cc:2393] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:01.457620 719 leader_election.cc:304] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:01.458195 2018 raft_consensus.cc:3060] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.459823 1973 ts_tablet_manager.cc:1950] T 2a3fa43017fa4c278111c29d0d22f7da P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.461508 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 47) took 2280 ms. Trace:
I20260619 19:54:01.469383 1994 raft_consensus.cc:2889] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:01.471820 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 620f3a56e57e49b7b520012857e71187 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]) successfully deleted
I20260619 19:54:01.487170 2021 consensus_queue.cc:1048] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260619 19:54:01.462591 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:01.463591 748 tablet_service.cc:1511] Processing CreateTablet for tablet 913f4e0c705a494e8f9514f34579ea69 (DEFAULT_TABLE table=default.Table_4f5e69e26c3542fbaa09da0518fd84c4 [id=fc59685337bc433b8f2dc9ec943b5644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.488026 1973 rpcz_store.cc:276] 0619 19:53:59.180871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.181059 (+ 188us) service_pool.cc:224] Handling call
0619 19:54:01.426300 (+2245241us) ts_tablet_manager.cc:1151] Deleting tablet 2a3fa43017fa4c278111c29d0d22f7da
0619 19:54:01.426313 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.435417 (+ 9104us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.438598 (+ 3181us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.461460 (+ 22862us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2242418}
I20260619 19:54:01.488656 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913f4e0c705a494e8f9514f34579ea69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:01.491411 996 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.463757 759 tablet_service.cc:1511] Processing CreateTablet for tablet 52d01d2d98b64226b619255500498ffe (DEFAULT_TABLE table=default.Table_b8daa904a52e492d9f9942b151daca0f [id=fd2aa005a84e43fcb05b3ddc511c1961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.491894 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d01d2d98b64226b619255500498ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.464154 757 tablet_service.cc:1511] Processing CreateTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be (DEFAULT_TABLE table=default.Table_d2fb548e74874865afb85ec54f4c2999 [id=3e15f4bd79fd433590d102806c85fed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.495558 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2939b8aa0d44ad2a05a933db4ea64be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.470561 2018 raft_consensus.cc:2749] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:01.500159 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 83452ce6b5b3479b98ea312db05dc651 consensus state has no leader
I20260619 19:54:01.500242 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dac857d85b7e4b748ff854769df04686" } modify_external_catalogs: true
I20260619 19:54:01.472913 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9c663c06d10e43958ab42dacc11cb486 (DEFAULT_TABLE table=default.Table_1d2d8281aa5c41a6870b4654f9ac2811 [id=f0765e89bb4c4b07bc228650250a6894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.500437 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dac857d85b7e4b748ff854769df04686" } modify_external_catalogs: true
I20260619 19:54:01.500741 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c663c06d10e43958ab42dacc11cb486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.501674 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9b78d8a4d8dd42859be248b698257e2c
I20260619 19:54:01.502374 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cfd604dcc65a4500b9c0785d9ae2a562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.502938 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfd604dcc65a4500b9c0785d9ae2a562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.487886 1208 tablet_bootstrap.cc:492] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.489984 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet bb56767231db42bebb75a45b5d512de3 (table default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]) successfully deleted
I20260619 19:54:01.503537 1208 ts_tablet_manager.cc:1403] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.171s user 0.015s sys 0.030s
I20260619 19:54:01.504082 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b78d8a4d8dd42859be248b698257e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.504565 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b78d8a4d8dd42859be248b698257e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:01.505031 1208 raft_consensus.cc:359] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.505273 1208 raft_consensus.cc:385] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.505347 1208 raft_consensus.cc:740] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.505609 1208 consensus_queue.cc:260] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.505708 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 2a3fa43017fa4c278111c29d0d22f7da (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]) successfully deleted
I20260619 19:54:01.506111 1208 ts_tablet_manager.cc:1434] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:01.506450 1208 tablet_bootstrap.cc:492] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.508750 1208 tablet_bootstrap.cc:654] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.510221 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1755ba072da64e428c5dece315b1543b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.510795 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1755ba072da64e428c5dece315b1543b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.512948 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6920393f5922435bbf9c6a6a1a16dff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.513509 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6920393f5922435bbf9c6a6a1a16dff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.515637 528 master_service.cc:960] ReplaceTablet: received request to replace tablet ba0cd4cd0661415d8b2b2339363e7aca from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:01.519236 531 catalog_manager.cc:5696] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:01.520102 1208 tablet_bootstrap.cc:492] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.520221 1208 ts_tablet_manager.cc:1403] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260619 19:54:01.519827 531 catalog_manager.cc:5696] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:54:01.520798 1208 raft_consensus.cc:359] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.521016 1208 raft_consensus.cc:385] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.520798 531 catalog_manager.cc:5696] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:01.521104 1208 raft_consensus.cc:740] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.521219 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202]). Expected version 2 got 0
I20260619 19:54:01.521359 1208 consensus_queue.cc:260] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.521924 1208 ts_tablet_manager.cc:1434] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:01.522243 1208 tablet_bootstrap.cc:492] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.527199 1208 tablet_bootstrap.cc:654] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.534077 2021 raft_consensus.cc:493] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.534775 2021 raft_consensus.cc:515] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.538460 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:01.539240 996 leader_election.cc:343] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.539640 2021 leader_election.cc:290] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.552430 1208 tablet_bootstrap.cc:492] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.552626 1208 ts_tablet_manager.cc:1403] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.007s
I20260619 19:54:01.553511 1208 raft_consensus.cc:359] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.553725 1208 raft_consensus.cc:385] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.553813 1208 raft_consensus.cc:740] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.554067 1208 consensus_queue.cc:260] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.554602 1208 ts_tablet_manager.cc:1434] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:01.554687 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_91c7ddb413964d86bfad6243e684a682" } new_table_name: "default.Table_a3301c06d179435588fe6dbab182fe11" modify_external_catalogs: true
I20260619 19:54:01.554944 1208 tablet_bootstrap.cc:492] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.556705 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4c7e1ad3890d4f9dbc9f41258e5d20b9" } new_table_name: "default.Table_2d0ef958689042fdaa6588675b99b3ec" modify_external_catalogs: true
I20260619 19:54:01.557148 1208 tablet_bootstrap.cc:654] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.560192 1200 tablet_bootstrap.cc:492] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:01.560400 1200 ts_tablet_manager.cc:1403] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.287s user 0.004s sys 0.001s
I20260619 19:54:01.561368 1200 raft_consensus.cc:359] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.570736 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5930f363db7a44459de1c9115c4051b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.571642 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5930f363db7a44459de1c9115c4051b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.573211 1200 raft_consensus.cc:385] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.573380 1200 raft_consensus.cc:740] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.583928 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ba0cd4cd0661415d8b2b2339363e7aca
I20260619 19:54:01.584702 528 catalog_manager.cc:6784] ReplaceTablet: tablet ba0cd4cd0661415d8b2b2339363e7aca deleted and replaced by tablet 910cf00e57404f1097800e84a2070b26
I20260619 19:54:01.587386 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca with delete_type TABLET_DATA_DELETED (replaced by tablet 910cf00e57404f1097800e84a2070b26) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:01.591617 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9b78d8a4d8dd42859be248b698257e2c (DEFAULT_TABLE table=default.Table_6fd43f965fb445cfbc8018f1ed9adfaf [id=86b56cb65cf741ae8607f903894cc121]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.592547 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b78d8a4d8dd42859be248b698257e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.598910 1994 raft_consensus.cc:2272] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.599900 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7ae6ef4dc2a74b9babb2925078822313" } modify_external_catalogs: true
I20260619 19:54:01.600524 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7ae6ef4dc2a74b9babb2925078822313" } modify_external_catalogs: true
I20260619 19:54:01.601303 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 9b78d8a4d8dd42859be248b698257e2c (DEFAULT_TABLE table=default.Table_6fd43f965fb445cfbc8018f1ed9adfaf [id=86b56cb65cf741ae8607f903894cc121]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.606597 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a (DEFAULT_TABLE table=default.Table_599b6bc9158b48d4848732a5c03bc7d1 [id=a8cf65f08efa458883756790fbdd055d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.615501 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b78d8a4d8dd42859be248b698257e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.622351 1973 tablet_replica.cc:333] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.622751 1973 raft_consensus.cc:2243] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.622969 1973 raft_consensus.cc:2272] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.627312 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f7122fa5f94eeaa3b99cae107d8c9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:01.635286 858 consensus_peers.cc:597] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33935217c1f44ce0ad5b8610d368f2eb. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:01.637450 903 tablet_service.cc:1511] Processing CreateTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 (DEFAULT_TABLE table=default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.640784 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca with delete_type TABLET_DATA_DELETED (replaced by tablet 910cf00e57404f1097800e84a2070b26) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:01.645604 888 tablet_service.cc:1511] Processing CreateTablet for tablet 52d01d2d98b64226b619255500498ffe (DEFAULT_TABLE table=default.Table_b8daa904a52e492d9f9942b151daca0f [id=fd2aa005a84e43fcb05b3ddc511c1961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.647163 885 tablet_service.cc:1511] Processing CreateTablet for tablet 913f4e0c705a494e8f9514f34579ea69 (DEFAULT_TABLE table=default.Table_4f5e69e26c3542fbaa09da0518fd84c4 [id=fc59685337bc433b8f2dc9ec943b5644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.647351 1994 ts_tablet_manager.cc:1916] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.649621 757 tablet_service.cc:1511] Processing CreateTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a (DEFAULT_TABLE table=default.Table_599b6bc9158b48d4848732a5c03bc7d1 [id=a8cf65f08efa458883756790fbdd055d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.650110 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f7122fa5f94eeaa3b99cae107d8c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.650719 892 tablet_service.cc:1511] Processing CreateTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be (DEFAULT_TABLE table=default.Table_d2fb548e74874865afb85ec54f4c2999 [id=3e15f4bd79fd433590d102806c85fed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.650902 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:01.652499 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0991105460f749e1854d512304ff56cd (DEFAULT_TABLE table=default.Table_a666e5f020f94fbbbb4aeb87d9f180fe [id=0880c684a7f344c2bb195bdc7d880080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.652878 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0991105460f749e1854d512304ff56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.649633 1973 ts_tablet_manager.cc:1916] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.655751 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 0991105460f749e1854d512304ff56cd (DEFAULT_TABLE table=default.Table_a666e5f020f94fbbbb4aeb87d9f180fe [id=0880c684a7f344c2bb195bdc7d880080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.656605 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0991105460f749e1854d512304ff56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.666801 1973 ts_tablet_manager.cc:1929] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.671823 2006 raft_consensus.cc:493] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.672355 893 tablet_service.cc:1511] Processing CreateTablet for tablet 9c663c06d10e43958ab42dacc11cb486 (DEFAULT_TABLE table=default.Table_1d2d8281aa5c41a6870b4654f9ac2811 [id=f0765e89bb4c4b07bc228650250a6894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.672948 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9b78d8a4d8dd42859be248b698257e2c (DEFAULT_TABLE table=default.Table_6fd43f965fb445cfbc8018f1ed9adfaf [id=86b56cb65cf741ae8607f903894cc121]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.674002 884 tablet_service.cc:1511] Processing CreateTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a (DEFAULT_TABLE table=default.Table_599b6bc9158b48d4848732a5c03bc7d1 [id=a8cf65f08efa458883756790fbdd055d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:01.676707 859 consensus_peers.cc:597] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a3fa43017fa4c278111c29d0d22f7da. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:01.680555 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ddb8412ad145dd85916bf5d756a9f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:01.683182 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84dbba24094d4630be45b7febe8cb29e consensus state has no leader
I20260619 19:54:01.683573 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c663c06d10e43958ab42dacc11cb486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.683657 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_88bb3e27be5d41d19ecce9b1881cdb1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:01.684258 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88bb3e27be5d41d19ecce9b1881cdb1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:01.686019 918 raft_consensus.cc:3060] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.686446 2006 raft_consensus.cc:515] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.687400 526 master_service.cc:960] ReplaceTablet: received request to replace tablet a690a4fdf60947acb271abe588d4b5c0 from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:01.688876 719 consensus_peers.cc:597] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:01.690487 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d01d2d98b64226b619255500498ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.690428 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5d100ac0078e402e8b7ad4b65c4de9f5" } new_table_name: "default.Table_94d5b0a1504044b7a1934b5c726b29d4" modify_external_catalogs: true
I20260619 19:54:01.690977 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b78d8a4d8dd42859be248b698257e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.691270 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3091dd1a525a4f779c68b8b77afa5b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:01.694133 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca with delete_type TABLET_DATA_DELETED (replaced by tablet 910cf00e57404f1097800e84a2070b26) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:01.694892 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913f4e0c705a494e8f9514f34579ea69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:01.696141 858 leader_election.cc:343] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.696717 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b78d8a4d8dd42859be248b698257e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.701459 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f7122fa5f94eeaa3b99cae107d8c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.708230 1973 log.cc:1199] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:54:01.708781 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 84dbba24094d4630be45b7febe8cb29e (DEFAULT_TABLE table=default.Table_a3301c06d179435588fe6dbab182fe11 [id=40a213ef1b0f46da8419637e4d118218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.709206 1973 ts_tablet_manager.cc:1950] T 5ea9f17d5e75499a8433fc9a3043a88e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.709832 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dbba24094d4630be45b7febe8cb29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.710145 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 48) took 2529 ms. Trace:
I20260619 19:54:01.710254 1973 rpcz_store.cc:276] 0619 19:53:59.180979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.181089 (+ 110us) service_pool.cc:224] Handling call
0619 19:54:01.488350 (+2307261us) ts_tablet_manager.cc:1151] Deleting tablet 5ea9f17d5e75499a8433fc9a3043a88e
0619 19:54:01.622230 (+133880us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.659307 (+ 37077us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.666718 (+ 7411us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.710098 (+ 43380us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2302753}
I20260619 19:54:01.710665 1973 tablet_replica.cc:333] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.710837 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 5ea9f17d5e75499a8433fc9a3043a88e (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]) successfully deleted
I20260619 19:54:01.710884 1973 raft_consensus.cc:2243] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.712513 747 tablet_service.cc:1511] Processing CreateTablet for tablet 84dbba24094d4630be45b7febe8cb29e (DEFAULT_TABLE table=default.Table_a3301c06d179435588fe6dbab182fe11 [id=40a213ef1b0f46da8419637e4d118218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.713029 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dbba24094d4630be45b7febe8cb29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.713380 2006 leader_election.cc:290] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.715749 918 raft_consensus.cc:2468] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:01.722834 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:01.723099 920 raft_consensus.cc:2468] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:01.723691 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0991105460f749e1854d512304ff56cd (DEFAULT_TABLE table=default.Table_a666e5f020f94fbbbb4aeb87d9f180fe [id=0880c684a7f344c2bb195bdc7d880080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.725520 2026 ts_tablet_manager.cc:1929] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:01.725943 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2939b8aa0d44ad2a05a933db4ea64be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.728161 1200 consensus_queue.cc:260] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.729744 2021 raft_consensus.cc:493] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.729918 2021 raft_consensus.cc:515] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.730893 2021 leader_election.cc:290] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.733477 2026 log.cc:1199] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/58e9d98ec1084b2ea9c087238686ed38
I20260619 19:54:01.734671 1200 ts_tablet_manager.cc:1434] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.174s user 0.002s sys 0.001s
I20260619 19:54:01.736128 1031 tablet_service.cc:1511] Processing CreateTablet for tablet deba56eb121e4aa6b8ad7b13951723aa (DEFAULT_TABLE table=default.Table_e63e4a6a46584565bd00b07e52fa0580 [id=2738114efd1f43d4a7f797f9b12f7398]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.736840 996 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:01.738271 996 leader_election.cc:304] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:01.739025 2035 raft_consensus.cc:2804] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:01.739574 2026 ts_tablet_manager.cc:1950] T 58e9d98ec1084b2ea9c087238686ed38 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:01.739604 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb56767231db42bebb75a45b5d512de3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:01.739832 781 raft_consensus.cc:2468] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:01.740411 887 tablet_service.cc:1511] Processing CreateTablet for tablet 84dbba24094d4630be45b7febe8cb29e (DEFAULT_TABLE table=default.Table_a3301c06d179435588fe6dbab182fe11 [id=40a213ef1b0f46da8419637e4d118218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.740830 2035 raft_consensus.cc:493] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:01.740954 2035 raft_consensus.cc:3060] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.741412 2114 raft_consensus.cc:2804] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:01.741770 2114 raft_consensus.cc:697] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:01.742247 996 leader_election.cc:304] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:01.742596 2021 raft_consensus.cc:2804] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:01.742740 2021 raft_consensus.cc:493] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:01.742820 2021 raft_consensus.cc:3060] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.746706 747 tablet_service.cc:1511] Processing CreateTablet for tablet deba56eb121e4aa6b8ad7b13951723aa (DEFAULT_TABLE table=default.Table_e63e4a6a46584565bd00b07e52fa0580 [id=2738114efd1f43d4a7f797f9b12f7398]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.747483 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deba56eb121e4aa6b8ad7b13951723aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.754698 1820 fs_manager.cc:714] Time spent opening directory manager: real 0.291s user 0.006s sys 0.016s
I20260619 19:54:01.755736 2035 raft_consensus.cc:515] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.756490 2035 leader_election.cc:290] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.756816 2114 consensus_queue.cc:237] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.761178 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:01.764346 2021 raft_consensus.cc:515] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.747181 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 10e01dc8f8cd43b59fe2bbbfa0a4db4c (DEFAULT_TABLE table=default.Table_732f4648a45146c285ecb6717c1de396 [id=dfe90442fcc9448798e60b0ceef878dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:01.765125 996 leader_election.cc:343] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.772708 2021 leader_election.cc:290] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.773473 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb56767231db42bebb75a45b5d512de3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:01.773721 781 raft_consensus.cc:3060] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.777269 781 raft_consensus.cc:2468] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:01.778230 996 leader_election.cc:304] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:01.779439 2021 raft_consensus.cc:2804] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:01.780330 894 tablet_service.cc:1511] Processing CreateTablet for tablet deba56eb121e4aa6b8ad7b13951723aa (DEFAULT_TABLE table=default.Table_e63e4a6a46584565bd00b07e52fa0580 [id=2738114efd1f43d4a7f797f9b12f7398]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.782872 2021 raft_consensus.cc:697] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:01.783615 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0991105460f749e1854d512304ff56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.784399 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dbba24094d4630be45b7febe8cb29e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.784655 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deba56eb121e4aa6b8ad7b13951723aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.784730 2021 consensus_queue.cc:237] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.789610 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 67) took 1479 ms. Trace:
I20260619 19:54:01.796372 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e01dc8f8cd43b59fe2bbbfa0a4db4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.802132 2026 rpcz_store.cc:276] 0619 19:54:00.260806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.262118 (+ 1312us) service_pool.cc:224] Handling call
0619 19:54:01.441051 (+1178933us) ts_tablet_manager.cc:1151] Deleting tablet 58e9d98ec1084b2ea9c087238686ed38
0619 19:54:01.441067 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.447807 (+ 6740us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.725449 (+277642us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.740387 (+ 14938us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061423}
I20260619 19:54:01.803895 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]) successfully deleted
I20260619 19:54:01.806192 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deba56eb121e4aa6b8ad7b13951723aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.807235 1200 tablet_bootstrap.cc:492] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:01.809213 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3091dd1a525a4f779c68b8b77afa5b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:01.812131 1200 tablet_bootstrap.cc:654] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.815766 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:01.816102 920 raft_consensus.cc:3060] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:01.822837 859 leader_election.cc:343] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.823002 859 leader_election.cc:304] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:01.824286 2026 tablet_replica.cc:333] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:01.824856 2006 raft_consensus.cc:2749] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:01.826177 920 raft_consensus.cc:2468] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:01.829434 2026 raft_consensus.cc:2243] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.830261 2026 raft_consensus.cc:2272] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.830901 2026 ts_tablet_manager.cc:1916] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:01.820333 996 leader_election.cc:343] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: bb56767231db42bebb75a45b5d512de3
W20260619 19:54:01.838214 996 leader_election.cc:343] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: bb56767231db42bebb75a45b5d512de3
I20260619 19:54:01.838557 996 leader_election.cc:304] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:01.840282 2114 raft_consensus.cc:2804] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:01.841154 2114 raft_consensus.cc:697] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:01.842782 2114 consensus_queue.cc:237] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.848603 747 tablet_service.cc:1511] Processing CreateTablet for tablet e244971a6b0b424db6d16d233b32a96e (DEFAULT_TABLE table=default.Table_ed1a0bb02c91457586c92240d93721dd [id=84c367d2b1dd4a25813599ba3e8fd32f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.848865 901 tablet_service.cc:1511] Processing CreateTablet for tablet e244971a6b0b424db6d16d233b32a96e (DEFAULT_TABLE table=default.Table_ed1a0bb02c91457586c92240d93721dd [id=84c367d2b1dd4a25813599ba3e8fd32f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.849086 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244971a6b0b424db6d16d233b32a96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.849287 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244971a6b0b424db6d16d233b32a96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.849390 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 1b18a61d955e4929998b90c6c8fa844e (DEFAULT_TABLE table=default.Table_8e1f6da4a6cf4417813e688ab868bfe5 [id=5d2c41238c64437a970164bc23f8368e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.849757 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b18a61d955e4929998b90c6c8fa844e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.854575 903 tablet_service.cc:1511] Processing CreateTablet for tablet 10e01dc8f8cd43b59fe2bbbfa0a4db4c (DEFAULT_TABLE table=default.Table_732f4648a45146c285ecb6717c1de396 [id=dfe90442fcc9448798e60b0ceef878dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.855123 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e01dc8f8cd43b59fe2bbbfa0a4db4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.856591 899 tablet_service.cc:1511] Processing CreateTablet for tablet 1b18a61d955e4929998b90c6c8fa844e (DEFAULT_TABLE table=default.Table_8e1f6da4a6cf4417813e688ab868bfe5 [id=5d2c41238c64437a970164bc23f8368e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.857198 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b18a61d955e4929998b90c6c8fa844e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.857298 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1b18a61d955e4929998b90c6c8fa844e (DEFAULT_TABLE table=default.Table_8e1f6da4a6cf4417813e688ab868bfe5 [id=5d2c41238c64437a970164bc23f8368e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.857694 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b18a61d955e4929998b90c6c8fa844e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.857797 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e170513f38a14ffcaceccb5ee9052c80" } new_table_name: "default.Table_2e8d0d77f8d24996b929a3d034b24a0c" modify_external_catalogs: true
I20260619 19:54:01.862159 1200 tablet_bootstrap.cc:492] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:01.862314 1200 ts_tablet_manager.cc:1403] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260619 19:54:01.863087 1200 raft_consensus.cc:359] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.863286 1200 raft_consensus.cc:385] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.863358 1200 raft_consensus.cc:740] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.863610 1200 consensus_queue.cc:260] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.867429 1200 ts_tablet_manager.cc:1434] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:54:01.867717 1200 tablet_bootstrap.cc:492] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:01.869366 1200 tablet_bootstrap.cc:654] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:01.872900 858 consensus_peers.cc:597] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:01.711097 1973 raft_consensus.cc:2272] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.875890 1973 ts_tablet_manager.cc:1916] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.888127 1208 tablet_bootstrap.cc:492] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.888365 1208 ts_tablet_manager.cc:1403] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.334s user 0.081s sys 0.169s
I20260619 19:54:01.889343 1208 raft_consensus.cc:359] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.889528 2021 raft_consensus.cc:493] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.889632 1208 raft_consensus.cc:385] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.889719 1208 raft_consensus.cc:740] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.889707 2021 raft_consensus.cc:515] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.890313 2021 leader_election.cc:290] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.891026 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c0ffb4629a46349ccfe473cc20cdfc" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:01.891234 781 raft_consensus.cc:2468] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:01.891422 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c0ffb4629a46349ccfe473cc20cdfc" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:01.891676 1208 consensus_queue.cc:260] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.891827 996 leader_election.cc:304] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:01.891937 920 raft_consensus.cc:2468] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:01.892117 2021 raft_consensus.cc:2804] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:01.892205 2021 raft_consensus.cc:493] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:01.892308 2021 raft_consensus.cc:3060] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.892566 1208 ts_tablet_manager.cc:1434] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:01.892970 1208 tablet_bootstrap.cc:492] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.894693 1208 tablet_bootstrap.cc:654] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.894929 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e244971a6b0b424db6d16d233b32a96e (DEFAULT_TABLE table=default.Table_ed1a0bb02c91457586c92240d93721dd [id=84c367d2b1dd4a25813599ba3e8fd32f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.894995 2021 raft_consensus.cc:515] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.895385 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244971a6b0b424db6d16d233b32a96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.898384 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c0ffb4629a46349ccfe473cc20cdfc" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:01.898581 781 raft_consensus.cc:3060] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.899751 2021 leader_election.cc:290] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:01.902149 781 raft_consensus.cc:2468] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:01.903757 1208 tablet_bootstrap.cc:492] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.905901 1208 ts_tablet_manager.cc:1403] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.004s
I20260619 19:54:01.902909 996 leader_election.cc:304] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:01.906754 1208 raft_consensus.cc:359] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.906939 1208 raft_consensus.cc:385] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:01.907009 1208 raft_consensus.cc:740] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:01.907176 2172 raft_consensus.cc:2804] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:01.907265 1208 consensus_queue.cc:260] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.907361 2172 raft_consensus.cc:697] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:01.907778 1208 ts_tablet_manager.cc:1434] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:01.907678 2172 consensus_queue.cc:237] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.908067 1208 tablet_bootstrap.cc:492] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:01.909780 1208 tablet_bootstrap.cc:654] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:01.904032 759 tablet_service.cc:1511] Processing CreateTablet for tablet 10e01dc8f8cd43b59fe2bbbfa0a4db4c (DEFAULT_TABLE table=default.Table_732f4648a45146c285ecb6717c1de396 [id=dfe90442fcc9448798e60b0ceef878dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.910952 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e01dc8f8cd43b59fe2bbbfa0a4db4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.916798 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c0ffb4629a46349ccfe473cc20cdfc" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:01.920287 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 74813bf79789451f90bcf7779aff9290 (DEFAULT_TABLE table=default.Table_5f333b129935494783c07771a7db1b73 [id=c746b2f4a50f461aaed225866dac8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.922860 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74813bf79789451f90bcf7779aff9290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.926425 2158 raft_consensus.cc:493] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.926488 759 tablet_service.cc:1511] Processing CreateTablet for tablet 74813bf79789451f90bcf7779aff9290 (DEFAULT_TABLE table=default.Table_5f333b129935494783c07771a7db1b73 [id=c746b2f4a50f461aaed225866dac8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.926602 2158 raft_consensus.cc:515] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.926709 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7877d111a0438da74b7bcf396e2c71 (DEFAULT_TABLE table=default.Table_d7ba1a44bb894e6c96ae35d7fcc4c8da [id=e1f11bc6739d4427b75f310028bef998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.926898 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74813bf79789451f90bcf7779aff9290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.927047 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7877d111a0438da74b7bcf396e2c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.927306 2158 leader_election.cc:290] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.928406 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:01.929095 720 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:01.936662 1208 tablet_bootstrap.cc:492] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:01.936753 2222 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 19:54:01.937258 1208 ts_tablet_manager.cc:1403] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.003s
I20260619 19:54:01.938581 2223 tablet.cc:1724] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:01.949133 1973 ts_tablet_manager.cc:1929] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.949301 1973 log.cc:1199] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/906212dd25ef46f2b381ce6a99c39343
I20260619 19:54:01.949815 920 raft_consensus.cc:3060] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:01.951969 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7877d111a0438da74b7bcf396e2c71 (DEFAULT_TABLE table=default.Table_d7ba1a44bb894e6c96ae35d7fcc4c8da [id=e1f11bc6739d4427b75f310028bef998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.952425 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7877d111a0438da74b7bcf396e2c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.953440 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 32ecd267aa34469cad9db0745178013b (DEFAULT_TABLE table=default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.953825 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ecd267aa34469cad9db0745178013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.956247 757 tablet_service.cc:1511] Processing CreateTablet for tablet 32ecd267aa34469cad9db0745178013b (DEFAULT_TABLE table=default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.956660 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ecd267aa34469cad9db0745178013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.959729 748 tablet_service.cc:1511] Processing CreateTablet for tablet 55404d15d42244c6b42272143c44ff9c (DEFAULT_TABLE table=default.Table_3197bcf4217d49889e1beb721a00a0df [id=e281514882fb422bbbe4d740eee2d029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.960105 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55404d15d42244c6b42272143c44ff9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.960165 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 55404d15d42244c6b42272143c44ff9c (DEFAULT_TABLE table=default.Table_3197bcf4217d49889e1beb721a00a0df [id=e281514882fb422bbbe4d740eee2d029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.960577 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55404d15d42244c6b42272143c44ff9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.962955 1994 ts_tablet_manager.cc:1929] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:01.963080 1994 log.cc:1199] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/550297c4d14f4d679d11fded97b671ae
I20260619 19:54:01.963469 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f (DEFAULT_TABLE table=default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.966197 1820 fs_manager.cc:730] Time spent opening block manager: real 0.195s user 0.001s sys 0.000s
I20260619 19:54:01.966661 2158 raft_consensus.cc:493] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.966828 2158 raft_consensus.cc:515] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.967556 2158 leader_election.cc:290] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:01.966499 1820 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data,/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
uuid: "2d38b77ff37948e19592b36b6d884fe0"
format_stamp: "Formatted at 2026-06-19 19:53:44 on dist-test-slave-wkdj"
I20260619 19:54:01.967754 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73029f4bc97349da9d5d2fae4321cd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.967903 1820 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 19:54:01.969039 755 tablet_service.cc:1511] Processing CreateTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f (DEFAULT_TABLE table=default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.969404 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73029f4bc97349da9d5d2fae4321cd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.972208 1973 ts_tablet_manager.cc:1950] T 906212dd25ef46f2b381ce6a99c39343 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:01.972591 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 49) took 2755 ms. Trace:
I20260619 19:54:01.972719 1973 rpcz_store.cc:276] 0619 19:53:59.217278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.217340 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:01.710572 (+2493232us) ts_tablet_manager.cc:1151] Deleting tablet 906212dd25ef46f2b381ce6a99c39343
0619 19:54:01.710581 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.944074 (+233493us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.949031 (+ 4957us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.972552 (+ 23521us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2481279}
I20260619 19:54:01.973404 1973 tablet_replica.cc:333] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:01.973953 760 tablet_service.cc:1511] Processing CreateTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e (DEFAULT_TABLE table=default.Table_00c1932320834358a5d2177cce3bd429 [id=d82c7168e6534b9eb971431987b69afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.974355 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d8cd01251f4cfa93ecddb391c1c91e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:01.975059 996 consensus_peers.cc:597] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:01.974327 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8522f562665540ce99490ab90e02d801" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:01.976130 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:01.976495 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:01.978353 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 906212dd25ef46f2b381ce6a99c39343 (table default.Table_17ad83fba0994578904672a32ee809a4 [id=64c1bcf3dc5048099e5aef869c6133f1]) successfully deleted
I20260619 19:54:01.976711 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:01.979164 746 tablet_service.cc:1511] Processing CreateTablet for tablet ce68de8f421f4011ba9eafe4413d2294 (DEFAULT_TABLE table=default.Table_59c7af4cbfdf4ef5a7bae5b388ec0a2d [id=da90383254a64c8bb9a84858524084d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.979278 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:54:01.979598 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce68de8f421f4011ba9eafe4413d2294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.980226 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:54:01.973675 1973 raft_consensus.cc:2243] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:01.982097 1973 raft_consensus.cc:2272] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:01.984799 751 tablet_service.cc:1511] Processing CreateTablet for tablet 495bafb07abe45da9f62138453dd6636 (DEFAULT_TABLE table=default.Table_96b2c29bad4c4371b337dc4318ef79ff [id=ca34531aaa3d4fb3a1e303bdeb31a103]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.985177 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495bafb07abe45da9f62138453dd6636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.987569 1973 ts_tablet_manager.cc:1916] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:01.988207 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:01.989022 765 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 (DEFAULT_TABLE table=default.Table_e0ce0d7cc0c64198a4c44d4bbd6a154f [id=19f4b9169a634b9d8fc0212981f18682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.989784 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae6164970ec4977a8c0c9fd24ab7275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.991698 1994 ts_tablet_manager.cc:1950] T 550297c4d14f4d679d11fded97b671ae P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:01.993535 749 tablet_service.cc:1511] Processing CreateTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e (DEFAULT_TABLE table=default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.993907 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056f7982f51f45a78d2b9b0a0b50576e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:01.996212 2158 raft_consensus.cc:493] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:01.996363 2158 raft_consensus.cc:515] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:01.996963 2158 leader_election.cc:290] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:02.002298 720 leader_election.cc:343] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.002900 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ce68de8f421f4011ba9eafe4413d2294 (DEFAULT_TABLE table=default.Table_59c7af4cbfdf4ef5a7bae5b388ec0a2d [id=da90383254a64c8bb9a84858524084d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:01.950349 894 tablet_service.cc:1511] Processing CreateTablet for tablet 74813bf79789451f90bcf7779aff9290 (DEFAULT_TABLE table=default.Table_5f333b129935494783c07771a7db1b73 [id=c746b2f4a50f461aaed225866dac8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.004694 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 495bafb07abe45da9f62138453dd6636 (DEFAULT_TABLE table=default.Table_96b2c29bad4c4371b337dc4318ef79ff [id=ca34531aaa3d4fb3a1e303bdeb31a103]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.005111 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e151dc97ad13456ba35708d50c9d7b26" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:02.001941 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e (DEFAULT_TABLE table=default.Table_00c1932320834358a5d2177cce3bd429 [id=d82c7168e6534b9eb971431987b69afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.005940 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:02.006260 918 raft_consensus.cc:2468] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:02.006392 1057 raft_consensus.cc:2468] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:02.007426 720 leader_election.cc:304] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:02.007869 2158 raft_consensus.cc:2804] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:02.008003 2158 raft_consensus.cc:493] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:02.008141 2158 raft_consensus.cc:3060] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.010089 719 leader_election.cc:304] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.011260 2160 raft_consensus.cc:2804] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:02.011358 2160 raft_consensus.cc:493] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:02.011426 2158 raft_consensus.cc:515] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.011425 2160 raft_consensus.cc:3060] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.012341 2158 leader_election.cc:290] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.013132 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 (DEFAULT_TABLE table=default.Table_e0ce0d7cc0c64198a4c44d4bbd6a154f [id=19f4b9169a634b9d8fc0212981f18682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.013368 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e (DEFAULT_TABLE table=default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.014642 2160 raft_consensus.cc:515] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.015861 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e151dc97ad13456ba35708d50c9d7b26" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:02.016582 1057 raft_consensus.cc:3060] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.019050 2160 leader_election.cc:290] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.020402 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce68de8f421f4011ba9eafe4413d2294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.020622 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495bafb07abe45da9f62138453dd6636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.021433 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d8cd01251f4cfa93ecddb391c1c91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.021669 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae6164970ec4977a8c0c9fd24ab7275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.023383 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:02.023694 902 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 (DEFAULT_TABLE table=default.Table_e0ce0d7cc0c64198a4c44d4bbd6a154f [id=19f4b9169a634b9d8fc0212981f18682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.023954 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056f7982f51f45a78d2b9b0a0b50576e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.024349 901 tablet_service.cc:1511] Processing CreateTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f (DEFAULT_TABLE table=default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:02.026151 720 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:02.026782 719 leader_election.cc:343] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26
I20260619 19:54:02.027272 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 45) took 2715 ms. Trace:
I20260619 19:54:02.027405 1994 rpcz_store.cc:276] 0619 19:53:59.311349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.311389 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:01.429743 (+2118354us) ts_tablet_manager.cc:1151] Deleting tablet 550297c4d14f4d679d11fded97b671ae
0619 19:54:01.429817 (+ 74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.670971 (+241154us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:01.962883 (+291912us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.027197 (+ 64314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2118143}
I20260619 19:54:02.027877 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 550297c4d14f4d679d11fded97b671ae (table default.Table_38a961b0cc2946c7b79e57cd66fbe323 [id=99ef9345e27d4380b7312b1cc8dc8b8e]) successfully deleted
I20260619 19:54:02.028457 887 tablet_service.cc:1511] Processing CreateTablet for tablet ce68de8f421f4011ba9eafe4413d2294 (DEFAULT_TABLE table=default.Table_59c7af4cbfdf4ef5a7bae5b388ec0a2d [id=da90383254a64c8bb9a84858524084d2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:02.028896 858 consensus_peers.cc:597] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ef20e35c612400bbbf1c707a36ced8c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.030639 1057 raft_consensus.cc:2468] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:02.030856 899 tablet_service.cc:1511] Processing CreateTablet for tablet 55404d15d42244c6b42272143c44ff9c (DEFAULT_TABLE table=default.Table_3197bcf4217d49889e1beb721a00a0df [id=e281514882fb422bbbe4d740eee2d029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.029109 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8522f562665540ce99490ab90e02d801" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:02.030337 893 tablet_service.cc:1511] Processing CreateTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e (DEFAULT_TABLE table=default.Table_00c1932320834358a5d2177cce3bd429 [id=d82c7168e6534b9eb971431987b69afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.033591 884 tablet_service.cc:1511] Processing CreateTablet for tablet 495bafb07abe45da9f62138453dd6636 (DEFAULT_TABLE table=default.Table_96b2c29bad4c4371b337dc4318ef79ff [id=ca34531aaa3d4fb3a1e303bdeb31a103]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.033731 720 leader_election.cc:304] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:02.034112 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74813bf79789451f90bcf7779aff9290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.034839 2160 raft_consensus.cc:2804] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:02.037343 2160 raft_consensus.cc:697] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:02.037710 2160 consensus_queue.cc:237] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.039508 888 tablet_service.cc:1511] Processing CreateTablet for tablet 32ecd267aa34469cad9db0745178013b (DEFAULT_TABLE table=default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.038439 897 tablet_service.cc:1511] Processing CreateTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e (DEFAULT_TABLE table=default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.040220 1994 tablet_replica.cc:333] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:02.040179 719 leader_election.cc:343] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26
I20260619 19:54:02.040467 1994 raft_consensus.cc:2243] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:02.043284 719 leader_election.cc:343] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.043812 719 leader_election.cc:304] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.045789 1994 raft_consensus.cc:2272] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.049353 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:02.050412 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]). Expected version 2 got 0
I20260619 19:54:02.051204 1994 ts_tablet_manager.cc:1916] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.052201 529 catalog_manager.cc:5696] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:02.055474 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.056087 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.056354 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:02.056902 918 raft_consensus.cc:3060] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.057480 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d8cd01251f4cfa93ecddb391c1c91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.060003 1201 tablet_bootstrap.cc:492] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:02.060063 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056f7982f51f45a78d2b9b0a0b50576e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.062891 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]). Expected version 1 got 0
I20260619 19:54:02.063268 889 tablet_service.cc:1511] Processing CreateTablet for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.063848 1201 ts_tablet_manager.cc:1403] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.708s user 0.023s sys 0.006s
I20260619 19:54:02.069106 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:02.070461 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 3 got 0
I20260619 19:54:02.070767 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ecd267aa34469cad9db0745178013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.073839 2158 raft_consensus.cc:2749] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:02.075765 859 consensus_peers.cc:597] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1bc12bcf50074b46860899a82dc0b46e. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.075819 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495bafb07abe45da9f62138453dd6636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.077219 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae6164970ec4977a8c0c9fd24ab7275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.077148 1201 raft_consensus.cc:359] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.077356 1201 raft_consensus.cc:385] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.077467 1201 raft_consensus.cc:740] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.077703 1201 consensus_queue.cc:260] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.078351 1201 ts_tablet_manager.cc:1434] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.014s user 0.000s sys 0.000s
I20260619 19:54:02.078819 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73029f4bc97349da9d5d2fae4321cd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.079392 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce68de8f421f4011ba9eafe4413d2294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.080488 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55404d15d42244c6b42272143c44ff9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.084496 1201 tablet_bootstrap.cc:492] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:02.086334 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:02.087818 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 1 got 0
I20260619 19:54:02.088169 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:02.089038 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.090200 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e4688dc20317479e9c80f6f41b3ea35e (DEFAULT_TABLE table=default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.091318 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:02.091861 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_dc77e7b8f63e4fe4924fdae4421075e9 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 2 got 0
I20260619 19:54:02.092218 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_83bb8d4286d24179baa0a9b7155f15d7 [id=ff393d500bb34f318889666cc5650292]). Expected version 1 got 0
I20260619 19:54:02.092607 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_9e763837fe2d46c9b0f859d4e159a2af [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 1 got 0
I20260619 19:54:02.093079 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 2 got 0
I20260619 19:54:02.093361 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 1 got 0
I20260619 19:54:02.093586 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:02.093834 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:02.094352 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:02.094611 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:54:02.095034 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:54:02.095422 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]). Expected version 1 got 0
I20260619 19:54:02.097038 903 tablet_service.cc:1511] Processing CreateTablet for tablet e4688dc20317479e9c80f6f41b3ea35e (DEFAULT_TABLE table=default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.098037 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202]). Expected version 2 got 0
I20260619 19:54:02.099629 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d (DEFAULT_TABLE table=default.Table_49b9db84d9d64b3bbde7236a42fef5df [id=4a0bee70b1e843b086d0ccc5b4cf13ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.100160 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7f825e5f84d5985427e83ee6a989d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.101052 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4688dc20317479e9c80f6f41b3ea35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.101655 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:02.106029 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 56640f773efb4123b93f4ca3799ddde7
I20260619 19:54:02.106307 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd6b786bd844781af7fdc5849e90009 (DEFAULT_TABLE table=default.Table_107d4f6ff8314ea1b5ea10925d7f52bd [id=a6fbc7b7f8be4094827cb7084eadaf9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.106714 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd6b786bd844781af7fdc5849e90009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.106879 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2dc810dbe0264b59aed3d2f2186ea1dd" } new_table_name: "default.Table_46a7c157a163498b8dad537378867594" modify_external_catalogs: true
I20260619 19:54:02.110985 920 raft_consensus.cc:2468] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:02.112053 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 56640f773efb4123b93f4ca3799ddde7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:02.117045 1973 ts_tablet_manager.cc:1929] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.117165 1973 log.cc:1199] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/5bae5be1340f4158a0b243415e232ae5
I20260619 19:54:02.117129 918 raft_consensus.cc:2468] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:02.122023 1973 ts_tablet_manager.cc:1950] T 5bae5be1340f4158a0b243415e232ae5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.122419 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 52) took 2891 ms. Trace:
I20260619 19:54:02.122501 1973 rpcz_store.cc:276] 0619 19:53:59.231261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.231677 (+ 416us) service_pool.cc:224] Handling call
0619 19:54:01.973011 (+2741334us) ts_tablet_manager.cc:1151] Deleting tablet 5bae5be1340f4158a0b243415e232ae5
0619 19:54:01.973021 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.083693 (+110672us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.116982 (+ 33289us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.122396 (+ 5414us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739714}
I20260619 19:54:02.123962 1973 tablet_replica.cc:333] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.124163 1973 raft_consensus.cc:2243] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.124361 1973 raft_consensus.cc:2272] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.124933 1973 ts_tablet_manager.cc:1916] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.126403 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4688dc20317479e9c80f6f41b3ea35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.126494 2114 consensus_queue.cc:1048] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:02.126950 886 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d (DEFAULT_TABLE table=default.Table_49b9db84d9d64b3bbde7236a42fef5df [id=4a0bee70b1e843b086d0ccc5b4cf13ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.127369 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7f825e5f84d5985427e83ee6a989d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.132433 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 56640f773efb4123b93f4ca3799ddde7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:02.134361 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (DEFAULT_TABLE table=default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.135010 747 tablet_service.cc:1511] Processing CreateTablet for tablet e4688dc20317479e9c80f6f41b3ea35e (DEFAULT_TABLE table=default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.137171 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 5bae5be1340f4158a0b243415e232ae5 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]) successfully deleted
I20260619 19:54:02.137367 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d (DEFAULT_TABLE table=default.Table_49b9db84d9d64b3bbde7236a42fef5df [id=4a0bee70b1e843b086d0ccc5b4cf13ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.153952 1994 ts_tablet_manager.cc:1929] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.154119 1994 log.cc:1199] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/184d655694434b0bbfa178fcd3110405
I20260619 19:54:02.154580 1994 ts_tablet_manager.cc:1950] T 184d655694434b0bbfa178fcd3110405 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.164302 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 46) took 2845 ms. Trace:
I20260619 19:54:02.164600 1994 rpcz_store.cc:276] 0619 19:53:59.311671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.311712 (+ 41us) service_pool.cc:224] Handling call
0619 19:54:02.028252 (+2716540us) ts_tablet_manager.cc:1151] Deleting tablet 184d655694434b0bbfa178fcd3110405
0619 19:54:02.028264 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.098079 (+ 69815us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.153847 (+ 55768us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.157535 (+ 3688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2716358}
I20260619 19:54:02.165076 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 47) took 2853 ms. Trace:
I20260619 19:54:02.165210 1994 rpcz_store.cc:276] 0619 19:53:59.312062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.312105 (+ 43us) service_pool.cc:224] Handling call
0619 19:54:02.164907 (+2852802us) ts_tablet_manager.cc:1151] Deleting tablet 19d6333b0c8940b2802307d0da8a57ac
0619 19:54:02.164916 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.165040 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2852619}
I20260619 19:54:02.165331 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 184d655694434b0bbfa178fcd3110405 (table default.Table_30ac9e6bf2a947009c67072b853bcf4e [id=88b02ca24c9f4dc6bf751de7bed9499c]) successfully deleted
I20260619 19:54:02.165609 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 36) took 2857 ms. Trace:
W20260619 19:54:02.165757 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 19d6333b0c8940b2802307d0da8a57ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19d6333b0c8940b2802307d0da8a57ac already in progress: creating tablet
I20260619 19:54:02.165728 1994 rpcz_store.cc:276] 0619 19:53:59.308569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.312618 (+ 4049us) service_pool.cc:224] Handling call
0619 19:54:02.165497 (+2852879us) ts_tablet_manager.cc:1151] Deleting tablet e3031a45cf534814bbece8d271c0420e
0619 19:54:02.165507 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.165571 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2852690}
I20260619 19:54:02.166018 1994 tablet_replica.cc:333] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.166234 1994 raft_consensus.cc:2243] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.166430 1994 raft_consensus.cc:2272] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.167263 1994 ts_tablet_manager.cc:1916] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:02.170295 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e3031a45cf534814bbece8d271c0420e because the tablet was not found. No further retry: Not found: Tablet not found: e3031a45cf534814bbece8d271c0420e
I20260619 19:54:02.174109 892 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd6b786bd844781af7fdc5849e90009 (DEFAULT_TABLE table=default.Table_107d4f6ff8314ea1b5ea10925d7f52bd [id=a6fbc7b7f8be4094827cb7084eadaf9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.173254 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 526af16b6a6a4cac9c084900b22d9acf (DEFAULT_TABLE table=default.Table_f7121ded2ddc495888c7d50e41b52b40 [id=a831bfed87194853b3982b43a6338c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.175009 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526af16b6a6a4cac9c084900b22d9acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.175365 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 56640f773efb4123b93f4ca3799ddde7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:02.177167 749 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd6b786bd844781af7fdc5849e90009 (DEFAULT_TABLE table=default.Table_107d4f6ff8314ea1b5ea10925d7f52bd [id=a6fbc7b7f8be4094827cb7084eadaf9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.179773 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (DEFAULT_TABLE table=default.Table_443e720ca25543829dd293413d08f95e [id=33e3d383660b422582a47dcb68ae6be7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.181252 719 leader_election.cc:304] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.181679 2018 raft_consensus.cc:2804] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:02.181810 2018 raft_consensus.cc:697] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:02.182068 2018 consensus_queue.cc:237] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.184127 1200 tablet_bootstrap.cc:492] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:02.186667 2026 ts_tablet_manager.cc:1929] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.187472 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd6b786bd844781af7fdc5849e90009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.187248 900 tablet_service.cc:1511] Processing CreateTablet for tablet 526af16b6a6a4cac9c084900b22d9acf (DEFAULT_TABLE table=default.Table_f7121ded2ddc495888c7d50e41b52b40 [id=a831bfed87194853b3982b43a6338c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.189865 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.189946 2026 log.cc:1199] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/33cfbae501de432cbcb34d2a6365f806
I20260619 19:54:02.190188 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7f825e5f84d5985427e83ee6a989d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.190480 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd6b786bd844781af7fdc5849e90009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.195297 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4688dc20317479e9c80f6f41b3ea35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.202844 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9e7877d111a0438da74b7bcf396e2c71 (DEFAULT_TABLE table=default.Table_d7ba1a44bb894e6c96ae35d7fcc4c8da [id=e1f11bc6739d4427b75f310028bef998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.207895 2230 tablet.cc:1724] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:02.208566 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526af16b6a6a4cac9c084900b22d9acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.235230 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e7877d111a0438da74b7bcf396e2c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.244591 1973 ts_tablet_manager.cc:1929] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.244750 1973 log.cc:1199] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:02.245167 1973 ts_tablet_manager.cc:1950] T 1a686826694b49b9bb5bcdefd61c9a15 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.245954 885 tablet_service.cc:1511] Processing CreateTablet for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (DEFAULT_TABLE table=default.Table_443e720ca25543829dd293413d08f95e [id=33e3d383660b422582a47dcb68ae6be7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.249608 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 53) took 3018 ms. Trace:
I20260619 19:54:02.249718 1973 rpcz_store.cc:276] 0619 19:53:59.231336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.231705 (+ 369us) service_pool.cc:224] Handling call
0619 19:54:02.123904 (+2892199us) ts_tablet_manager.cc:1151] Deleting tablet 1a686826694b49b9bb5bcdefd61c9a15
0619 19:54:02.123916 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.219533 (+ 95617us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.244520 (+ 24987us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.249587 (+ 5067us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2890430}
I20260619 19:54:02.253331 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:02.257563 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 (DEFAULT_TABLE table=default.Table_f1436f5ff9b34985976f95675a904bc5 [id=83cf7db2f6054464813d2bc3c268af46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.261379 1973 tablet_replica.cc:333] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.261629 1973 raft_consensus.cc:2243] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.261996 1973 raft_consensus.cc:2272] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.262753 1973 ts_tablet_manager.cc:1916] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.269266 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:02.269604 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:54:02.270498 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:54:02.280900 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]). Expected version 2 got 0
I20260619 19:54:02.281257 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:02.282008 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]). Expected version 1 got 0
I20260619 19:54:02.283731 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:02.287472 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:02.287968 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]). Expected version 3 got 0
I20260619 19:54:02.288221 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:02.288657 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:02.289153 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_9e763837fe2d46c9b0f859d4e159a2af [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 1 got 0
I20260619 19:54:02.290236 1973 ts_tablet_manager.cc:1929] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.289686 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_dc77e7b8f63e4fe4924fdae4421075e9 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 2 got 0
I20260619 19:54:02.290622 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_83bb8d4286d24179baa0a9b7155f15d7 [id=ff393d500bb34f318889666cc5650292]). Expected version 1 got 0
I20260619 19:54:02.290843 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:02.291010 1973 log.cc:1199] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/82d2dd6eedd24f44a6a17aceb20e62bb
I20260619 19:54:02.291637 1973 ts_tablet_manager.cc:1950] T 82d2dd6eedd24f44a6a17aceb20e62bb P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.292649 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:02.293182 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 54) took 3061 ms. Trace:
I20260619 19:54:02.293582 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 2 got 0
I20260619 19:54:02.293726 1973 rpcz_store.cc:276] 0619 19:53:59.231452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.231681 (+ 229us) service_pool.cc:224] Handling call
0619 19:54:02.261310 (+3029629us) ts_tablet_manager.cc:1151] Deleting tablet 82d2dd6eedd24f44a6a17aceb20e62bb
0619 19:54:02.261325 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.266149 (+ 4824us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.290131 (+ 23982us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.293162 (+ 3031us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3026941}
I20260619 19:54:02.294315 1973 tablet_replica.cc:333] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.294566 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:02.294819 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 1 got 0
I20260619 19:54:02.295182 1973 raft_consensus.cc:2243] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.299875 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 1 got 0
I20260619 19:54:02.300483 1973 raft_consensus.cc:2272] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.300762 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a54231986cca44258942dbc3373870b2 (table default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]). Expected version 1 got 0
I20260619 19:54:02.301599 1973 ts_tablet_manager.cc:1916] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.302368 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:02.303766 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:54:02.304170 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]). Expected version 1 got 0
I20260619 19:54:02.304687 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 3 got 0
I20260619 19:54:02.310209 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 11e9d0ae96db4388a39a8b8f9c87187e (table default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202]). Expected version 2 got 0
I20260619 19:54:02.310572 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:02.311266 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
W20260619 19:54:02.312062 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4023cceb8d9447c9952951c1d6bcdf00 consensus state has no leader
I20260619 19:54:02.314254 2026 ts_tablet_manager.cc:1950] T 33cfbae501de432cbcb34d2a6365f806 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:02.315270 897 tablet_service.cc:1511] Processing CreateTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 (DEFAULT_TABLE table=default.Table_cae61bfa5a3c4fa8b9eb4ab07b327be0 [id=050ce6b1eee349318da902df45aa205e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.315775 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.316270 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fe4b37c74b4fb496f2842407c65eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.317068 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642bc8d3f984e1c9d60093fa7abcc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.323065 1835 raft_consensus.cc:493] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:02.323290 1973 ts_tablet_manager.cc:1929] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.323406 1973 log.cc:1199] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/c2c0afdcf96247b0a16c8f9ac71cc24a
I20260619 19:54:02.323489 1835 raft_consensus.cc:515] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:02.323871 1973 ts_tablet_manager.cc:1950] T c2c0afdcf96247b0a16c8f9ac71cc24a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.324240 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:02.324404 1835 leader_election.cc:290] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:02.325181 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 9a4c335fc5ca4885b5482c6b749f76f9 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:02.329285 2006 raft_consensus.cc:493] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:02.329524 2006 raft_consensus.cc:515] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.329953 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 56) took 3097 ms. Trace:
I20260619 19:54:02.330053 1973 rpcz_store.cc:276] 0619 19:53:59.232776 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.232837 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:02.294244 (+3061407us) ts_tablet_manager.cc:1151] Deleting tablet c2c0afdcf96247b0a16c8f9ac71cc24a
0619 19:54:02.294259 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.308158 (+ 13899us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.323218 (+ 15060us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.329923 (+ 6705us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3058607}
I20260619 19:54:02.330297 2006 leader_election.cc:290] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.330365 1973 tablet_replica.cc:333] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.330574 1973 raft_consensus.cc:2243] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.330724 1973 raft_consensus.cc:2272] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.331341 1973 ts_tablet_manager.cc:1916] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:02.333151 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59123a56731645e1bbfcc94b2a46b1d6 consensus state has no leader
I20260619 19:54:02.333491 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 30e606b958d940c6a353a09a2eb627ee
I20260619 19:54:02.334015 532 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:37030 (request call id 214) took 1245 ms. Trace:
I20260619 19:54:02.336412 532 rpcz_store.cc:276] 0619 19:54:01.088923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.220505 (+131582us) service_pool.cc:224] Handling call
0619 19:54:01.303091 (+ 82586us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570d06b6 00007fd74db2d486 00007fd74db2d1b5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:01.305691 (+ 2600us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0619 19:54:01.305847 (+ 156us) catalog_manager.cc:2840] Modifying in-memory table state
0619 19:54:01.305928 (+ 81us) catalog_manager.cc:2849] Locking tablets
0619 19:54:01.306137 (+ 209us) catalog_manager.cc:2863] Removing table and tablets from system table
0619 19:54:01.418087 (+111950us) catalog_manager.cc:2881] Removing table from by-name map
0619 19:54:01.517484 (+ 99397us) catalog_manager.cc:2897] Committing in-memory state
0619 19:54:02.315401 (+797917us) catalog_manager.cc:2901] Aborting table tasks
0619 19:54:02.333980 (+ 18579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:01.322296 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:01.322429 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:01.322435 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:01.322437 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:01.322687 (+ 250us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:01.322699 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:01.322704 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:01.322836 (+ 132us) tablet.cc:701] Row locks acquired
0619 19:54:01.322843 (+ 7us) write_op.cc:260] PREPARE: finished
0619 19:54:01.322880 (+ 37us) write_op.cc:270] Start()
0619 19:54:01.322916 (+ 36us) write_op.cc:276] Timestamp: P: 1781898841322857 usec, L: 0
0619 19:54:01.322920 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:01.323090 (+ 170us) log.cc:844] Serialized 796 byte log entry
0619 19:54:01.416310 (+ 93220us) op_driver.cc:464] REPLICATION: finished
0619 19:54:01.417084 (+ 774us) write_op.cc:301] APPLY: starting
0619 19:54:01.417094 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:01.417133 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:01.417156 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:01.417226 (+ 70us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:01.417253 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:01.417260 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:01.417313 (+ 53us) log.cc:844] Serialized 29 byte log entry
0619 19:54:01.417351 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.417364 (+ 13us) write_op.cc:454] Released schema lock
0619 19:54:01.417369 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:01.417441 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.417445 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":189397760,"child_traces":[["op",{"apply.queue_time_us":741,"apply.run_cpu_time_us":343,"apply.run_wall_time_us":343,"num_ops":2,"prepare.queue_time_us":15302,"prepare.run_cpu_time_us":917,"prepare.run_wall_time_us":1309,"raft.queue_time_us":1587,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":3,"replication_time_us":93373}]]}
I20260619 19:54:02.337440 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fe814880d9984bbd83fa121cb2a34eac
I20260619 19:54:02.337587 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_0761528dd12f4e449282247241577e72 [id=f58a91c6f29e4958b3de00addcb87fec] alter complete (version 1)
I20260619 19:54:02.337611 1973 ts_tablet_manager.cc:1929] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:02.337713 1973 log.cc:1199] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:54:02.339996 886 tablet_service.cc:1511] Processing CreateTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 (DEFAULT_TABLE table=default.Table_122ef08337114140a4943c821d049ffb [id=b8f9efa202184597a36c5b4dcfa46084]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:02.340139 859 leader_election.cc:343] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1d0fe0c67fe84e5b866fd2553ea26d91
I20260619 19:54:02.340809 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c5f9405d6a4a16bd49697001c201e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.343202 1973 ts_tablet_manager.cc:1950] T 45c0ffb4629a46349ccfe473cc20cdfc P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.343508 524 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_6fa059c58932422ab8d776397d5a3379 [id=394d8c70bca54b0eb32990278e06cd91] alter complete (version 3)
I20260619 19:54:02.343978 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_d911a0e8835847cb9ccf9d5d192872fe [id=57b57ad63a674bf08da4cf6d7bcd1b4e] alter complete (version 1)
I20260619 19:54:02.346167 1201 tablet_bootstrap.cc:654] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.346554 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 57) took 3112 ms. Trace:
I20260619 19:54:02.346727 1973 rpcz_store.cc:276] 0619 19:53:59.234494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.234566 (+ 72us) service_pool.cc:224] Handling call
0619 19:54:02.330316 (+3095750us) ts_tablet_manager.cc:1151] Deleting tablet 45c0ffb4629a46349ccfe473cc20cdfc
0619 19:54:02.330325 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.334494 (+ 4169us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.337549 (+ 3055us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.346535 (+ 8986us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3094545}
I20260619 19:54:02.347265 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 59) took 3110 ms. Trace:
I20260619 19:54:02.347396 1973 rpcz_store.cc:276] 0619 19:53:59.237204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.237453 (+ 249us) service_pool.cc:224] Handling call
0619 19:54:02.347116 (+3109663us) ts_tablet_manager.cc:1151] Deleting tablet 19d6333b0c8940b2802307d0da8a57ac
0619 19:54:02.347144 (+ 28us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.347248 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3106529}
I20260619 19:54:02.347745 1973 tablet_replica.cc:333] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.347987 1973 raft_consensus.cc:2243] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.348366 1973 raft_consensus.cc:2272] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.349009 1973 ts_tablet_manager.cc:1916] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:02.350008 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d77de42bb514452a8dc6a4a71289dc59 consensus state has no leader
I20260619 19:54:02.351548 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 69) took 1972 ms. Trace:
I20260619 19:54:02.351711 2026 rpcz_store.cc:276] 0619 19:54:00.379103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.379675 (+ 572us) service_pool.cc:224] Handling call
0619 19:54:01.802920 (+1423245us) ts_tablet_manager.cc:1151] Deleting tablet 33cfbae501de432cbcb34d2a6365f806
0619 19:54:01.802936 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:01.941363 (+138427us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.172565 (+231202us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.351489 (+178924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403128}
I20260619 19:54:02.352443 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 73) took 1800 ms. Trace:
I20260619 19:54:02.352581 2026 rpcz_store.cc:276] 0619 19:54:00.551558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.551843 (+ 285us) service_pool.cc:224] Handling call
0619 19:54:02.352255 (+1800412us) ts_tablet_manager.cc:1151] Deleting tablet 56ba47943b9d4123985ea6ca1478cd93
0619 19:54:02.352271 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.352402 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1800210}
I20260619 19:54:02.353226 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 74) took 1801 ms. Trace:
I20260619 19:54:02.353363 2026 rpcz_store.cc:276] 0619 19:54:00.551684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.552076 (+ 392us) service_pool.cc:224] Handling call
0619 19:54:02.353049 (+1800973us) ts_tablet_manager.cc:1151] Deleting tablet 05c9a91f95bb4bcdafe493bab8c393b4
0619 19:54:02.353062 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.353194 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782530}
I20260619 19:54:02.353921 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 77) took 1758 ms. Trace:
I20260619 19:54:02.354051 2026 rpcz_store.cc:276] 0619 19:54:00.595923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.612921 (+ 16998us) service_pool.cc:224] Handling call
0619 19:54:02.353782 (+1740861us) ts_tablet_manager.cc:1151] Deleting tablet b2902c7f67a1402987315ee426ddf1d2
0619 19:54:02.353794 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.353880 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1740563}
I20260619 19:54:02.354564 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 87) took 1495 ms. Trace:
I20260619 19:54:02.354702 2026 rpcz_store.cc:276] 0619 19:54:00.858874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.860205 (+ 1331us) service_pool.cc:224] Handling call
0619 19:54:02.354430 (+1494225us) ts_tablet_manager.cc:1151] Deleting tablet 0b55debc1b064192a56d2453364ba260
0619 19:54:02.354441 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.354533 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1493883}
I20260619 19:54:02.355285 527 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:37030 (request call id 205) took 1297 ms. Trace:
I20260619 19:54:02.355409 527 rpcz_store.cc:276] 0619 19:54:01.055039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.079958 (+ 24919us) service_pool.cc:224] Handling call
0619 19:54:01.080485 (+ 527us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0619 19:54:01.080656 (+ 171us) catalog_manager.cc:2840] Modifying in-memory table state
0619 19:54:01.080708 (+ 52us) catalog_manager.cc:2849] Locking tablets
0619 19:54:01.389543 (+308835us) catalog_manager.cc:2863] Removing table and tablets from system table
0619 19:54:01.476285 (+ 86742us) catalog_manager.cc:2881] Removing table from by-name map
0619 19:54:01.509820 (+ 33535us) catalog_manager.cc:2897] Committing in-memory state
0619 19:54:02.315322 (+805502us) catalog_manager.cc:2901] Aborting table tasks
0619 19:54:02.352154 (+ 36832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:01.396512 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:01.396597 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:01.396602 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:01.396605 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:01.396720 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:01.396728 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:01.396733 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:01.396850 (+ 117us) tablet.cc:701] Row locks acquired
0619 19:54:01.396861 (+ 11us) write_op.cc:260] PREPARE: finished
0619 19:54:01.396890 (+ 29us) write_op.cc:270] Start()
0619 19:54:01.396924 (+ 34us) write_op.cc:276] Timestamp: P: 1781898841396863 usec, L: 0
0619 19:54:01.396928 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:01.397067 (+ 139us) log.cc:844] Serialized 731 byte log entry
0619 19:54:01.474916 (+ 77849us) op_driver.cc:464] REPLICATION: finished
0619 19:54:01.475634 (+ 718us) write_op.cc:301] APPLY: starting
0619 19:54:01.475642 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:01.475671 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:01.475697 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:01.475736 (+ 39us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:01.475758 (+ 22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:01.475765 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:01.475806 (+ 41us) log.cc:844] Serialized 29 byte log entry
0619 19:54:01.475836 (+ 30us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.475848 (+ 12us) write_op.cc:454] Released schema lock
0619 19:54:01.475853 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:01.475902 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.475906 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":691,"apply.run_cpu_time_us":263,"apply.run_wall_time_us":263,"num_ops":2,"prepare.queue_time_us":6353,"prepare.run_cpu_time_us":650,"prepare.run_wall_time_us":967,"raft.queue_time_us":68,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":2,"replication_time_us":77973}]]}
I20260619 19:54:02.356849 1973 ts_tablet_manager.cc:1929] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260619 19:54:02.357018 1973 log.cc:1199] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:02.356993 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f0c38d52de164a0faf77ba776b51a3bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:02.357577 1973 ts_tablet_manager.cc:1950] T 4e2f73871161488dbad7a19fc9e20b9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:02.357661 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0c38d52de164a0faf77ba776b51a3bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.358103 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 55) took 3126 ms. Trace:
I20260619 19:54:02.358279 1973 rpcz_store.cc:276] 0619 19:53:59.231596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.231916 (+ 320us) service_pool.cc:224] Handling call
0619 19:54:02.347704 (+3115788us) ts_tablet_manager.cc:1151] Deleting tablet 4e2f73871161488dbad7a19fc9e20b9c
0619 19:54:02.347713 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.352618 (+ 4905us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.356786 (+ 4168us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.358078 (+ 1292us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3106856}
I20260619 19:54:02.358801 1973 tablet_replica.cc:333] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.359054 1973 raft_consensus.cc:2243] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.359313 1973 raft_consensus.cc:2272] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.359874 900 tablet_service.cc:1511] Processing CreateTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.360360 1973 ts_tablet_manager.cc:1916] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.363168 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 33cfbae501de432cbcb34d2a6365f806 (table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]) successfully deleted
W20260619 19:54:02.363451 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 56ba47943b9d4123985ea6ca1478cd93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56ba47943b9d4123985ea6ca1478cd93 already in progress: creating tablet
W20260619 19:54:02.363708 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 05c9a91f95bb4bcdafe493bab8c393b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05c9a91f95bb4bcdafe493bab8c393b4 already in progress: creating tablet
W20260619 19:54:02.364251 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b2902c7f67a1402987315ee426ddf1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2902c7f67a1402987315ee426ddf1d2 already in progress: creating tablet
W20260619 19:54:02.364691 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 0b55debc1b064192a56d2453364ba260 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b55debc1b064192a56d2453364ba260 already in progress: creating tablet
I20260619 19:54:02.367302 1973 ts_tablet_manager.cc:1929] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.367506 1973 log.cc:1199] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/2d1b7b743e594e2aaeaeedd8613d9789
I20260619 19:54:02.367789 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_93a36817c65c48b5b2e86a7b7a2937be [id=a57b082016f14ff48e4194fcbd7b63c1] alter complete (version 1)
I20260619 19:54:02.368013 1973 ts_tablet_manager.cc:1950] T 2d1b7b743e594e2aaeaeedd8613d9789 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.368397 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 51) took 3137 ms. Trace:
I20260619 19:54:02.368553 1973 rpcz_store.cc:276] 0619 19:53:59.231175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.231727 (+ 552us) service_pool.cc:224] Handling call
0619 19:54:02.358743 (+3127016us) ts_tablet_manager.cc:1151] Deleting tablet 2d1b7b743e594e2aaeaeedd8613d9789
0619 19:54:02.358756 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.363756 (+ 5000us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.366938 (+ 3182us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.368379 (+ 1441us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3117612}
I20260619 19:54:02.368989 1973 tablet_replica.cc:333] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.369226 1973 raft_consensus.cc:2243] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.369465 1973 raft_consensus.cc:2272] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.370110 1973 ts_tablet_manager.cc:1916] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.375394 889 tablet_service.cc:1558] Processing DeleteTablet for tablet fe814880d9984bbd83fa121cb2a34eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:02.375950 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e606b958d940c6a353a09a2eb627ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:02.376269 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:02.376878 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 56ba47943b9d4123985ea6ca1478cd93 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:02.377409 1973 ts_tablet_manager.cc:1929] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.377637 1973 log.cc:1199] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d29506dab4c84850ad79b8b7a0340987
I20260619 19:54:02.377717 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b060c9b13fe14e5b877dca744457d580"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:02.378216 1973 ts_tablet_manager.cc:1950] T d29506dab4c84850ad79b8b7a0340987 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:02.378470 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b060c9b13fe14e5b877dca744457d580 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:02.378484 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 199373us
I20260619 19:54:02.378695 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 61) took 3140 ms. Trace:
I20260619 19:54:02.378857 1973 rpcz_store.cc:276] 0619 19:53:59.237810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.237894 (+ 84us) service_pool.cc:224] Handling call
0619 19:54:02.368942 (+3131048us) ts_tablet_manager.cc:1151] Deleting tablet d29506dab4c84850ad79b8b7a0340987
0619 19:54:02.368951 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.373398 (+ 4447us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.377347 (+ 3949us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.378671 (+ 1324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3127327}
I20260619 19:54:02.379393 1973 tablet_replica.cc:333] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.380191 1973 raft_consensus.cc:2243] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.380237 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_599b6bc9158b48d4848732a5c03bc7d1" } modify_external_catalogs: true
I20260619 19:54:02.380446 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_599b6bc9158b48d4848732a5c03bc7d1" } modify_external_catalogs: true
I20260619 19:54:02.380514 1973 raft_consensus.cc:2272] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.381258 1973 ts_tablet_manager.cc:1916] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.382269 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_11ebd5156f0249c0abafdda9c4392b11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:02.382913 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11ebd5156f0249c0abafdda9c4392b11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.185833 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.203377 1994 ts_tablet_manager.cc:1929] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.384646 1994 log.cc:1199] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/33935217c1f44ce0ad5b8610d368f2eb
I20260619 19:54:02.385267 1994 ts_tablet_manager.cc:1950] T 33935217c1f44ce0ad5b8610d368f2eb P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.386236 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 35) took 3077 ms. Trace:
I20260619 19:54:02.386341 1994 rpcz_store.cc:276] 0619 19:53:59.308426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.312892 (+ 4466us) service_pool.cc:224] Handling call
0619 19:54:02.165946 (+2853054us) ts_tablet_manager.cc:1151] Deleting tablet 33935217c1f44ce0ad5b8610d368f2eb
0619 19:54:02.165957 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.170419 (+ 4462us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.203289 (+ 32870us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.386160 (+182871us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2852896}
I20260619 19:54:02.386826 1994 tablet_replica.cc:333] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.387022 1994 raft_consensus.cc:2243] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.226979 1025 tablet_service.cc:1511] Processing CreateTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.387650 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcc9c4167c58495fbfcf5fb60952c884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.389859 2158 consensus_queue.cc:1048] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:02.247224 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 (DEFAULT_TABLE table=default.Table_cae61bfa5a3c4fa8b9eb4ab07b327be0 [id=050ce6b1eee349318da902df45aa205e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.254889 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 (DEFAULT_TABLE table=default.Table_f1436f5ff9b34985976f95675a904bc5 [id=83cf7db2f6054464813d2bc3c268af46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.262197 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 (DEFAULT_TABLE table=default.Table_122ef08337114140a4943c821d049ffb [id=b8f9efa202184597a36c5b4dcfa46084]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:02.392899 720 consensus_peers.cc:597] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 184d655694434b0bbfa178fcd3110405. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.394701 970 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:54:02.334837 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:02.336014 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e606b958d940c6a353a09a2eb627ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:02.336264 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:02.353296 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet fe814880d9984bbd83fa121cb2a34eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:02.367081 2223 tablet.cc:1724] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:02.396417 859 leader_election.cc:343] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.396873 2224 tablet.cc:1724] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:02.396963 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 33935217c1f44ce0ad5b8610d368f2eb (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]) successfully deleted
I20260619 19:54:02.398360 1994 pending_rounds.cc:70] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:02.398469 1994 pending_rounds.cc:77] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657656457142272 op_type: NO_OP noop_request { }
I20260619 19:54:02.398612 1994 raft_consensus.cc:2889] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:02.398723 1994 raft_consensus.cc:2272] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.398638 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 1a686826694b49b9bb5bcdefd61c9a15 (table default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]) successfully deleted
I20260619 19:54:02.399186 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 82d2dd6eedd24f44a6a17aceb20e62bb (table default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f [id=a35219ac89654132bd60088b911b7859]) successfully deleted
I20260619 19:54:02.399899 1994 ts_tablet_manager.cc:1916] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.400274 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fe4b37c74b4fb496f2842407c65eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.400939 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c5f9405d6a4a16bd49697001c201e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.401399 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642bc8d3f984e1c9d60093fa7abcc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.405685 1208 raft_consensus.cc:359] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.405929 1208 raft_consensus.cc:385] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.405990 1208 raft_consensus.cc:740] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.406234 1208 consensus_queue.cc:260] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.408059 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet c2c0afdcf96247b0a16c8f9ac71cc24a (table default.Table_fee05dbe2f3d4261b61052c1fa5e39f0 [id=c2b19d2a6fe34187866a4ad49b0533d6]) successfully deleted
I20260619 19:54:02.408495 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 19d6333b0c8940b2802307d0da8a57ac from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:02.409025 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 45c0ffb4629a46349ccfe473cc20cdfc (table default.Table_f2b7aed4e720476cb97127ea1b58db50 [id=0178c0c89c424890aeaa1e2bd32ed94e]) successfully deleted
W20260619 19:54:02.409503 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 19d6333b0c8940b2802307d0da8a57ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19d6333b0c8940b2802307d0da8a57ac already in progress: creating tablet
I20260619 19:54:02.410979 2158 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:02.411147 2158 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.411712 2158 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.420568 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b4f7122fa5f94eeaa3b99cae107d8c9a
I20260619 19:54:02.422396 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:02.422784 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:02.427372 2230 tablet.cc:1724] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:02.433211 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcc9c4167c58495fbfcf5fb60952c884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.434983 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 4e2f73871161488dbad7a19fc9e20b9c (table default.Table_a146cb8bcd694f8482d04dcd9b0ac13c [id=f73253a802944e92a24b1e8bbe5a5231]) successfully deleted
I20260619 19:54:02.435817 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 2d1b7b743e594e2aaeaeedd8613d9789 (table default.Table_e628fda622264f3eb2fdbfbffbf213cc [id=6db61c680af2412f8943d8fb98e9e7fd]) successfully deleted
I20260619 19:54:02.437103 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:02.437623 776 raft_consensus.cc:3060] T d27342783a5641d7a324e71183269308 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.448100 2026 tablet_replica.cc:333] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:02.449126 2026 raft_consensus.cc:2243] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.453611 2026 raft_consensus.cc:2272] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.454443 2026 ts_tablet_manager.cc:1916] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.454819 1994 ts_tablet_manager.cc:1929] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.455106 523 catalog_manager.cc:5696] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:02.456046 523 catalog_manager.cc:5696] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:02.456624 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_94d5b0a1504044b7a1934b5c726b29d4 [id=96dda797fa474e119e765b5d9946bfb7]). Expected version 2 got 1
I20260619 19:54:02.456890 1994 log.cc:1199] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:54:02.457573 523 catalog_manager.cc:5696] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:02.458396 1994 ts_tablet_manager.cc:1950] T 45c0ffb4629a46349ccfe473cc20cdfc P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.458696 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:02.459903 1973 ts_tablet_manager.cc:1929] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.479525 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 49) took 3166 ms. Trace:
I20260619 19:54:02.479835 1973 log.cc:1199] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/aafe2a956b844c9998c84bbe52070e5d
I20260619 19:54:02.479974 1994 rpcz_store.cc:276] 0619 19:53:59.313294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.313452 (+ 158us) service_pool.cc:224] Handling call
0619 19:54:02.386726 (+3073274us) ts_tablet_manager.cc:1151] Deleting tablet 45c0ffb4629a46349ccfe473cc20cdfc
0619 19:54:02.386737 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.451570 (+ 64833us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.454749 (+ 3179us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.479490 (+ 24741us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3073110}
I20260619 19:54:02.480698 1973 ts_tablet_manager.cc:1950] T aafe2a956b844c9998c84bbe52070e5d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.480986 1994 tablet_replica.cc:333] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.481216 1994 raft_consensus.cc:2243] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.481643 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 50) took 3250 ms. Trace:
I20260619 19:54:02.482036 1994 raft_consensus.cc:2272] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.482788 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:02.483021 1973 rpcz_store.cc:276] 0619 19:53:59.231037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.232595 (+ 1558us) service_pool.cc:224] Handling call
0619 19:54:02.379326 (+3146731us) ts_tablet_manager.cc:1151] Deleting tablet aafe2a956b844c9998c84bbe52070e5d
0619 19:54:02.379348 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.455061 (+ 75713us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.459842 (+ 4781us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.481626 (+ 21784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408,"tablet-delete.queue_time_us":3136841}
I20260619 19:54:02.483386 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 45c0ffb4629a46349ccfe473cc20cdfc (table default.Table_f2b7aed4e720476cb97127ea1b58db50 [id=0178c0c89c424890aeaa1e2bd32ed94e]) successfully deleted
I20260619 19:54:02.483534 1973 tablet_replica.cc:333] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.483808 1973 raft_consensus.cc:2243] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.484170 528 catalog_manager.cc:6784] ReplaceTablet: tablet 9a4c335fc5ca4885b5482c6b749f76f9 deleted and replaced by tablet 32648df603ac442396922383ffbd2e31
I20260619 19:54:02.484324 1994 ts_tablet_manager.cc:1916] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.485678 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 32648df603ac442396922383ffbd2e31) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:02.488294 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_673a1e52cb85474ca009c9f232b8c7d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:02.489111 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_673a1e52cb85474ca009c9f232b8c7d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.490567 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4b57592fb6a44808bcc5312ccbae5c03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:02.491670 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a5448851752141fd8c235a5b5e2b43ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:02.492273 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5448851752141fd8c235a5b5e2b43ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.493789 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d29506dab4c84850ad79b8b7a0340987 (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]) successfully deleted
I20260619 19:54:02.461126 747 tablet_service.cc:1511] Processing CreateTablet for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (DEFAULT_TABLE table=default.Table_443e720ca25543829dd293413d08f95e [id=33e3d383660b422582a47dcb68ae6be7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.494436 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.495991 1994 ts_tablet_manager.cc:1929] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.496096 1994 log.cc:1199] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:54:02.496418 1994 ts_tablet_manager.cc:1950] T 5ea9f17d5e75499a8433fc9a3043a88e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.497323 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 50) took 3183 ms. Trace:
I20260619 19:54:02.497418 1994 rpcz_store.cc:276] 0619 19:53:59.313412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.313677 (+ 265us) service_pool.cc:224] Handling call
0619 19:54:02.480933 (+3167256us) ts_tablet_manager.cc:1151] Deleting tablet 5ea9f17d5e75499a8433fc9a3043a88e
0619 19:54:02.480945 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.487472 (+ 6527us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.495932 (+ 8460us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.497301 (+ 1369us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3167088}
I20260619 19:54:02.497759 1994 tablet_replica.cc:333] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.497929 1994 raft_consensus.cc:2243] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.498067 1994 raft_consensus.cc:2272] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.498545 1994 ts_tablet_manager.cc:1916] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.461419 760 tablet_service.cc:1511] Processing CreateTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 (DEFAULT_TABLE table=default.Table_f1436f5ff9b34985976f95675a904bc5 [id=83cf7db2f6054464813d2bc3c268af46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.499778 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1642bc8d3f984e1c9d60093fa7abcc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.500208 832 heartbeater.cc:499] Master 127.0.105.189:45849 was elected leader, sending a full tablet report...
I20260619 19:54:02.461519 749 tablet_service.cc:1511] Processing CreateTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.503423 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcc9c4167c58495fbfcf5fb60952c884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.461958 751 tablet_service.cc:1511] Processing CreateTablet for tablet 526af16b6a6a4cac9c084900b22d9acf (DEFAULT_TABLE table=default.Table_f7121ded2ddc495888c7d50e41b52b40 [id=a831bfed87194853b3982b43a6338c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.461963 757 tablet_service.cc:1511] Processing CreateTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 (DEFAULT_TABLE table=default.Table_cae61bfa5a3c4fa8b9eb4ab07b327be0 [id=050ce6b1eee349318da902df45aa205e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.504515 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fe4b37c74b4fb496f2842407c65eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.504688 1994 ts_tablet_manager.cc:1929] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.504786 1994 log.cc:1199] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/82d2dd6eedd24f44a6a17aceb20e62bb
I20260619 19:54:02.505093 1994 ts_tablet_manager.cc:1950] T 82d2dd6eedd24f44a6a17aceb20e62bb P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:02.506084 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet a16fdee448fb4975861b7cd46cbbc271 (table default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a16fdee448fb4975861b7cd46cbbc271 has no consensus state
I20260619 19:54:02.471727 755 tablet_service.cc:1511] Processing CreateTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 (DEFAULT_TABLE table=default.Table_122ef08337114140a4943c821d049ffb [id=b8f9efa202184597a36c5b4dcfa46084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.507454 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c5f9405d6a4a16bd49697001c201e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.509405 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 51) took 3195 ms. Trace:
I20260619 19:54:02.509521 1994 rpcz_store.cc:276] 0619 19:53:59.314039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.314082 (+ 43us) service_pool.cc:224] Handling call
0619 19:54:02.497709 (+3183627us) ts_tablet_manager.cc:1151] Deleting tablet 82d2dd6eedd24f44a6a17aceb20e62bb
0619 19:54:02.497718 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.501596 (+ 3878us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.504641 (+ 3045us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.509347 (+ 4706us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3183481}
I20260619 19:54:02.509974 1994 tablet_replica.cc:333] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.510155 1994 raft_consensus.cc:2243] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.510291 1994 raft_consensus.cc:2272] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.510782 1994 ts_tablet_manager.cc:1916] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.471983 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:02.472121 765 tablet_service.cc:1558] Processing DeleteTablet for tablet fe814880d9984bbd83fa121cb2a34eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:02.472153 752 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:02.471719 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e606b958d940c6a353a09a2eb627ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:02.494429 1973 raft_consensus.cc:2272] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.491883 783 raft_consensus.cc:1275] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260619 19:54:02.511925 1973 ts_tablet_manager.cc:1916] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.493048 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:02.459956 1208 ts_tablet_manager.cc:1434] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.522s user 0.002s sys 0.000s
W20260619 19:54:02.512224 1208 ts_tablet_manager.cc:1467] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Tablet startup took 574ms
W20260619 19:54:02.512358 1208 ts_tablet_manager.cc:1469] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Trace:
0619 19:53:54.090539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:54.090778 (+ 239us) service_pool.cc:224] Handling call
0619 19:53:54.091470 (+ 692us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:53:54.091502 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:53:54.154304 (+ 62802us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:54.298459 (+144155us) tablet_replica.cc:206] Creating consensus instance
0619 19:53:54.298618 (+ 159us) inbound_call.cc:177] Queueing success response
0619 19:54:01.907937 (+7609319us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0619 19:54:01.937576 (+ 29639us) ts_tablet_manager.cc:1435] Starting tablet replica
0619 19:54:01.937778 (+ 202us) tablet_replica.cc:261] Starting instrumentation
0619 19:54:01.937922 (+ 144us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":55,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"tablet-open.queue_time_us":7609357}
I20260619 19:54:02.513059 1208 tablet_bootstrap.cc:492] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:02.515897 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet aafe2a956b844c9998c84bbe52070e5d (table default.Table_06fee996690b44c3ad920d2090ceffa6 [id=129e814ff97d42f188d80f6418013bab]) successfully deleted
I20260619 19:54:02.516181 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 5ea9f17d5e75499a8433fc9a3043a88e (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]) successfully deleted
I20260619 19:54:02.516738 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 82d2dd6eedd24f44a6a17aceb20e62bb (table default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f [id=a35219ac89654132bd60088b911b7859]) successfully deleted
W20260619 19:54:02.516937 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b57592fb6a44808bcc5312ccbae5c03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.517149 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_326c1bc01d404daaa76ea5322feb651f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:02.517587 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a66ca1d30e274d2281b507485193b9b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:02.518783 1208 tablet_bootstrap.cc:654] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:02.519783 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a66ca1d30e274d2281b507485193b9b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:02.520210 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_326c1bc01d404daaa76ea5322feb651f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.519027 1994 ts_tablet_manager.cc:1929] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:02.521193 1994 log.cc:1199] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/e151dc97ad13456ba35708d50c9d7b26
I20260619 19:54:02.521570 1994 ts_tablet_manager.cc:1950] T e151dc97ad13456ba35708d50c9d7b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.522341 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 52) took 3208 ms. Trace:
I20260619 19:54:02.522485 1994 rpcz_store.cc:276] 0619 19:53:59.314358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.314396 (+ 38us) service_pool.cc:224] Handling call
0619 19:54:02.509930 (+3195534us) ts_tablet_manager.cc:1151] Deleting tablet e151dc97ad13456ba35708d50c9d7b26
0619 19:54:02.509940 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.516260 (+ 6320us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.518977 (+ 2717us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.522320 (+ 3343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3195371}
I20260619 19:54:02.523082 1994 tablet_replica.cc:333] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.523316 1994 raft_consensus.cc:2243] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.523599 1994 raft_consensus.cc:2272] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.523672 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet e151dc97ad13456ba35708d50c9d7b26 (table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]) successfully deleted
I20260619 19:54:02.524380 1994 ts_tablet_manager.cc:1916] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.528132 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526af16b6a6a4cac9c084900b22d9acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.529223 1208 tablet_bootstrap.cc:492] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:02.529408 1208 ts_tablet_manager.cc:1403] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260619 19:54:02.530130 1208 raft_consensus.cc:359] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.530401 1208 raft_consensus.cc:385] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.530496 1208 raft_consensus.cc:740] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.530697 1994 ts_tablet_manager.cc:1929] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.530764 1208 consensus_queue.cc:260] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.531045 1994 log.cc:1199] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9b08ab9ad59049919649b96890b6785d
I20260619 19:54:02.532478 1208 ts_tablet_manager.cc:1434] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260619 19:54:02.532810 1994 ts_tablet_manager.cc:1950] T 9b08ab9ad59049919649b96890b6785d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.533425 1208 tablet_bootstrap.cc:492] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:02.533594 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 53) took 3218 ms. Trace:
I20260619 19:54:02.533748 1994 rpcz_store.cc:276] 0619 19:53:59.314697 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.314737 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:02.523039 (+3208302us) ts_tablet_manager.cc:1151] Deleting tablet 9b08ab9ad59049919649b96890b6785d
0619 19:54:02.523048 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.527350 (+ 4302us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.530631 (+ 3281us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.533538 (+ 2907us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3208126}
I20260619 19:54:02.534250 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9b08ab9ad59049919649b96890b6785d (table default.Table_9b854aa69df5459692f816d4bdebc8cf [id=4e12ede134634d1a92d756ba9c4b3219]) successfully deleted
I20260619 19:54:02.534325 1994 tablet_replica.cc:333] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.534593 1994 raft_consensus.cc:2243] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.534969 1994 raft_consensus.cc:2272] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.535051 1208 tablet_bootstrap.cc:654] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:02.535224 759 consensus_meta.cc:287] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent flushing consensus metadata: real 0.601s user 0.002s sys 0.004s
I20260619 19:54:02.535670 1994 ts_tablet_manager.cc:1916] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.535812 1973 ts_tablet_manager.cc:1929] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.535921 1973 log.cc:1199] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/184d655694434b0bbfa178fcd3110405
I20260619 19:54:02.536119 2021 consensus_queue.cc:1048] T d27342783a5641d7a324e71183269308 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:02.536296 1973 ts_tablet_manager.cc:1950] T 184d655694434b0bbfa178fcd3110405 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.536558 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 62) took 3295 ms. Trace:
W20260619 19:54:02.537830 858 consensus_peers.cc:597] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a3fa43017fa4c278111c29d0d22f7da. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:02.538216 858 leader_election.cc:343] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 1d0fe0c67fe84e5b866fd2553ea26d91
I20260619 19:54:02.544443 1994 ts_tablet_manager.cc:1929] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.544688 1994 log.cc:1199] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:02.545113 1994 ts_tablet_manager.cc:1950] T 1a686826694b49b9bb5bcdefd61c9a15 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.545962 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 54) took 3230 ms. Trace:
I20260619 19:54:02.546108 1994 rpcz_store.cc:276] 0619 19:53:59.315070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.315120 (+ 50us) service_pool.cc:224] Handling call
0619 19:54:02.534242 (+3219122us) ts_tablet_manager.cc:1151] Deleting tablet 1a686826694b49b9bb5bcdefd61c9a15
0619 19:54:02.534252 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.539079 (+ 4827us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.544381 (+ 5302us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.545942 (+ 1561us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3218847}
I20260619 19:54:02.546582 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 1a686826694b49b9bb5bcdefd61c9a15 (table default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]) successfully deleted
I20260619 19:54:02.546782 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 55) took 3231 ms. Trace:
I20260619 19:54:02.546893 1994 rpcz_store.cc:276] 0619 19:53:59.315750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.315992 (+ 242us) service_pool.cc:224] Handling call
0619 19:54:02.546624 (+3230632us) ts_tablet_manager.cc:1151] Deleting tablet d8c889f13fbe49c3aab1e7f0d0d08e98
0619 19:54:02.546634 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.546765 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3230398}
I20260619 19:54:02.548954 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 32648df603ac442396922383ffbd2e31) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:02.549294 858 leader_election.cc:304] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.551111 2004 raft_consensus.cc:2749] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:02.552345 1201 tablet_bootstrap.cc:492] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:02.552719 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:02.552977 919 raft_consensus.cc:2393] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:02.554636 1201 ts_tablet_manager.cc:1403] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.468s user 0.006s sys 0.002s
I20260619 19:54:02.555476 1201 raft_consensus.cc:359] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.556473 1201 raft_consensus.cc:385] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.556592 1201 raft_consensus.cc:740] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.556691 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_28205fd1dd524e6b8aa7a105f1a9638f" } new_table_name: "default.Table_7960e324594b4ee68f9f29a77162cc92" modify_external_catalogs: true
I20260619 19:54:02.557694 1201 consensus_queue.cc:260] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.558271 1201 ts_tablet_manager.cc:1434] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:54:02.558681 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f45ecb22649c41cf875aa7f1b1e017b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:02.559401 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f45ecb22649c41cf875aa7f1b1e017b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:02.561661 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 5bae5be1340f4158a0b243415e232ae5 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:02.581121 1820 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 19:54:02.583953 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_92f5508aef334d42a58426bb75ba972a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:02.586627 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92f5508aef334d42a58426bb75ba972a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:02.548557 996 consensus_peers.cc:597] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33cfbae501de432cbcb34d2a6365f806. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.588474 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cb2d44091aa541459ddc23620b508b4e" } modify_external_catalogs: true
I20260619 19:54:02.588824 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cb2d44091aa541459ddc23620b508b4e" } modify_external_catalogs: true
I20260619 19:54:02.576107 1200 ts_tablet_manager.cc:1403] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.708s user 0.028s sys 0.015s
I20260619 19:54:02.590121 1200 raft_consensus.cc:359] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.590297 1200 raft_consensus.cc:385] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.590354 1200 raft_consensus.cc:740] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.590454 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_49472f6375c04623bbaba293eb98dd6f" } new_table_name: "default.Table_31cb74809b234f63acac36750deaf575" modify_external_catalogs: true
I20260619 19:54:02.590606 1200 consensus_queue.cc:260] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.591948 1200 ts_tablet_manager.cc:1434] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:02.592985 1200 tablet_bootstrap.cc:492] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:02.593541 1820 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 19:54:02.594115 1820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 19:54:02.594738 1200 tablet_bootstrap.cc:654] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.595736 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 56) took 3279 ms. Trace:
W20260619 19:54:02.595774 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 because the tablet was not found. No further retry: Not found: Tablet not found: d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:54:02.595825 1994 rpcz_store.cc:276] 0619 19:53:59.316426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.316477 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:02.595611 (+3279134us) ts_tablet_manager.cc:1151] Deleting tablet 46dcf2293e2d461ca1be171069867d1f
0619 19:54:02.595621 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.595719 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3278918}
W20260619 19:54:02.596213 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 46dcf2293e2d461ca1be171069867d1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46dcf2293e2d461ca1be171069867d1f already in progress: creating tablet
I20260619 19:54:02.596318 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 57) took 3279 ms. Trace:
I20260619 19:54:02.596385 1994 rpcz_store.cc:276] 0619 19:53:59.317156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.317220 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:02.596215 (+3278995us) ts_tablet_manager.cc:1151] Deleting tablet fbc952b283d94035be1f86f3b90382b6
0619 19:54:02.596225 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.596303 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3278779}
W20260619 19:54:02.596721 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fbc952b283d94035be1f86f3b90382b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbc952b283d94035be1f86f3b90382b6 already in progress: creating tablet
I20260619 19:54:02.597119 2026 ts_tablet_manager.cc:1929] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:02.597270 2026 log.cc:1199] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/0dd210e843db4f58a976af5c28dabc9c
I20260619 19:54:02.598055 2026 ts_tablet_manager.cc:1950] T 0dd210e843db4f58a976af5c28dabc9c P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:02.547073 719 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 50451.3us
I20260619 19:54:02.598304 1973 rpcz_store.cc:276] 0619 19:53:59.241109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.241355 (+ 246us) service_pool.cc:224] Handling call
0619 19:54:02.483383 (+3242028us) ts_tablet_manager.cc:1151] Deleting tablet 184d655694434b0bbfa178fcd3110405
0619 19:54:02.483394 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.515280 (+ 31886us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.535764 (+ 20484us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.536546 (+ 782us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3240730}
I20260619 19:54:02.598809 719 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.598969 1994 tablet_replica.cc:333] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.599038 2158 raft_consensus.cc:3060] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.599222 1994 raft_consensus.cc:2243] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:02.599243 719 consensus_peers.cc:597] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.599386 1994 raft_consensus.cc:2272] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.600061 1994 ts_tablet_manager.cc:1916] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.556564 1208 tablet_bootstrap.cc:492] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:02.600589 1208 ts_tablet_manager.cc:1403] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.001s
I20260619 19:54:02.601346 1208 raft_consensus.cc:359] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.601504 1208 raft_consensus.cc:385] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.601549 1208 raft_consensus.cc:740] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.601680 2158 raft_consensus.cc:2749] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:02.601724 1208 consensus_queue.cc:260] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.602372 1208 ts_tablet_manager.cc:1434] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:02.602881 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 32648df603ac442396922383ffbd2e31) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:02.567665 2160 raft_consensus.cc:493] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:02.603286 2160 raft_consensus.cc:515] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.603582 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:02.603647 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 184d655694434b0bbfa178fcd3110405 (table default.Table_30ac9e6bf2a947009c67072b853bcf4e [id=88b02ca24c9f4dc6bf751de7bed9499c]) successfully deleted
I20260619 19:54:02.603817 2160 leader_election.cc:290] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.603919 524 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d] alter complete (version 1)
I20260619 19:54:02.604391 1973 tablet_replica.cc:333] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.604574 1973 raft_consensus.cc:2243] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.604887 1973 raft_consensus.cc:2272] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.605434 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_30d978ee7d9b4a67bf40b0ccb4858574 [id=eb99724694ef457287a4d0d0a263a0b8] alter complete (version 3)
W20260619 19:54:02.606052 2224 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.209s user 0.001s sys 0.000s
W20260619 19:54:02.608083 858 leader_election.cc:343] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.608283 858 leader_election.cc:304] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.608959 1835 consensus_queue.cc:1048] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:02.609426 1835 raft_consensus.cc:2749] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:02.610713 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:02.611613 720 leader_election.cc:343] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:02.612202 996 consensus_peers.cc:597] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:02.612327 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 801f08f4daa842238460506ccd0c466f consensus state has no leader
I20260619 19:54:02.612810 1208 tablet_bootstrap.cc:492] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:02.613101 1994 ts_tablet_manager.cc:1929] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.613201 1994 log.cc:1199] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d4771739543f4b4189b7d603f76325f0
I20260619 19:54:02.613533 1994 ts_tablet_manager.cc:1950] T d4771739543f4b4189b7d603f76325f0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.614396 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c" } modify_external_catalogs: true
I20260619 19:54:02.614662 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c" } modify_external_catalogs: true
I20260619 19:54:02.616544 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:02.616812 918 raft_consensus.cc:2468] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:02.618921 1973 ts_tablet_manager.cc:1916] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.622107 2172 consensus_queue.cc:1048] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:02.623389 1201 tablet_bootstrap.cc:492] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:02.625420 1201 tablet_bootstrap.cc:654] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.629668 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 58) took 3312 ms. Trace:
I20260619 19:54:02.629789 1994 rpcz_store.cc:276] 0619 19:53:59.317627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.317672 (+ 45us) service_pool.cc:224] Handling call
0619 19:54:02.596705 (+3279033us) ts_tablet_manager.cc:1151] Deleting tablet d4771739543f4b4189b7d603f76325f0
0619 19:54:02.597055 (+ 350us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.605910 (+ 8855us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.612980 (+ 7070us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.629636 (+ 16656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3278860}
I20260619 19:54:02.630157 1994 tablet_replica.cc:333] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.630561 1994 raft_consensus.cc:2243] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.630882 1994 raft_consensus.cc:2272] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.631433 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 86) took 1778 ms. Trace:
I20260619 19:54:02.631994 2026 rpcz_store.cc:276] 0619 19:54:00.852999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.895635 (+ 42636us) service_pool.cc:224] Handling call
0619 19:54:02.355096 (+1459461us) ts_tablet_manager.cc:1151] Deleting tablet 0dd210e843db4f58a976af5c28dabc9c
0619 19:54:02.355107 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.568166 (+213059us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.597024 (+ 28858us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.631361 (+ 34337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1458721}
I20260619 19:54:02.632391 1994 ts_tablet_manager.cc:1916] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.632628 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_96b2c29bad4c4371b337dc4318ef79ff" } modify_external_catalogs: true
I20260619 19:54:02.632951 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_96b2c29bad4c4371b337dc4318ef79ff" } modify_external_catalogs: true
I20260619 19:54:02.633260 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d4771739543f4b4189b7d603f76325f0 (table default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]) successfully deleted
I20260619 19:54:02.619207 719 leader_election.cc:304] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.635161 2160 raft_consensus.cc:2804] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:02.635277 2160 raft_consensus.cc:493] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:02.635354 2160 raft_consensus.cc:3060] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.638866 2160 raft_consensus.cc:515] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.639676 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_93a36817c65c48b5b2e86a7b7a2937be" } modify_external_catalogs: true
I20260619 19:54:02.639925 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_93a36817c65c48b5b2e86a7b7a2937be" } modify_external_catalogs: true
I20260619 19:54:02.643720 1201 tablet_bootstrap.cc:492] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:02.643893 1201 ts_tablet_manager.cc:1403] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20260619 19:54:02.644682 1201 raft_consensus.cc:359] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.644872 1201 raft_consensus.cc:385] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.644963 1201 raft_consensus.cc:740] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.645174 1201 consensus_queue.cc:260] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.645732 1201 ts_tablet_manager.cc:1434] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:02.646060 1201 tablet_bootstrap.cc:492] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:02.648363 1201 tablet_bootstrap.cc:654] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.649808 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 0dd210e843db4f58a976af5c28dabc9c (table default.Table_4957c483382c45d7a305c7b4fd2ea6c8 [id=2daa177012434787b804b7721c3f91d2]) successfully deleted
I20260619 19:54:02.650426 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 89) took 1767 ms. Trace:
I20260619 19:54:02.650532 2026 rpcz_store.cc:276] 0619 19:54:00.882675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.898671 (+ 15996us) service_pool.cc:224] Handling call
0619 19:54:02.650234 (+1751563us) ts_tablet_manager.cc:1151] Deleting tablet 10f6e202e8fd4a7292774d5eb4c7266b
0619 19:54:02.650246 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.650375 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1751293}
W20260619 19:54:02.651051 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 10f6e202e8fd4a7292774d5eb4c7266b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6e202e8fd4a7292774d5eb4c7266b already in progress: creating tablet
I20260619 19:54:02.651392 2026 tablet_replica.cc:333] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:02.651578 2026 raft_consensus.cc:2243] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.651757 2026 raft_consensus.cc:2272] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.652267 2026 ts_tablet_manager.cc:1916] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.620200 1208 tablet_bootstrap.cc:654] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.655699 2224 tablet.cc:1724] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:02.670320 2160 leader_election.cc:290] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.670682 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:02.670909 919 raft_consensus.cc:3060] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.671271 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:54:02.671947 720 leader_election.cc:343] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.672838 1994 ts_tablet_manager.cc:1929] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.672936 1994 log.cc:1199] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b7adec89ed984837a8cf3544679ca617
I20260619 19:54:02.673261 1994 ts_tablet_manager.cc:1950] T b7adec89ed984837a8cf3544679ca617 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.673834 919 raft_consensus.cc:2468] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:02.674026 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 59) took 3356 ms. Trace:
I20260619 19:54:02.674106 1994 rpcz_store.cc:276] 0619 19:53:59.317995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.318037 (+ 42us) service_pool.cc:224] Handling call
0619 19:54:02.630104 (+3312067us) ts_tablet_manager.cc:1151] Deleting tablet b7adec89ed984837a8cf3544679ca617
0619 19:54:02.630116 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.648077 (+ 17961us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.672778 (+ 24701us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.674006 (+ 1228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3311910}
I20260619 19:54:02.674630 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b7adec89ed984837a8cf3544679ca617 (table default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]) successfully deleted
I20260619 19:54:02.674630 719 leader_election.cc:304] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:02.677240 2160 raft_consensus.cc:2804] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:02.677464 2160 raft_consensus.cc:697] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:02.677716 2160 consensus_queue.cc:237] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:02.691295 719 consensus_peers.cc:597] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:02.694334 859 consensus_peers.cc:597] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b08ab9ad59049919649b96890b6785d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.700546 1200 tablet_bootstrap.cc:492] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:02.700737 1200 ts_tablet_manager.cc:1403] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.008s
I20260619 19:54:02.701577 1200 raft_consensus.cc:359] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.701793 1200 raft_consensus.cc:385] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.701858 1200 raft_consensus.cc:740] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.702142 1200 consensus_queue.cc:260] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.702837 1200 ts_tablet_manager.cc:1434] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:02.704452 1200 tablet_bootstrap.cc:492] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:02.705843 1200 tablet_bootstrap.cc:654] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:02.707957 858 consensus_peers.cc:597] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d29506dab4c84850ad79b8b7a0340987. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:02.711932 859 consensus_peers.cc:597] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33935217c1f44ce0ad5b8610d368f2eb. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.713068 1973 ts_tablet_manager.cc:1929] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.713178 1973 log.cc:1199] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d97025f1e0634720bc68d0a6196bd20b
I20260619 19:54:02.713518 1973 ts_tablet_manager.cc:1950] T d97025f1e0634720bc68d0a6196bd20b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:02.713838 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 63) took 3472 ms. Trace:
I20260619 19:54:02.713927 1973 rpcz_store.cc:276] 0619 19:53:59.241763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.241824 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:02.598974 (+3357150us) ts_tablet_manager.cc:1151] Deleting tablet d97025f1e0634720bc68d0a6196bd20b
0619 19:54:02.603940 (+ 4966us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.709618 (+105678us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.713011 (+ 3393us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.713819 (+ 808us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3356229}
I20260619 19:54:02.714289 1973 tablet_replica.cc:333] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:02.714507 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d97025f1e0634720bc68d0a6196bd20b (table default.Table_31acb6e850e140b09225f0905b1a5d8c [id=d6c6c699115c4d7c8edbc8a1131ab5c9]) successfully deleted
I20260619 19:54:02.717692 1994 tablet_replica.cc:333] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.717976 1994 raft_consensus.cc:2243] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.718180 1994 raft_consensus.cc:2272] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:02.718839 858 consensus_peers.cc:597] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aafe2a956b844c9998c84bbe52070e5d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.719152 2004 raft_consensus.cc:493] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:02.719312 2004 raft_consensus.cc:515] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.719930 2004 leader_election.cc:290] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.720853 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8522f562665540ce99490ab90e02d801" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:02.721262 783 raft_consensus.cc:2468] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:02.721784 858 leader_election.cc:304] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:02.722429 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8522f562665540ce99490ab90e02d801" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:02.723088 859 leader_election.cc:343] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.723618 2004 raft_consensus.cc:2804] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:02.723711 2004 raft_consensus.cc:493] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:02.723802 2004 raft_consensus.cc:3060] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.725884 1994 ts_tablet_manager.cc:1916] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.727037 2004 raft_consensus.cc:515] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.728407 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8522f562665540ce99490ab90e02d801" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:02.728591 783 raft_consensus.cc:3060] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.731779 783 raft_consensus.cc:2468] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:02.732381 858 leader_election.cc:304] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:02.732764 2006 raft_consensus.cc:2804] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:02.732889 2006 raft_consensus.cc:697] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:02.733160 2006 consensus_queue.cc:237] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.735409 1200 tablet_bootstrap.cc:492] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:02.735558 1200 ts_tablet_manager.cc:1403] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.005s
I20260619 19:54:02.736475 1200 raft_consensus.cc:359] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.736667 1200 raft_consensus.cc:385] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.736735 1200 raft_consensus.cc:740] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.736997 1200 consensus_queue.cc:260] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.737589 1200 ts_tablet_manager.cc:1434] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260619 19:54:02.741135 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:44433, user_credentials={real_user=slave}} blocked reactor thread for 85945.3us
I20260619 19:54:02.745797 2004 leader_election.cc:290] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:02.767318 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8522f562665540ce99490ab90e02d801" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:54:02.768210 858 consensus_peers.cc:597] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.769385 1208 tablet_bootstrap.cc:492] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:02.769730 2114 raft_consensus.cc:493] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:02.769886 2114 raft_consensus.cc:515] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.770500 2114 leader_election.cc:290] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:02.770920 859 leader_election.cc:343] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.771742 1208 ts_tablet_manager.cc:1403] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.159s user 0.003s sys 0.007s
I20260619 19:54:02.772621 1208 raft_consensus.cc:359] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.772782 1208 raft_consensus.cc:385] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.773931 1201 tablet_bootstrap.cc:492] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:02.784013 2114 consensus_queue.cc:1048] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:02.796279 1201 ts_tablet_manager.cc:1403] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.150s user 0.004s sys 0.001s
I20260619 19:54:02.800177 1994 ts_tablet_manager.cc:1929] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.800305 1994 log.cc:1199] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9c379d780b294b9a863576f53f79ee7b
I20260619 19:54:02.800669 1994 ts_tablet_manager.cc:1950] T 9c379d780b294b9a863576f53f79ee7b P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.801461 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 60) took 3483 ms. Trace:
I20260619 19:54:02.801556 1994 rpcz_store.cc:276] 0619 19:53:59.318460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.318502 (+ 42us) service_pool.cc:224] Handling call
0619 19:54:02.717616 (+3399114us) ts_tablet_manager.cc:1151] Deleting tablet 9c379d780b294b9a863576f53f79ee7b
0619 19:54:02.717632 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.749640 (+ 32008us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.800107 (+ 50467us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.801440 (+ 1333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3398942}
I20260619 19:54:02.802073 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 48) took 3488 ms. Trace:
I20260619 19:54:02.802165 1994 rpcz_store.cc:276] 0619 19:53:59.313185 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.318907 (+ 5722us) service_pool.cc:224] Handling call
0619 19:54:02.801953 (+3483046us) ts_tablet_manager.cc:1151] Deleting tablet 0f32e1c7a27941ca9377901b19b32af3
0619 19:54:02.801962 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.802058 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3482811}
I20260619 19:54:02.802573 1994 tablet_replica.cc:333] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.802762 1994 raft_consensus.cc:2243] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.803081 1994 raft_consensus.cc:2272] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.803643 1994 ts_tablet_manager.cc:1916] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.805760 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9c379d780b294b9a863576f53f79ee7b (table default.Table_9c718229c76b4c2794a9bd5d5a26fc86 [id=e546025d2806485aa4b7d9ec209ab2d6]) successfully deleted
W20260619 19:54:02.806085 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0f32e1c7a27941ca9377901b19b32af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f32e1c7a27941ca9377901b19b32af3 already in progress: creating tablet
I20260619 19:54:02.816677 1201 raft_consensus.cc:359] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.816934 1201 raft_consensus.cc:385] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.817019 1201 raft_consensus.cc:740] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.779987 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:02.817349 918 raft_consensus.cc:2468] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:02.818312 2114 raft_consensus.cc:493] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:02.818269 1208 raft_consensus.cc:740] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.818471 2114 raft_consensus.cc:515] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.818578 1208 consensus_queue.cc:260] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.774205 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:02.807698 720 consensus_peers.cc:597] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c379d780b294b9a863576f53f79ee7b. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:02.819007 720 consensus_peers.cc:597] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4771739543f4b4189b7d603f76325f0. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.819085 2114 leader_election.cc:290] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:02.820145 996 leader_election.cc:343] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.819898 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:02.829308 1200 tablet_bootstrap.cc:492] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:02.841725 720 consensus_peers.cc:597] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:02.852808 1208 ts_tablet_manager.cc:1434] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20260619 19:54:02.853210 1208 tablet_bootstrap.cc:492] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:02.854559 1200 tablet_bootstrap.cc:654] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.854933 1208 tablet_bootstrap.cc:654] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.862090 996 leader_election.cc:304] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:02.862656 2114 raft_consensus.cc:2804] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:02.862743 2114 raft_consensus.cc:493] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:02.862838 2114 raft_consensus.cc:3060] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:02.865525 2114 raft_consensus.cc:515] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.866164 1201 consensus_queue.cc:260] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.866953 2114 leader_election.cc:290] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:02.867041 1201 ts_tablet_manager.cc:1434] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.051s user 0.002s sys 0.000s
I20260619 19:54:02.867085 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:02.867424 1201 tablet_bootstrap.cc:492] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:02.867743 996 leader_election.cc:343] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:02.871220 1994 ts_tablet_manager.cc:1929] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.875173 759 tablet_service.cc:1511] Processing CreateTablet for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 (DEFAULT_TABLE table=default.Table_1755ba072da64e428c5dece315b1543b [id=7370eb5e3dbe439aa632b217ba8b0ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.876017 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a6ffdcd55d4db6870fe032f72ab3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.880692 751 tablet_service.cc:1511] Processing CreateTablet for tablet b1bb4e51cce643fab695507af03800af (DEFAULT_TABLE table=default.Table_1491bf4decd34cceb722de0e75008614 [id=bcb64321d0b1417fb5435a52857a82f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.871778 1200 tablet_bootstrap.cc:492] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:02.881057 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb4e51cce643fab695507af03800af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.881078 1200 ts_tablet_manager.cc:1403] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260619 19:54:02.881774 1200 raft_consensus.cc:359] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.881924 1200 raft_consensus.cc:385] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:02.881968 1200 raft_consensus.cc:740] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:02.882170 1200 consensus_queue.cc:260] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:02.879782 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 (DEFAULT_TABLE table=default.Table_1755ba072da64e428c5dece315b1543b [id=7370eb5e3dbe439aa632b217ba8b0ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.882844 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a6ffdcd55d4db6870fe032f72ab3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.883873 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f (DEFAULT_TABLE table=default.Table_4c7cb900600a4a3187137ce27bd3a8cb [id=43c741b10edc48db8e677e14f41d68e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.884207 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.880141 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b1bb4e51cce643fab695507af03800af (DEFAULT_TABLE table=default.Table_1491bf4decd34cceb722de0e75008614 [id=bcb64321d0b1417fb5435a52857a82f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.887418 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 (DEFAULT_TABLE table=default.Table_cdf577f46fe04a03b5ee265415239167 [id=b4dcc2ac85a7493ba006481f2746cb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.887605 1994 log.cc:1199] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:54:02.887849 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a16fdee448fb4975861b7cd46cbbc271 (DEFAULT_TABLE table=default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.888032 1200 ts_tablet_manager.cc:1434] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260619 19:54:02.888626 1994 ts_tablet_manager.cc:1950] T 467bb41a4e9f46e497726c6b29ddeb04 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.888970 747 tablet_service.cc:1511] Processing CreateTablet for tablet a16fdee448fb4975861b7cd46cbbc271 (DEFAULT_TABLE table=default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.889007 757 tablet_service.cc:1511] Processing CreateTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f (DEFAULT_TABLE table=default.Table_4c7cb900600a4a3187137ce27bd3a8cb [id=43c741b10edc48db8e677e14f41d68e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.889381 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16fdee448fb4975861b7cd46cbbc271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.889600 760 tablet_service.cc:1511] Processing CreateTablet for tablet 904e20649a5f4c49a93bb084c1d3bb9a (DEFAULT_TABLE table=default.Table_34c184c3d7184b60af86c17cf2708721 [id=49ba0c73b4dd43d2888378a870bd0b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.889945 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904e20649a5f4c49a93bb084c1d3bb9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.889379 755 tablet_service.cc:1511] Processing CreateTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 (DEFAULT_TABLE table=default.Table_cdf577f46fe04a03b5ee265415239167 [id=b4dcc2ac85a7493ba006481f2746cb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.891538 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22e0f53008c4a96bf56b7f057f81cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.891558 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16fdee448fb4975861b7cd46cbbc271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.895473 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.895473 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb4e51cce643fab695507af03800af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.900063 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 61) took 3581 ms. Trace:
I20260619 19:54:02.900183 1994 rpcz_store.cc:276] 0619 19:53:59.318842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.329007 (+ 10165us) service_pool.cc:224] Handling call
0619 19:54:02.802531 (+3473524us) ts_tablet_manager.cc:1151] Deleting tablet 467bb41a4e9f46e497726c6b29ddeb04
0619 19:54:02.802540 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.846545 (+ 44005us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.871120 (+ 24575us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.900037 (+ 28917us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3473055}
I20260619 19:54:02.900604 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 62) took 3570 ms. Trace:
I20260619 19:54:02.900846 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 467bb41a4e9f46e497726c6b29ddeb04 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]) successfully deleted
I20260619 19:54:02.902446 747 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb5b67e240242e696f583cb9c00f610 (DEFAULT_TABLE table=default.Table_be05e3d01010443c87fa83b4acde4eed [id=e007ac03da10456aa7c9eafce34aad8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.902818 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb5b67e240242e696f583cb9c00f610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.900663 1994 rpcz_store.cc:276] 0619 19:53:59.330700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.330748 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:02.900473 (+3569725us) ts_tablet_manager.cc:1151] Deleting tablet 997cd0b5a8d24b56a2d5b95ab877d95f
0619 19:54:02.900482 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.900591 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3569257}
I20260619 19:54:02.907331 1994 tablet_replica.cc:333] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.907588 1994 raft_consensus.cc:2243] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.907986 1994 raft_consensus.cc:2272] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.908701 1994 ts_tablet_manager.cc:1916] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.901078 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 904e20649a5f4c49a93bb084c1d3bb9a (DEFAULT_TABLE table=default.Table_34c184c3d7184b60af86c17cf2708721 [id=49ba0c73b4dd43d2888378a870bd0b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.901280 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb5b67e240242e696f583cb9c00f610 (DEFAULT_TABLE table=default.Table_be05e3d01010443c87fa83b4acde4eed [id=e007ac03da10456aa7c9eafce34aad8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.902261 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22e0f53008c4a96bf56b7f057f81cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.909705 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb5b67e240242e696f583cb9c00f610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.906340 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 198bde101e7b4eeeb8de58aebe208bb4 (DEFAULT_TABLE table=default.Table_53c4ff46dfa649b29c6dfe8e8af85a17 [id=b050d865cd52491c97d748c78f0c83a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.910120 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198bde101e7b4eeeb8de58aebe208bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.915727 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904e20649a5f4c49a93bb084c1d3bb9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.902035 1200 tablet_bootstrap.cc:492] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:02.921108 1200 tablet_bootstrap.cc:654] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:02.922394 748 tablet_service.cc:1511] Processing CreateTablet for tablet 198bde101e7b4eeeb8de58aebe208bb4 (DEFAULT_TABLE table=default.Table_53c4ff46dfa649b29c6dfe8e8af85a17 [id=b050d865cd52491c97d748c78f0c83a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.922845 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198bde101e7b4eeeb8de58aebe208bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.923365 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d2156cf3d7664ffc9b4b3f47fa750226 (DEFAULT_TABLE table=default.Table_5916dd401c144d7f9c23431c595e9ba8 [id=a49e4ca2e6134adca61585683b8f3be2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.923753 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2156cf3d7664ffc9b4b3f47fa750226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.922394 752 tablet_service.cc:1511] Processing CreateTablet for tablet e68808ad4f64475782f8fba579fdb8bd (DEFAULT_TABLE table=default.Table_3a52ed0a914a41d39dbd362b643ed5f2 [id=2e1136eb711a4f9f878880e84e98d610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.927795 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68808ad4f64475782f8fba579fdb8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.928246 747 tablet_service.cc:1511] Processing CreateTablet for tablet d2156cf3d7664ffc9b4b3f47fa750226 (DEFAULT_TABLE table=default.Table_5916dd401c144d7f9c23431c595e9ba8 [id=a49e4ca2e6134adca61585683b8f3be2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.928318 765 tablet_service.cc:1511] Processing CreateTablet for tablet 61adf222e10c490c9c8dd6f83edc1643 (DEFAULT_TABLE table=default.Table_a0283e721db2406c8c1a487f6cab6f46 [id=97b96e6c0f164ede83066539b1713846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.928596 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2156cf3d7664ffc9b4b3f47fa750226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.928828 746 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca68b755bf841509b6ffcfbe212278c (DEFAULT_TABLE table=default.Table_e01bf9476bef42e98a895c3e39d404e4 [id=87db50e1076b4212af1fc304e627f24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.929111 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca68b755bf841509b6ffcfbe212278c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.931293 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61adf222e10c490c9c8dd6f83edc1643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.934453 1994 ts_tablet_manager.cc:1929] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:02.934562 1994 log.cc:1199] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/2d1b7b743e594e2aaeaeedd8613d9789
I20260619 19:54:02.934926 1994 ts_tablet_manager.cc:1950] T 2d1b7b743e594e2aaeaeedd8613d9789 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:02.936239 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c3780418b3854889868cf428b2800ab0 (DEFAULT_TABLE table=default.Table_22aa0ecb6e6d4d81b2b7143514b03ea8 [id=9dd2dfcd472344d3bd3fdbec630c95d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.936288 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2a8462edb54df2aa0343ecea6dd761 (DEFAULT_TABLE table=default.Table_f011ebcb383f4f73a1766d0990ac9197 [id=1c8c18675ec84713a63c669793132a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.936681 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3780418b3854889868cf428b2800ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.939261 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 63) took 3607 ms. Trace:
I20260619 19:54:02.939363 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a8462edb54df2aa0343ecea6dd761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.936199 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca68b755bf841509b6ffcfbe212278c (DEFAULT_TABLE table=default.Table_e01bf9476bef42e98a895c3e39d404e4 [id=87db50e1076b4212af1fc304e627f24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.939690 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca68b755bf841509b6ffcfbe212278c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.940218 749 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2a8462edb54df2aa0343ecea6dd761 (DEFAULT_TABLE table=default.Table_f011ebcb383f4f73a1766d0990ac9197 [id=1c8c18675ec84713a63c669793132a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.940500 763 tablet_service.cc:1511] Processing CreateTablet for tablet b57f64f97cdc493ea48e08d897bfc982 (DEFAULT_TABLE table=default.Table_4987fd27300444088d5b028d1285b62b [id=58c2cec4d9c34409aeeaa6d738304543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.940609 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a8462edb54df2aa0343ecea6dd761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.940819 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57f64f97cdc493ea48e08d897bfc982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.940229 761 tablet_service.cc:1511] Processing CreateTablet for tablet c3780418b3854889868cf428b2800ab0 (DEFAULT_TABLE table=default.Table_22aa0ecb6e6d4d81b2b7143514b03ea8 [id=9dd2dfcd472344d3bd3fdbec630c95d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.941468 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3780418b3854889868cf428b2800ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.944121 758 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf769db8f5d45bf9c409876322350b3 (DEFAULT_TABLE table=default.Table_d758bed342d14223ac00095546093692 [id=478d3b8b08c348898767fbf372341f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.944449 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf769db8f5d45bf9c409876322350b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.947889 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf769db8f5d45bf9c409876322350b3 (DEFAULT_TABLE table=default.Table_d758bed342d14223ac00095546093692 [id=478d3b8b08c348898767fbf372341f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.948329 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf769db8f5d45bf9c409876322350b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.952708 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b57f64f97cdc493ea48e08d897bfc982 (DEFAULT_TABLE table=default.Table_4987fd27300444088d5b028d1285b62b [id=58c2cec4d9c34409aeeaa6d738304543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.953147 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57f64f97cdc493ea48e08d897bfc982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.958099 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e68808ad4f64475782f8fba579fdb8bd (DEFAULT_TABLE table=default.Table_3a52ed0a914a41d39dbd362b643ed5f2 [id=2e1136eb711a4f9f878880e84e98d610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.958529 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68808ad4f64475782f8fba579fdb8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.970337 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 61adf222e10c490c9c8dd6f83edc1643 (DEFAULT_TABLE table=default.Table_a0283e721db2406c8c1a487f6cab6f46 [id=97b96e6c0f164ede83066539b1713846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.970853 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61adf222e10c490c9c8dd6f83edc1643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.975219 1973 raft_consensus.cc:2243] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:02.975642 1973 pending_rounds.cc:70] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:02.975709 1973 pending_rounds.cc:77] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7298657653766238208 op_type: NO_OP noop_request { }
I20260619 19:54:02.975826 1973 raft_consensus.cc:2889] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:02.975919 1973 raft_consensus.cc:2272] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.977025 1973 ts_tablet_manager.cc:1916] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.939374 1994 rpcz_store.cc:276] 0619 19:53:59.331535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.331596 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:02.907266 (+3575670us) ts_tablet_manager.cc:1151] Deleting tablet 2d1b7b743e594e2aaeaeedd8613d9789
0619 19:54:02.907281 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.919249 (+ 11968us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.934392 (+ 15143us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:02.939240 (+ 4848us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3575376}
I20260619 19:54:02.977919 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 2d1b7b743e594e2aaeaeedd8613d9789 (table default.Table_e628fda622264f3eb2fdbfbffbf213cc [id=6db61c680af2412f8943d8fb98e9e7fd]) successfully deleted
I20260619 19:54:02.982940 1994 tablet_replica.cc:333] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:02.984634 1994 raft_consensus.cc:2243] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:02.984702 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2718b9619524430388f0760485d8e4be (DEFAULT_TABLE table=default.Table_cfd604dcc65a4500b9c0785d9ae2a562 [id=9c17546b17914c499303f91334af8232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.986490 1994 raft_consensus.cc:2272] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:02.986805 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2718b9619524430388f0760485d8e4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.987272 1994 ts_tablet_manager.cc:1916] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:02.992969 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2718b9619524430388f0760485d8e4be (DEFAULT_TABLE table=default.Table_cfd604dcc65a4500b9c0785d9ae2a562 [id=9c17546b17914c499303f91334af8232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.994788 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 788550efad2f4dbc917131cff1e76f09 (DEFAULT_TABLE table=default.Table_6920393f5922435bbf9c6a6a1a16dff2 [id=c1382da014f14094b6678d7774d12fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.995317 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788550efad2f4dbc917131cff1e76f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:02.997354 758 tablet_service.cc:1511] Processing CreateTablet for tablet 788550efad2f4dbc917131cff1e76f09 (DEFAULT_TABLE table=default.Table_6920393f5922435bbf9c6a6a1a16dff2 [id=c1382da014f14094b6678d7774d12fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:02.998994 1208 tablet_bootstrap.cc:492] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:03.002059 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 0a39b06bad874a5d8c945c27c3552d43 (DEFAULT_TABLE table=default.Table_a5d67c87b793425982fdfaddadd3b827 [id=b1eb763e7d5b46d59c93910b686d06a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.002665 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a39b06bad874a5d8c945c27c3552d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.003291 1208 ts_tablet_manager.cc:1403] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.150s user 0.003s sys 0.000s
I20260619 19:54:03.004285 1208 raft_consensus.cc:359] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.004573 1208 raft_consensus.cc:385] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.004698 1208 raft_consensus.cc:740] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.005077 1208 consensus_queue.cc:260] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.011693 751 tablet_service.cc:1511] Processing CreateTablet for tablet 0a39b06bad874a5d8c945c27c3552d43 (DEFAULT_TABLE table=default.Table_a5d67c87b793425982fdfaddadd3b827 [id=b1eb763e7d5b46d59c93910b686d06a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.015254 2114 consensus_queue.cc:1048] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:03.020478 1038 tablet_service.cc:1511] Processing CreateTablet for tablet f96563f57f844df4814397f76ec42007 (DEFAULT_TABLE table=default.Table_b0a31efd94754d3f8883825db473e0fd [id=cbc6cd22a6cd47cea42449b8ceb0ce45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.021356 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96563f57f844df4814397f76ec42007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.021530 760 tablet_service.cc:1511] Processing CreateTablet for tablet f96563f57f844df4814397f76ec42007 (DEFAULT_TABLE table=default.Table_b0a31efd94754d3f8883825db473e0fd [id=cbc6cd22a6cd47cea42449b8ceb0ce45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.023795 746 tablet_service.cc:1511] Processing CreateTablet for tablet 910cf00e57404f1097800e84a2070b26 (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.024708 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19d6333b0c8940b2802307d0da8a57ac" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.025045 920 raft_consensus.cc:2393] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:03.029882 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 910cf00e57404f1097800e84a2070b26 (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.030328 1200 tablet_bootstrap.cc:492] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:03.030556 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910cf00e57404f1097800e84a2070b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.031968 1200 ts_tablet_manager.cc:1403] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.130s user 0.004s sys 0.010s
I20260619 19:54:03.032662 1200 raft_consensus.cc:359] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.032841 1200 raft_consensus.cc:385] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.032896 1200 raft_consensus.cc:740] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.034696 900 tablet_service.cc:1511] Processing CreateTablet for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 (DEFAULT_TABLE table=default.Table_1755ba072da64e428c5dece315b1543b [id=7370eb5e3dbe439aa632b217ba8b0ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.036507 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2718b9619524430388f0760485d8e4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.036988 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788550efad2f4dbc917131cff1e76f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.042160 2269 raft_consensus.cc:493] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:03.042347 2269 raft_consensus.cc:515] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.043097 2269 leader_election.cc:290] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.043335 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910cf00e57404f1097800e84a2070b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.044036 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a39b06bad874a5d8c945c27c3552d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.044313 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a6ffdcd55d4db6870fe032f72ab3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.044590 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96563f57f844df4814397f76ec42007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.047417 2026 ts_tablet_manager.cc:1929] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:03.047629 2026 log.cc:1199] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/2448429656934063887b63d9a6e79894
I20260619 19:54:03.048121 2026 ts_tablet_manager.cc:1950] T 2448429656934063887b63d9a6e79894 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:03.049067 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 90) took 2044 ms. Trace:
I20260619 19:54:03.049211 2026 rpcz_store.cc:276] 0619 19:54:01.004162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.004229 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:02.651313 (+1647084us) ts_tablet_manager.cc:1151] Deleting tablet 2448429656934063887b63d9a6e79894
0619 19:54:02.651322 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.770741 (+119419us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.038183 (+267442us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.049023 (+ 10840us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1646874}
I20260619 19:54:03.049744 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 91) took 2035 ms. Trace:
I20260619 19:54:03.049871 2026 rpcz_store.cc:276] 0619 19:54:01.014396 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.014619 (+ 223us) service_pool.cc:224] Handling call
0619 19:54:03.049585 (+2034966us) ts_tablet_manager.cc:1151] Deleting tablet d895be304fcf445e9a4d2d8242becdd5
0619 19:54:03.049596 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.049712 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2034600}
I20260619 19:54:03.050247 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 92) took 2035 ms. Trace:
I20260619 19:54:03.050354 2026 rpcz_store.cc:276] 0619 19:54:01.014556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.015042 (+ 486us) service_pool.cc:224] Handling call
0619 19:54:03.050122 (+2035080us) ts_tablet_manager.cc:1151] Deleting tablet 9f6ec149e1ac475f8038b328dae4af2a
0619 19:54:03.050131 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.050215 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2034801}
I20260619 19:54:03.050625 2026 tablet_replica.cc:333] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:03.050853 2026 raft_consensus.cc:2243] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
W20260619 19:54:03.051514 859 leader_election.cc:343] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 376dfca0b54d4c689c96242566869717
I20260619 19:54:03.054993 891 tablet_service.cc:1511] Processing CreateTablet for tablet b1bb4e51cce643fab695507af03800af (DEFAULT_TABLE table=default.Table_1491bf4decd34cceb722de0e75008614 [id=bcb64321d0b1417fb5435a52857a82f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.058660 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:03.058885 918 raft_consensus.cc:3060] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.059748 1973 ts_tablet_manager.cc:1929] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260619 19:54:03.059868 1973 log.cc:1199] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/1bc12bcf50074b46860899a82dc0b46e
I20260619 19:54:03.063998 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 0d32f01411e541a987c0b5902528489b (DEFAULT_TABLE table=default.Table_5930f363db7a44459de1c9115c4051b3 [id=7d73b73b575e487c8ce95074a4b108d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.064319 996 leader_election.cc:304] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:03.064374 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_a3301c06d179435588fe6dbab182fe11 [id=40a213ef1b0f46da8419637e4d118218]). Expected version 1 got 0
I20260619 19:54:03.064839 2172 raft_consensus.cc:3060] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.065052 2021 consensus_queue.cc:1048] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:03.066021 1200 consensus_queue.cc:260] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.066540 1200 ts_tablet_manager.cc:1434] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.034s user 0.001s sys 0.000s
I20260619 19:54:03.067170 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:03.067497 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a54231986cca44258942dbc3373870b2 (table default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]). Expected version 1 got 0
I20260619 19:54:03.067651 886 tablet_service.cc:1511] Processing CreateTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f (DEFAULT_TABLE table=default.Table_4c7cb900600a4a3187137ce27bd3a8cb [id=43c741b10edc48db8e677e14f41d68e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.067813 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 1 got 0
I20260619 19:54:03.068068 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 1 got 0
I20260619 19:54:03.068416 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_9e763837fe2d46c9b0f859d4e159a2af [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 1 got 0
I20260619 19:54:03.068606 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:03.068771 2172 raft_consensus.cc:2749] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:03.068967 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 2 got 0
I20260619 19:54:03.069115 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_dc77e7b8f63e4fe4924fdae4421075e9 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 2 got 0
I20260619 19:54:03.064851 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d32f01411e541a987c0b5902528489b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.069504 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:03.069706 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_83bb8d4286d24179baa0a9b7155f15d7 [id=ff393d500bb34f318889666cc5650292]). Expected version 1 got 0
I20260619 19:54:03.069903 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:03.069914 892 tablet_service.cc:1511] Processing CreateTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 (DEFAULT_TABLE table=default.Table_cdf577f46fe04a03b5ee265415239167 [id=b4dcc2ac85a7493ba006481f2746cb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.070122 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:54:03.070334 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:03.070638 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:03.070657 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bb4e51cce643fab695507af03800af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.071117 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:03.071731 894 tablet_service.cc:1511] Processing CreateTablet for tablet a16fdee448fb4975861b7cd46cbbc271 (DEFAULT_TABLE table=default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.071971 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:03.072188 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.072283 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]). Expected version 1 got 0
I20260619 19:54:03.072955 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:54:03.073308 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_31cb74809b234f63acac36750deaf575 [id=8d6402c45a4d4456935a213be45b3c51]). Expected version 1 got 0
I20260619 19:54:03.073916 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:03.074185 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:03.074370 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:03.074600 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:03.074788 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]). Expected version 1 got 0
I20260619 19:54:03.075035 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:54:03.075263 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:03.075636 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_94d5b0a1504044b7a1934b5c726b29d4 [id=96dda797fa474e119e765b5d9946bfb7]). Expected version 2 got 1
I20260619 19:54:03.076062 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:03.076401 527 catalog_manager.cc:5696] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:03.076896 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 3 got 0
I20260619 19:54:03.077648 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 59123a56731645e1bbfcc94b2a46b1d6 (table default.Table_2e8d0d77f8d24996b929a3d034b24a0c [id=8eedaa1e27904cadb0b52ab19f4c43ff]). Expected version 1 got 0
I20260619 19:54:03.078087 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a (DEFAULT_TABLE table=default.Table_88bb3e27be5d41d19ecce9b1881cdb1b [id=7ea73c05d7e54bfe8f3c2acc34670ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.078786 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.079412 889 tablet_service.cc:1511] Processing CreateTablet for tablet e68808ad4f64475782f8fba579fdb8bd (DEFAULT_TABLE table=default.Table_3a52ed0a914a41d39dbd362b643ed5f2 [id=2e1136eb711a4f9f878880e84e98d610]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.080287 1200 tablet_bootstrap.cc:492] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:03.081771 897 tablet_service.cc:1511] Processing CreateTablet for tablet d2156cf3d7664ffc9b4b3f47fa750226 (DEFAULT_TABLE table=default.Table_5916dd401c144d7f9c23431c595e9ba8 [id=a49e4ca2e6134adca61585683b8f3be2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.078785 1994 ts_tablet_manager.cc:1929] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.082036 1200 tablet_bootstrap.cc:654] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:03.082103 1994 log.cc:1199] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/5bae5be1340f4158a0b243415e232ae5
I20260619 19:54:03.082321 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca68b755bf841509b6ffcfbe212278c (DEFAULT_TABLE table=default.Table_e01bf9476bef42e98a895c3e39d404e4 [id=87db50e1076b4212af1fc304e627f24b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.082778 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb5b67e240242e696f583cb9c00f610 (DEFAULT_TABLE table=default.Table_be05e3d01010443c87fa83b4acde4eed [id=e007ac03da10456aa7c9eafce34aad8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.083168 888 tablet_service.cc:1511] Processing CreateTablet for tablet 198bde101e7b4eeeb8de58aebe208bb4 (DEFAULT_TABLE table=default.Table_53c4ff46dfa649b29c6dfe8e8af85a17 [id=b050d865cd52491c97d748c78f0c83a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.083441 902 tablet_service.cc:1511] Processing CreateTablet for tablet 61adf222e10c490c9c8dd6f83edc1643 (DEFAULT_TABLE table=default.Table_a0283e721db2406c8c1a487f6cab6f46 [id=97b96e6c0f164ede83066539b1713846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.083585 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 10c73b679e394f31b9e5d51681e06976 (DEFAULT_TABLE table=default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.083684 885 tablet_service.cc:1511] Processing CreateTablet for tablet 904e20649a5f4c49a93bb084c1d3bb9a (DEFAULT_TABLE table=default.Table_34c184c3d7184b60af86c17cf2708721 [id=49ba0c73b4dd43d2888378a870bd0b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.083946 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c73b679e394f31b9e5d51681e06976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.083985 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16fdee448fb4975861b7cd46cbbc271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.078624 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]). Expected version 2 got 0
I20260619 19:54:03.085341 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:03.085821 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_2d0ef958689042fdaa6588675b99b3ec [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 1 got 0
I20260619 19:54:03.085881 1973 ts_tablet_manager.cc:1950] T 1bc12bcf50074b46860899a82dc0b46e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.086735 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 58) took 3849 ms. Trace:
I20260619 19:54:03.086839 1973 rpcz_store.cc:276] 0619 19:53:59.237067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.237478 (+ 411us) service_pool.cc:224] Handling call
0619 19:54:02.714240 (+3476762us) ts_tablet_manager.cc:1151] Deleting tablet 1bc12bcf50074b46860899a82dc0b46e
0619 19:54:02.714248 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:02.975511 (+261263us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x6160001b3154. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1e07e0 00007eff4e52c933 00007eff510efae7 00007eff51122bb4 00007eff511035d0 00007eff5110335d 0000000000aa681c 00007eff411809ff 00007eff41183d1b 00007eff41183b98
0619 19:54:03.036091 (+ 60580us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.059694 (+ 23603us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.086710 (+ 27016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599538560,"tablet-delete.queue_time_us":3471139}
I20260619 19:54:03.088663 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61adf222e10c490c9c8dd6f83edc1643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.090139 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 1bc12bcf50074b46860899a82dc0b46e (table default.Table_6f48937efc8f41559b9dc1c81380c1cd [id=9d332d034c5d424f92ca51559775be6f]) successfully deleted
I20260619 19:54:03.090507 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 60) took 3853 ms. Trace:
I20260619 19:54:03.090597 1973 rpcz_store.cc:276] 0619 19:53:59.237356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.237537 (+ 181us) service_pool.cc:224] Handling call
0619 19:54:03.088793 (+3851256us) ts_tablet_manager.cc:1151] Deleting tablet 0f32e1c7a27941ca9377901b19b32af3
0619 19:54:03.088802 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.090481 (+ 1679us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3845503}
I20260619 19:54:03.090910 1973 tablet_replica.cc:333] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.091101 1973 raft_consensus.cc:2243] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.091307 1973 raft_consensus.cc:2272] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.091931 1973 ts_tablet_manager.cc:1916] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.100000 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb5b67e240242e696f583cb9c00f610. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.100203 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0f32e1c7a27941ca9377901b19b32af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f32e1c7a27941ca9377901b19b32af3 already in progress: creating tablet
I20260619 19:54:03.100705 761 tablet_service.cc:1511] Processing CreateTablet for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a (DEFAULT_TABLE table=default.Table_88bb3e27be5d41d19ecce9b1881cdb1b [id=7ea73c05d7e54bfe8f3c2acc34670ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.101197 746 tablet_service.cc:1511] Processing CreateTablet for tablet 0d32f01411e541a987c0b5902528489b (DEFAULT_TABLE table=default.Table_5930f363db7a44459de1c9115c4051b3 [id=7d73b73b575e487c8ce95074a4b108d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.101608 1208 ts_tablet_manager.cc:1434] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.098s user 0.001s sys 0.001s
I20260619 19:54:03.101555 899 tablet_service.cc:1511] Processing CreateTablet for tablet c3780418b3854889868cf428b2800ab0 (DEFAULT_TABLE table=default.Table_22aa0ecb6e6d4d81b2b7143514b03ea8 [id=9dd2dfcd472344d3bd3fdbec630c95d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.101840 884 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2a8462edb54df2aa0343ecea6dd761 (DEFAULT_TABLE table=default.Table_f011ebcb383f4f73a1766d0990ac9197 [id=1c8c18675ec84713a63c669793132a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.111835 2273 raft_consensus.cc:493] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:03.113858 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.120440 2253 tablet.cc:1724] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:03.124059 2026 raft_consensus.cc:2272] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.126976 1973 ts_tablet_manager.cc:1929] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.127110 1973 log.cc:1199] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fd9c959792fa48e89b669520f7332b26
I20260619 19:54:03.127619 1973 ts_tablet_manager.cc:1950] T fd9c959792fa48e89b669520f7332b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.128786 887 tablet_service.cc:1511] Processing CreateTablet for tablet b57f64f97cdc493ea48e08d897bfc982 (DEFAULT_TABLE table=default.Table_4987fd27300444088d5b028d1285b62b [id=58c2cec4d9c34409aeeaa6d738304543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.129766 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2718b9619524430388f0760485d8e4be (DEFAULT_TABLE table=default.Table_cfd604dcc65a4500b9c0785d9ae2a562 [id=9c17546b17914c499303f91334af8232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.130227 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf769db8f5d45bf9c409876322350b3 (DEFAULT_TABLE table=default.Table_d758bed342d14223ac00095546093692 [id=478d3b8b08c348898767fbf372341f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.134092 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 66) took 3883 ms. Trace:
I20260619 19:54:03.134325 2272 raft_consensus.cc:493] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.134231 1973 rpcz_store.cc:276] 0619 19:53:59.250543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.250591 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:03.090846 (+3840255us) ts_tablet_manager.cc:1151] Deleting tablet fd9c959792fa48e89b669520f7332b26
0619 19:54:03.090858 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.116210 (+ 25352us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.126912 (+ 10702us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.134063 (+ 7151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3839384}
I20260619 19:54:03.134779 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fd9c959792fa48e89b669520f7332b26 (table default.Table_d11dd25ca82141b79681a23f91d8fcb0 [id=0cb3b7f319a34662a7b8c13ecc98d360]) successfully deleted
I20260619 19:54:03.135692 1208 tablet_bootstrap.cc:492] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:03.112038 2273 raft_consensus.cc:515] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.136281 1973 tablet_replica.cc:333] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.137632 1973 raft_consensus.cc:2243] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.137954 1973 raft_consensus.cc:2272] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.139338 1973 ts_tablet_manager.cc:1916] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.141213 1994 ts_tablet_manager.cc:1950] T 5bae5be1340f4158a0b243415e232ae5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:03.142282 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 64) took 3803 ms. Trace:
I20260619 19:54:03.142446 1994 rpcz_store.cc:276] 0619 19:53:59.338850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.338923 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:02.982853 (+3643930us) ts_tablet_manager.cc:1151] Deleting tablet 5bae5be1340f4158a0b243415e232ae5
0619 19:54:02.982867 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.016935 (+ 34068us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.078725 (+ 61790us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.142255 (+ 63530us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3643607}
I20260619 19:54:03.143181 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 5bae5be1340f4158a0b243415e232ae5 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]) successfully deleted
I20260619 19:54:03.143627 1994 tablet_replica.cc:333] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:03.144124 1994 raft_consensus.cc:2243] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.144487 1994 raft_consensus.cc:2272] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.150826 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198bde101e7b4eeeb8de58aebe208bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.153077 747 tablet_service.cc:1511] Processing CreateTablet for tablet 10c73b679e394f31b9e5d51681e06976 (DEFAULT_TABLE table=default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.154968 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_a3301c06d179435588fe6dbab182fe11 [id=40a213ef1b0f46da8419637e4d118218]). Expected version 1 got 0
I20260619 19:54:03.156263 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:03.156505 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d32f01411e541a987c0b5902528489b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.156910 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c73b679e394f31b9e5d51681e06976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.163864 1973 ts_tablet_manager.cc:1929] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.163995 1973 log.cc:1199] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:54:03.164338 1973 ts_tablet_manager.cc:1950] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.164649 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 64) took 3916 ms. Trace:
I20260619 19:54:03.164733 1973 rpcz_store.cc:276] 0619 19:53:59.248464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.248563 (+ 99us) service_pool.cc:224] Handling call
0619 19:54:03.136217 (+3887654us) ts_tablet_manager.cc:1151] Deleting tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc
0619 19:54:03.136229 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.160399 (+ 24170us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.163819 (+ 3420us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.164634 (+ 815us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3884585}
I20260619 19:54:03.165186 1973 tablet_replica.cc:333] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.165190 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc (table default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]) successfully deleted
I20260619 19:54:03.165364 1973 raft_consensus.cc:2243] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.165628 1973 raft_consensus.cc:2272] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.166155 1973 ts_tablet_manager.cc:1916] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.168592 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_133d7ea5230b46b39f99d27ceeef20c8 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 1 got 0
I20260619 19:54:03.169680 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]). Expected version 1 got 0
I20260619 19:54:03.170050 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]). Expected version 2 got 0
I20260619 19:54:03.171351 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:03.173739 1208 tablet_bootstrap.cc:654] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:03.173883 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_7810442fe18f4992bc31a9edf87d2438 [id=daffb1c409b74c799628ced1c9be2520]). Expected version 1 got 0
I20260619 19:54:03.134487 2272 raft_consensus.cc:515] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.174615 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]). Expected version 1 got 0
I20260619 19:54:03.177448 1973 ts_tablet_manager.cc:1929] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.177731 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:03.177940 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:03.179342 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:03.180022 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:03.180619 1973 log.cc:1199] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:03.180409 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_2d0ef958689042fdaa6588675b99b3ec [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 1 got 0
I20260619 19:54:03.181221 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:03.181710 1973 ts_tablet_manager.cc:1950] T ecbe466eee2f43359181a1d26d6e761e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.182060 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 65) took 3931 ms. Trace:
I20260619 19:54:03.182363 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_31cb74809b234f63acac36750deaf575 [id=8d6402c45a4d4456935a213be45b3c51]). Expected version 1 got 0
I20260619 19:54:03.182832 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:03.182991 1973 rpcz_store.cc:276] 0619 19:53:59.250310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.250416 (+ 106us) service_pool.cc:224] Handling call
0619 19:54:03.165142 (+3914726us) ts_tablet_manager.cc:1151] Deleting tablet ecbe466eee2f43359181a1d26d6e761e
0619 19:54:03.165151 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.172669 (+ 7518us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.177392 (+ 4723us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.182043 (+ 4651us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3913130}
W20260619 19:54:03.183983 858 leader_election.cc:343] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 376dfca0b54d4c689c96242566869717
I20260619 19:54:03.184496 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet ecbe466eee2f43359181a1d26d6e761e (table default.Table_2a0e967a9ab24a16b767629e2c9c6529 [id=f9c9368e00a44a3cba3399486f27f016]) successfully deleted
I20260619 19:54:03.184659 1973 tablet_replica.cc:333] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.184926 1973 raft_consensus.cc:2243] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.184055 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:03.186228 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_bc1fc8567cd045b1bd6b1e4679853fd3 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 2 got 0
I20260619 19:54:03.186496 1973 raft_consensus.cc:2272] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.186755 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]). Expected version 3 got 0
I20260619 19:54:03.187456 1973 ts_tablet_manager.cc:1916] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.187690 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 59123a56731645e1bbfcc94b2a46b1d6 (table default.Table_2e8d0d77f8d24996b929a3d034b24a0c [id=8eedaa1e27904cadb0b52ab19f4c43ff]). Expected version 1 got 0
I20260619 19:54:03.187937 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:03.188205 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:03.188943 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:03.189167 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]). Expected version 1 got 0
I20260619 19:54:03.190900 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_83bb8d4286d24179baa0a9b7155f15d7 [id=ff393d500bb34f318889666cc5650292]). Expected version 1 got 0
I20260619 19:54:03.191527 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:03.191715 2160 raft_consensus.cc:493] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.191852 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]). Expected version 2 got 0
I20260619 19:54:03.191869 2160 raft_consensus.cc:515] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.192026 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_dc77e7b8f63e4fe4924fdae4421075e9 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 2 got 0
I20260619 19:54:03.192631 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:03.192842 2160 leader_election.cc:290] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.195298 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_9e763837fe2d46c9b0f859d4e159a2af [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 1 got 0
I20260619 19:54:03.196208 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_55cb53e830ed49f388e2fcf9f9bfff1d [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 1 got 0
I20260619 19:54:03.196478 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 1 got 0
I20260619 19:54:03.196724 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a54231986cca44258942dbc3373870b2 (table default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]). Expected version 1 got 0
I20260619 19:54:03.200628 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1202fe45d0964d368989f969e95f880d
I20260619 19:54:03.200728 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e4132f28c434492cbddc8da7d8075c43
I20260619 19:54:03.201712 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9] alter complete (version 1)
I20260619 19:54:03.201785 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_55cb53e830ed49f388e2fcf9f9bfff1d" } new_table_name: "default.Table_a3f0b91866884789b9a1ddc76a59ca8f" modify_external_catalogs: true
I20260619 19:54:03.202957 523 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_68c5aafd2b074c8cb05af88820d8fb40 [id=6d7c9506a27b4a70a32958a89c72c202] alter complete (version 2)
I20260619 19:54:03.203861 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 710fae36dd674b1786aa75013284684e
I20260619 19:54:03.204205 1973 ts_tablet_manager.cc:1929] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.204332 1973 log.cc:1199] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d4771739543f4b4189b7d603f76325f0
I20260619 19:54:03.204632 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d2c62460bd8d448584fc4e76100e5fea" } new_table_name: "default.Table_3f5d1b351c6045268f3010117cd2a78c" modify_external_catalogs: true
I20260619 19:54:03.204743 1973 ts_tablet_manager.cc:1950] T d4771739543f4b4189b7d603f76325f0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.204981 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 495bafb07abe45da9f62138453dd6636
I20260619 19:54:03.205785 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_91c55535580a45ac84980c9ba6792306" } modify_external_catalogs: true
I20260619 19:54:03.206077 524 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_97bcd24488634ad1a7b636e894bd36f2 [id=f1c35564785e48a6b6b465801f79ac2d] alter complete (version 1)
W20260619 19:54:03.158666 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 93558.3us
I20260619 19:54:03.193696 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:03.209857 996 consensus_peers.cc:597] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb56767231db42bebb75a45b5d512de3. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:03.206255 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet e4132f28c434492cbddc8da7d8075c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.160233 2114 raft_consensus.cc:493] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.210179 2114 raft_consensus.cc:515] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.210732 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 1202fe45d0964d368989f969e95f880d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.211054 2114 leader_election.cc:290] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:03.211236 1058 raft_consensus.cc:2468] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:03.211416 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.212276 720 leader_election.cc:304] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:03.212711 2160 raft_consensus.cc:2804] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:03.212810 2160 raft_consensus.cc:493] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:03.212908 2160 raft_consensus.cc:3060] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.215552 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:03.217854 2160 raft_consensus.cc:515] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.201751 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f011ebcb383f4f73a1766d0990ac9197" } new_table_name: "default.Table_e308f230944e4e96a5ec1a35eb5b21aa" modify_external_catalogs: true
I20260619 19:54:03.218163 898 tablet_service.cc:1511] Processing CreateTablet for tablet 788550efad2f4dbc917131cff1e76f09 (DEFAULT_TABLE table=default.Table_6920393f5922435bbf9c6a6a1a16dff2 [id=c1382da014f14094b6678d7774d12fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.219488 781 raft_consensus.cc:2393] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
W20260619 19:54:03.220144 531 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 222) took 1946 ms (client timeout 1000 ms). Trace:
I20260619 19:54:03.221259 890 tablet_service.cc:1511] Processing CreateTablet for tablet f96563f57f844df4814397f76ec42007 (DEFAULT_TABLE table=default.Table_b0a31efd94754d3f8883825db473e0fd [id=cbc6cd22a6cd47cea42449b8ceb0ce45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.221616 2160 leader_election.cc:290] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.222975 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:03.223225 1058 raft_consensus.cc:3060] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.223466 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 495bafb07abe45da9f62138453dd6636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.223722 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.223956 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 550297c4d14f4d679d11fded97b671ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.224419 2160 raft_consensus.cc:493] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.224612 2160 raft_consensus.cc:515] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.225356 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 495bafb07abe45da9f62138453dd6636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.226022 2160 leader_election.cc:290] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.226126 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc952b283d94035be1f86f3b90382b6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:03.226267 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:03.226667 720 leader_election.cc:343] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.226900 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.227841 1208 tablet_bootstrap.cc:492] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:03.228044 1208 ts_tablet_manager.cc:1403] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.002s
I20260619 19:54:03.228935 1208 raft_consensus.cc:359] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.229279 1208 raft_consensus.cc:385] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.229418 1208 raft_consensus.cc:740] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.229247 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 69) took 3977 ms. Trace:
I20260619 19:54:03.229779 1208 consensus_queue.cc:260] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.229696 1973 rpcz_store.cc:276] 0619 19:53:59.252156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.252202 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:03.184586 (+3932384us) ts_tablet_manager.cc:1151] Deleting tablet d4771739543f4b4189b7d603f76325f0
0619 19:54:03.184603 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.197075 (+ 12472us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.204137 (+ 7062us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.229229 (+ 25092us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3932184}
I20260619 19:54:03.231719 1208 ts_tablet_manager.cc:1434] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:03.231725 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d4771739543f4b4189b7d603f76325f0 (table default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]) successfully deleted
I20260619 19:54:03.231674 858 leader_election.cc:304] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:03.231782 1973 tablet_replica.cc:333] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.232831 1973 raft_consensus.cc:2243] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.233196 1973 raft_consensus.cc:2272] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.233614 2026 ts_tablet_manager.cc:1916] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.233841 1973 ts_tablet_manager.cc:1916] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.237211 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_91c55535580a45ac84980c9ba6792306" } modify_external_catalogs: true
I20260619 19:54:03.238480 1208 tablet_bootstrap.cc:492] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:03.241233 746 tablet_service.cc:1558] Processing DeleteTablet for tablet e4132f28c434492cbddc8da7d8075c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.243852 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 1202fe45d0964d368989f969e95f880d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:03.220292 531 rpcz_store.cc:269] 0619 19:54:01.273957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.291246 (+ 17289us) service_pool.cc:224] Handling call
0619 19:54:01.301082 (+ 9836us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:03.220047 (+1918965us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:01.602356 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:01.602496 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:01.602503 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:01.602507 (+ 4us) tablet.cc:662] Decoding operations
0619 19:54:01.602685 (+ 178us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:01.602703 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:01.602710 (+ 7us) tablet.cc:685] Acquiring locks for 3 operations
0619 19:54:01.602826 (+ 116us) tablet.cc:701] Row locks acquired
0619 19:54:01.602830 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:54:01.602868 (+ 38us) write_op.cc:270] Start()
0619 19:54:01.602906 (+ 38us) write_op.cc:276] Timestamp: P: 1781898841602815 usec, L: 0
0619 19:54:01.602912 (+ 6us) op_driver.cc:348] REPLICATION: starting
0619 19:54:01.603195 (+ 283us) log.cc:844] Serialized 1293 byte log entry
0619 19:54:01.607068 (+ 3873us) op_driver.cc:464] REPLICATION: finished
0619 19:54:01.615240 (+ 8172us) write_op.cc:301] APPLY: starting
0619 19:54:01.615261 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:01.615338 (+ 77us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:01.615367 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:01.615454 (+ 87us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:01.615497 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0619 19:54:01.615503 (+ 6us) write_op.cc:312] APPLY: finished
0619 19:54:01.615583 (+ 80us) log.cc:844] Serialized 35 byte log entry
0619 19:54:01.615643 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.615663 (+ 20us) write_op.cc:454] Released schema lock
0619 19:54:01.615669 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:01.623999 (+ 8330us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.624008 (+ 9us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:01.742212 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:01.742349 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:01.742355 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:01.742357 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:01.742473 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:01.742489 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:01.742493 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:01.742560 (+ 67us) tablet.cc:701] Row locks acquired
0619 19:54:01.742562 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:01.742599 (+ 37us) write_op.cc:270] Start()
0619 19:54:01.742651 (+ 52us) write_op.cc:276] Timestamp: P: 1781898841742535 usec, L: 0
0619 19:54:01.742655 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:01.742889 (+ 234us) log.cc:844] Serialized 356 byte log entry
0619 19:54:01.750034 (+ 7145us) op_driver.cc:464] REPLICATION: finished
0619 19:54:01.750643 (+ 609us) write_op.cc:301] APPLY: starting
0619 19:54:01.750663 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:01.750713 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:01.750740 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:01.750812 (+ 72us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:01.750850 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:01.750857 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:01.750945 (+ 88us) log.cc:844] Serialized 23 byte log entry
0619 19:54:01.751012 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.751035 (+ 23us) write_op.cc:454] Released schema lock
0619 19:54:01.751043 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:01.823689 (+ 72646us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:01.823699 (+ 10us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:02.345825 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.345949 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.345957 (+ 8us) write_op.cc:435] Acquired schema lock
0619 19:54:02.345959 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:02.346061 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.346075 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.346080 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.346146 (+ 66us) tablet.cc:701] Row locks acquired
0619 19:54:02.346148 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:02.346183 (+ 35us) write_op.cc:270] Start()
0619 19:54:02.346216 (+ 33us) write_op.cc:276] Timestamp: P: 1781898842346147 usec, L: 0
0619 19:54:02.346220 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.346407 (+ 187us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.359024 (+ 12617us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x60c0005f6600. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fd756f71a05 00007fd74317488e 00007fd743177d1b 00007fd743177b98 0000000000aa681c 00007fd743153f48 00007fd74681d6da 00007fd73f2db61e
0619 19:54:02.366151 (+ 7127us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.366314 (+ 163us) write_op.cc:301] APPLY: starting
0619 19:54:02.366332 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.366379 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.366381 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.366440 (+ 59us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.366476 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.366483 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:02.366566 (+ 83us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.366630 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.366655 (+ 25us) write_op.cc:454] Released schema lock
0619 19:54:02.366665 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.366750 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.366756 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:02.368818 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.369000 (+ 182us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.369009 (+ 9us) write_op.cc:435] Acquired schema lock
0619 19:54:02.369013 (+ 4us) tablet.cc:662] Decoding operations
0619 19:54:02.369123 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.369136 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.369141 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.369204 (+ 63us) tablet.cc:701] Row locks acquired
0619 19:54:02.369207 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:02.369244 (+ 37us) write_op.cc:270] Start()
0619 19:54:02.369278 (+ 34us) write_op.cc:276] Timestamp: P: 1781898842369203 usec, L: 0
0619 19:54:02.369283 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.369473 (+ 190us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.397921 (+ 28448us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.401824 (+ 3903us) write_op.cc:301] APPLY: starting
0619 19:54:02.401847 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.401905 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.401937 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.402000 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.402039 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.402046 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:02.402135 (+ 89us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.402212 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.402232 (+ 20us) write_op.cc:454] Released schema lock
0619 19:54:02.402240 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.402317 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.402321 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:02.705761 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.705859 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.705865 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:02.705868 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:02.705949 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.705956 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.705960 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.706026 (+ 66us) tablet.cc:701] Row locks acquired
0619 19:54:02.706029 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:02.706059 (+ 30us) write_op.cc:270] Start()
0619 19:54:02.706083 (+ 24us) write_op.cc:276] Timestamp: P: 1781898842705989 usec, L: 0
0619 19:54:02.706086 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.706245 (+ 159us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.798344 (+ 92099us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.799749 (+ 1405us) write_op.cc:301] APPLY: starting
0619 19:54:02.799758 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.799799 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.799818 (+ 19us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.799854 (+ 36us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.799886 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.799897 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:02.799951 (+ 54us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.800001 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.800017 (+ 16us) write_op.cc:454] Released schema lock
0619 19:54:02.800024 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.800090 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.800097 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":20348160,"child_traces":[["op",{"apply.queue_time_us":8100,"apply.run_cpu_time_us":500,"apply.run_wall_time_us":500,"num_ops":3,"prepare.queue_time_us":74729,"prepare.run_cpu_time_us":1001,"prepare.run_wall_time_us":21629,"raft.queue_time_us":68,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":295,"replication_time_us":4128}],["op",{"apply.queue_time_us":539,"apply.run_cpu_time_us":475,"apply.run_wall_time_us":474,"num_ops":1,"prepare.queue_time_us":125076,"prepare.run_cpu_time_us":886,"prepare.run_wall_time_us":81461,"raft.queue_time_us":1277,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":251,"replication_time_us":7346}],["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":419,"apply.run_wall_time_us":418,"num_ops":1,"prepare.queue_time_us":506,"prepare.run_cpu_time_us":698,"prepare.run_wall_time_us":698,"raft.queue_time_us":48,"raft.run_cpu_time_us":12,"raft.run_wall_time_us":12,"replication_time_us":19892,"spinlock_wait_cycles":9387776}],["op",{"apply.queue_time_us":3800,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":515,"num_ops":1,"prepare.queue_time_us":86,"prepare.run_cpu_time_us":755,"prepare.run_wall_time_us":754,"raft.queue_time_us":72,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":28594}],["op",{"apply.queue_time_us":1372,"apply.run_cpu_time_us":333,"apply.run_wall_time_us":332,"num_ops":1,"prepare.queue_time_us":99398,"prepare.run_cpu_time_us":561,"prepare.run_wall_time_us":1027,"replication_time_us":92238}]]}
I20260619 19:54:03.248914 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:03.249931 1208 tablet_bootstrap.cc:654] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:03.250886 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8c3aef303b94d58aaa24917399ac240 consensus state has no leader
I20260619 19:54:03.251015 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 997cd0b5a8d24b56a2d5b95ab877d95f from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:03.252125 523 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 223) took 1005 ms (client timeout 1000 ms). Trace:
W20260619 19:54:03.252368 523 rpcz_store.cc:269] 0619 19:54:02.246206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.312342 (+ 66136us) service_pool.cc:224] Handling call
0619 19:54:03.252068 (+939726us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:02.704743 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.704837 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.704842 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:02.704844 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:02.705008 (+ 164us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.705019 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.705024 (+ 5us) tablet.cc:685] Acquiring locks for 3 operations
0619 19:54:02.705108 (+ 84us) tablet.cc:701] Row locks acquired
0619 19:54:02.705110 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:02.705150 (+ 40us) write_op.cc:270] Start()
0619 19:54:02.705180 (+ 30us) write_op.cc:276] Timestamp: P: 1781898842705075 usec, L: 0
0619 19:54:02.705183 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.705351 (+ 168us) log.cc:844] Serialized 1293 byte log entry
0619 19:54:02.798287 (+ 92936us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.799197 (+ 910us) write_op.cc:301] APPLY: starting
0619 19:54:02.799207 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.799269 (+ 62us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.799304 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.799391 (+ 87us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.799430 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0619 19:54:02.799441 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:02.799517 (+ 76us) log.cc:844] Serialized 35 byte log entry
0619 19:54:02.799566 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.799587 (+ 21us) write_op.cc:454] Released schema lock
0619 19:54:02.799595 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.799682 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.799688 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:02.816135 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.816277 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.816284 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:02.816287 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:02.816399 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.816413 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.816419 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.816485 (+ 66us) tablet.cc:701] Row locks acquired
0619 19:54:02.816488 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:02.816524 (+ 36us) write_op.cc:270] Start()
0619 19:54:02.816560 (+ 36us) write_op.cc:276] Timestamp: P: 1781898842816505 usec, L: 0
0619 19:54:02.816564 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.816767 (+ 203us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.856174 (+ 39407us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.856371 (+ 197us) write_op.cc:301] APPLY: starting
0619 19:54:02.856390 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.856437 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.856461 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.856614 (+ 153us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.856661 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.856669 (+ 8us) write_op.cc:312] APPLY: finished
0619 19:54:02.856767 (+ 98us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.856867 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.856886 (+ 19us) write_op.cc:454] Released schema lock
0619 19:54:02.856893 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.857025 (+ 132us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.857029 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":871,"apply.run_cpu_time_us":474,"apply.run_wall_time_us":473,"num_ops":3,"prepare.queue_time_us":98729,"prepare.run_cpu_time_us":680,"prepare.run_wall_time_us":973,"replication_time_us":93083}],["op",{"apply.queue_time_us":143,"apply.run_cpu_time_us":640,"apply.run_wall_time_us":639,"num_ops":1,"prepare.queue_time_us":14614,"prepare.run_cpu_time_us":797,"prepare.run_wall_time_us":3205,"raft.queue_time_us":173,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":39574}]]}
I20260619 19:54:03.253715 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9fa8c861b0b0409cae36b17be2580b3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.254719 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c0d72f12910c4e988c146acf69ec7224"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.255577 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0d3189fcabab4e4d898b875f885c0c30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.256263 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d3189fcabab4e4d898b875f885c0c30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:03.256378 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0d72f12910c4e988c146acf69ec7224 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:03.254693 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fa8c861b0b0409cae36b17be2580b3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.267354 746 tablet_service.cc:1558] Processing DeleteTablet for tablet b65f88b43b4e45c481aa7d43ef59fe7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.268138 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.268778 746 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.269330 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 12258d3bcc714f34857d7362c49ee787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.269645 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.270063 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 620f3a56e57e49b7b520012857e71187 with delete_type TABLET_DATA_DELETED (replaced by tablet 365c0bb1e9ac480e96e7f4d604048663) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.270502 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.250348 1973 ts_tablet_manager.cc:1929] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.271941 760 tablet_service.cc:1558] Processing DeleteTablet for tablet aafe2a956b844c9998c84bbe52070e5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.271996 1973 log.cc:1199] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:54:03.250137 749 tablet_service.cc:1558] Processing DeleteTablet for tablet c83c093717ef4424b56d49e2689a6d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.271770 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.272472 1973 ts_tablet_manager.cc:1950] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:03.273562 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9911df524f8948ea8ecce55df0fdd0d6 consensus state has no leader
I20260619 19:54:03.274197 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d4771739543f4b4189b7d603f76325f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.272521 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.273217 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.273700 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cbec819571854db8a46daae15b9127bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.274941 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 68) took 4022 ms. Trace:
I20260619 19:54:03.277159 1973 rpcz_store.cc:276] 0619 19:53:59.252025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.252392 (+ 367us) service_pool.cc:224] Handling call
0619 19:54:03.231727 (+3979335us) ts_tablet_manager.cc:1151] Deleting tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60
0619 19:54:03.231740 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.242685 (+ 10945us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.250274 (+ 7589us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.274922 (+ 24648us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3977147}
I20260619 19:54:03.276271 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ecbe466eee2f43359181a1d26d6e761e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.278542 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d97025f1e0634720bc68d0a6196bd20b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.276710 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc with delete_type TABLET_DATA_DELETED (replaced by tablet b7adec89ed984837a8cf3544679ca617) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.277485 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d29506dab4c84850ad79b8b7a0340987 with delete_type TABLET_DATA_DELETED (replaced by tablet 991c877feeae43c580d9471c25c4424c) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.275605 749 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.279003 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 (table default.Table_06a592321d9b45b1b878d51b17c448c6 [id=6c9fac095a1d4192b64322a131a26435]) successfully deleted
I20260619 19:54:03.279659 1973 tablet_replica.cc:333] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.279937 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 184d655694434b0bbfa178fcd3110405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.280800 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.281034 1973 raft_consensus.cc:2243] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:03.281188 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f2a8462edb54df2aa0343ecea6dd761 consensus state has no leader
I20260619 19:54:03.281239 1973 raft_consensus.cc:2272] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.281665 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d0f21486f95f46bc925b3c31432fab7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.281885 1973 ts_tablet_manager.cc:1916] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:03.282524 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0f21486f95f46bc925b3c31432fab7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.284734 2269 raft_consensus.cc:2749] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:03.284976 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_94637363307d4dca9da129b82be2b4b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.286556 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.286628 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.286780 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.286825 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e2f73871161488dbad7a19fc9e20b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.286563 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.288218 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0a39b06bad874a5d8c945c27c3552d43 (DEFAULT_TABLE table=default.Table_a5d67c87b793425982fdfaddadd3b827 [id=b1eb763e7d5b46d59c93910b686d06a1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:03.289158 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94637363307d4dca9da129b82be2b4b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.288931 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.291785 2273 leader_election.cc:290] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.291887 760 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c0afdcf96247b0a16c8f9ac71cc24a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.292030 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2dd6eedd24f44a6a17aceb20e62bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.292129 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.292373 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57f64f97cdc493ea48e08d897bfc982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.294569 1973 ts_tablet_manager.cc:1929] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260619 19:54:03.294991 529 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 196) took 1971 ms (client timeout 1000 ms). Trace:
W20260619 19:54:03.295209 529 rpcz_store.cc:269] 0619 19:54:01.323091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.337760 (+ 14669us) service_pool.cc:224] Handling call
0619 19:54:01.414962 (+ 77202us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:02.171228 (+756266us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.171235 (+ 7us) write_op.cc:454] Released schema lock
0619 19:54:02.242771 (+ 71536us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.242778 (+ 7us) write_op.cc:454] Released schema lock
0619 19:54:03.294928 (+1052150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:02.158578 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.158680 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.158687 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:02.158690 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:02.158798 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.158814 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.158819 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.158898 (+ 79us) tablet.cc:701] Row locks acquired
0619 19:54:02.158901 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:02.158941 (+ 40us) write_op.cc:270] Start()
0619 19:54:02.158980 (+ 39us) write_op.cc:276] Timestamp: P: 1781898842158831 usec, L: 0
0619 19:54:02.158984 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.159233 (+ 249us) log.cc:844] Serialized 533 byte log entry
0619 19:54:02.163170 (+ 3937us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.163307 (+ 137us) write_op.cc:301] APPLY: starting
0619 19:54:02.163326 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.163371 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.163399 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.163458 (+ 59us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.163492 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.163499 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:02.163583 (+ 84us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.163651 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.163675 (+ 24us) write_op.cc:454] Released schema lock
0619 19:54:02.163684 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0619 19:54:02.233016 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.233121 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.233129 (+ 8us) write_op.cc:435] Acquired schema lock
0619 19:54:02.233131 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:02.233268 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.233283 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.233289 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.233356 (+ 67us) tablet.cc:701] Row locks acquired
0619 19:54:02.233358 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:02.233412 (+ 54us) write_op.cc:270] Start()
0619 19:54:02.233460 (+ 48us) write_op.cc:276] Timestamp: P: 1781898842233296 usec, L: 0
0619 19:54:02.233464 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.234287 (+ 823us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.238839 (+ 4552us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.239007 (+ 168us) write_op.cc:301] APPLY: starting
0619 19:54:02.239028 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.239077 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.239117 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.239204 (+ 87us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.239243 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.239250 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:02.239338 (+ 88us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.239401 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.239424 (+ 23us) write_op.cc:454] Released schema lock
0619 19:54:02.239432 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":67235,"reported_tablets":157,"spinlock_wait_cycles":104274816,"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":443,"apply.run_wall_time_us":443,"num_ops":1,"prepare.queue_time_us":6989,"prepare.run_cpu_time_us":780,"prepare.run_wall_time_us":781,"raft.queue_time_us":978,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":274,"replication_time_us":4133}],["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":490,"apply.run_wall_time_us":489,"num_ops":1,"prepare.queue_time_us":9722,"prepare.run_cpu_time_us":855,"prepare.run_wall_time_us":1407,"raft.queue_time_us":863,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":323,"replication_time_us":5326}]]}
W20260619 19:54:03.297505 859 leader_election.cc:343] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 12258d3bcc714f34857d7362c49ee787
I20260619 19:54:03.297681 530 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_94d5b0a1504044b7a1934b5c726b29d4 [id=96dda797fa474e119e765b5d9946bfb7] alter complete (version 2)
W20260619 19:54:03.297688 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 113802us
W20260619 19:54:03.303045 859 consensus_peers.cc:597] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:03.303817 2272 leader_election.cc:290] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:03.304165 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 108754us
I20260619 19:54:03.305877 2272 raft_consensus.cc:493] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.306121 2272 raft_consensus.cc:515] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.307071 2272 leader_election.cc:290] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.310273 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9f78e22f0138463888f10d7f72494936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.311151 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a39b06bad874a5d8c945c27c3552d43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.311520 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f78e22f0138463888f10d7f72494936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:03.314491 527 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e4688dc20317479e9c80f6f41b3ea35e consensus state has no leader
I20260619 19:54:03.319090 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788550efad2f4dbc917131cff1e76f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.325794 2269 raft_consensus.cc:493] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.326035 2269 raft_consensus.cc:515] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.326767 2269 leader_election.cc:290] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.327427 525 master_service.cc:960] ReplaceTablet: received request to replace tablet dcc9c4167c58495fbfcf5fb60952c884 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:03.328524 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_43e48f948c9d4202b33eec58d213f63b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.328596 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e7943a3044fe46f783ae56e66daf2120"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.329420 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7943a3044fe46f783ae56e66daf2120 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:03.331087 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43e48f948c9d4202b33eec58d213f63b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:03.333920 858 leader_election.cc:343] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 12258d3bcc714f34857d7362c49ee787
I20260619 19:54:03.336512 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_31cb74809b234f63acac36750deaf575" } new_table_name: "default.Table_069216990ae746dca4b43043b9485658" modify_external_catalogs: true
I20260619 19:54:03.336910 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96563f57f844df4814397f76ec42007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.339804 1973 log.cc:1199] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/5f25c0378a6f4e9ea1a62d98f27778ee
I20260619 19:54:03.340397 1973 ts_tablet_manager.cc:1950] T 5f25c0378a6f4e9ea1a62d98f27778ee P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.296025 2160 raft_consensus.cc:493] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.341487 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 67) took 4089 ms. Trace:
I20260619 19:54:03.341572 1973 rpcz_store.cc:276] 0619 19:53:59.251887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.252616 (+ 729us) service_pool.cc:224] Handling call
0619 19:54:03.279602 (+4026986us) ts_tablet_manager.cc:1151] Deleting tablet 5f25c0378a6f4e9ea1a62d98f27778ee
0619 19:54:03.279614 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.288796 (+ 9182us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.294506 (+ 5710us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.341465 (+ 46959us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4024773}
I20260619 19:54:03.341593 2160 raft_consensus.cc:515] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.342037 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 72) took 4085 ms. Trace:
I20260619 19:54:03.342110 1973 rpcz_store.cc:276] 0619 19:53:59.256959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.257344 (+ 385us) service_pool.cc:224] Handling call
0619 19:54:03.341934 (+4084590us) ts_tablet_manager.cc:1151] Deleting tablet b7adec89ed984837a8cf3544679ca617
0619 19:54:03.341945 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.342020 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4084382}
I20260619 19:54:03.342160 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_aebafa0524114fdfac5a48b2f2ceedea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.342401 2160 leader_election.cc:290] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.342588 1973 tablet_replica.cc:333] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:03.342734 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aebafa0524114fdfac5a48b2f2ceedea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.342785 1973 raft_consensus.cc:2243] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.305514 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:03.230648 1058 raft_consensus.cc:2468] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:03.230753 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b7b743e594e2aaeaeedd8613d9789 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.346069 720 leader_election.cc:304] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:03.316303 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:03.346585 776 raft_consensus.cc:2468] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:03.233358 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 467bb41a4e9f46e497726c6b29ddeb04 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcb1050f57246feb65f7e8948856c21) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.318449 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.233510 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet b7adec89ed984837a8cf3544679ca617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.348654 918 raft_consensus.cc:2468] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:03.234933 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c0ffb4629a46349ccfe473cc20cdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.236670 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ea9f17d5e75499a8433fc9a3043a88e with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.241806 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bae5be1340f4158a0b243415e232ae5 with delete_type TABLET_DATA_DELETED (replaced by tablet 55684b109a03488a88efd45a067159a0) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.247850 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a686826694b49b9bb5bcdefd61c9a15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.250653 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c83c093717ef4424b56d49e2689a6d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:03.291484 996 leader_election.cc:343] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.310125 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:03.352000 996 leader_election.cc:304] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:03.330271 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc952b283d94035be1f86f3b90382b6" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:03.352324 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 60849.9us
I20260619 19:54:03.337725 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 988e0a8b1b5b4f7cb68674af923454cf (DEFAULT_TABLE table=default.Table_92f5508aef334d42a58426bb75ba972a [id=bbed5d98d45844a0865421f8d166a56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.352926 996 leader_election.cc:304] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:03.352995 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988e0a8b1b5b4f7cb68674af923454cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.354388 2035 raft_consensus.cc:2749] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:03.354569 2035 raft_consensus.cc:2804] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:03.354665 2035 raft_consensus.cc:697] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:03.354931 2035 consensus_queue.cc:237] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.355288 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:03.338537 1039 tablet_service.cc:1511] Processing CreateTablet for tablet c1539fb656324cfb8e3b05a67115f8ce (DEFAULT_TABLE table=default.Table_a5448851752141fd8c235a5b5e2b43ef [id=8b7640345ca44252b98e9814c7d070ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.355970 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1539fb656324cfb8e3b05a67115f8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.356455 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 59123a56731645e1bbfcc94b2a46b1d6 (table default.Table_2e8d0d77f8d24996b929a3d034b24a0c [id=8eedaa1e27904cadb0b52ab19f4c43ff]). Expected version 1 got 0
I20260619 19:54:03.338464 751 tablet_service.cc:1511] Processing CreateTablet for tablet 988e0a8b1b5b4f7cb68674af923454cf (DEFAULT_TABLE table=default.Table_92f5508aef334d42a58426bb75ba972a [id=bbed5d98d45844a0865421f8d166a56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.342957 1973 raft_consensus.cc:2272] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.356963 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988e0a8b1b5b4f7cb68674af923454cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.357306 1973 ts_tablet_manager.cc:1916] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:03.359364 720 leader_election.cc:343] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.301554 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:03.361406 524 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1202fe45d0964d368989f969e95f880d consensus state has no leader
I20260619 19:54:03.362097 2160 raft_consensus.cc:2804] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:03.362234 2160 raft_consensus.cc:697] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:03.362485 2160 consensus_queue.cc:237] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.363148 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 8ce7f825e5f84d5985427e83ee6a989d from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:03.366803 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7810442fe18f4992bc31a9edf87d2438" } new_table_name: "default.Table_508ca7090aa54693b073adb86fe4f9ad" modify_external_catalogs: true
I20260619 19:54:03.369783 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 76ffe451545c4af6821971384fce483e from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:03.364389 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet dcc9c4167c58495fbfcf5fb60952c884
I20260619 19:54:03.371510 525 catalog_manager.cc:6784] ReplaceTablet: tablet dcc9c4167c58495fbfcf5fb60952c884 deleted and replaced by tablet 7d1b35a09aad46039677eb3d800b0051
I20260619 19:54:03.372411 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.364809 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 47ace991ad1a4d52ab609940aacf6681 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:03.373596 1973 ts_tablet_manager.cc:1929] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.373718 1973 log.cc:1199] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9b08ab9ad59049919649b96890b6785d
I20260619 19:54:03.374094 1973 ts_tablet_manager.cc:1950] T 9b08ab9ad59049919649b96890b6785d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.375448 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 74) took 4118 ms. Trace:
I20260619 19:54:03.375548 1973 rpcz_store.cc:276] 0619 19:53:59.257265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.257595 (+ 330us) service_pool.cc:224] Handling call
0619 19:54:03.342320 (+4084725us) ts_tablet_manager.cc:1151] Deleting tablet 9b08ab9ad59049919649b96890b6785d
0619 19:54:03.342546 (+ 226us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.360660 (+ 18114us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.373524 (+ 12864us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.375425 (+ 1901us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4084560}
I20260619 19:54:03.375911 1973 tablet_replica.cc:333] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.376121 1973 raft_consensus.cc:2243] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.376417 1973 raft_consensus.cc:2272] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:03.376633 859 leader_election.cc:343] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.376995 1973 ts_tablet_manager.cc:1916] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:03.377925 859 leader_election.cc:343] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.378018 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0c189a1a614e0cbd0862291eb0962a (DEFAULT_TABLE table=default.Table_f45ecb22649c41cf875aa7f1b1e017b0 [id=a85bed9349da4c70af600c8f333c8aa5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:03.378258 859 leader_election.cc:343] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.378466 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0c189a1a614e0cbd0862291eb0962a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.378912 524 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:53243 (request call id 195) took 1988 ms (client timeout 1000 ms). Trace:
I20260619 19:54:03.379221 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2a8462edb54df2aa0343ecea6dd761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.379418 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1e6d16452b4e568745f884cd13ebac (DEFAULT_TABLE table=default.Table_673a1e52cb85474ca009c9f232b8c7d2 [id=5fbcc34aea0e444abedf15cf2f3c4ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.379746 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1e6d16452b4e568745f884cd13ebac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.382138 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:03.382520 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:03.383051 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7b94596b0246628b963524983bb226 (DEFAULT_TABLE table=default.Table_a66ca1d30e274d2281b507485193b9b0 [id=68b401194bfd41f0b71116e5b7fc4216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.383636 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7b94596b0246628b963524983bb226. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.379051 524 rpcz_store.cc:269] 0619 19:54:01.390779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.409165 (+ 18386us) service_pool.cc:224] Handling call
0619 19:54:03.378859 (+1969694us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:02.327680 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.327813 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.327820 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:02.327822 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:02.327948 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.327966 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.327971 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.328039 (+ 68us) tablet.cc:701] Row locks acquired
0619 19:54:02.328041 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:02.328079 (+ 38us) write_op.cc:270] Start()
0619 19:54:02.328114 (+ 35us) write_op.cc:276] Timestamp: P: 1781898842328044 usec, L: 0
0619 19:54:02.328118 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.328306 (+ 188us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.339535 (+ 11229us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.339668 (+ 133us) write_op.cc:301] APPLY: starting
0619 19:54:02.339687 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.339735 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.342331 (+ 2596us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.342410 (+ 79us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.342457 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.342468 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:02.342567 (+ 99us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.342639 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.342662 (+ 23us) write_op.cc:454] Released schema lock
0619 19:54:02.342670 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.342760 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.342763 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:02.526369 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.526482 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.526489 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:02.526492 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:02.526602 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.526614 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.526619 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.526680 (+ 61us) tablet.cc:701] Row locks acquired
0619 19:54:02.526682 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:02.526715 (+ 33us) write_op.cc:270] Start()
0619 19:54:02.526749 (+ 34us) write_op.cc:276] Timestamp: P: 1781898842526662 usec, L: 0
0619 19:54:02.526753 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.526908 (+ 155us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.551264 (+ 24356us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.552104 (+ 840us) write_op.cc:301] APPLY: starting
0619 19:54:02.552117 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.552164 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.552192 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.552236 (+ 44us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.552263 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.552270 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:02.552330 (+ 60us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.552376 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.552390 (+ 14us) write_op.cc:454] Released schema lock
0619 19:54:02.552396 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.552460 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.552463 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:02.703341 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:02.703484 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:02.703489 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:02.703492 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:02.703601 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:02.703615 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:02.703620 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:02.703690 (+ 70us) tablet.cc:701] Row locks acquired
0619 19:54:02.703692 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:02.703730 (+ 38us) write_op.cc:270] Start()
0619 19:54:02.703764 (+ 34us) write_op.cc:276] Timestamp: P: 1781898842703658 usec, L: 0
0619 19:54:02.703768 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.703967 (+ 199us) log.cc:844] Serialized 356 byte log entry
0619 19:54:02.798198 (+ 94231us) op_driver.cc:464] REPLICATION: finished
0619 19:54:02.798494 (+ 296us) write_op.cc:301] APPLY: starting
0619 19:54:02.798515 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:02.798570 (+ 55us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:02.798610 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:02.798685 (+ 75us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:02.798733 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:02.798744 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:02.798851 (+ 107us) log.cc:844] Serialized 23 byte log entry
0619 19:54:02.798926 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.798952 (+ 26us) write_op.cc:454] Released schema lock
0619 19:54:02.798962 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:02.799069 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:02.799074 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66387,"reported_tablets":158,"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":533,"apply.run_wall_time_us":3076,"num_ops":1,"prepare.queue_time_us":1537,"prepare.run_cpu_time_us":738,"prepare.run_wall_time_us":738,"raft.queue_time_us":1785,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":259,"replication_time_us":11384}],["op",{"apply.queue_time_us":800,"apply.run_cpu_time_us":349,"apply.run_wall_time_us":348,"num_ops":1,"prepare.queue_time_us":86902,"prepare.run_cpu_time_us":641,"prepare.run_wall_time_us":1090,"raft.queue_time_us":35,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":6,"replication_time_us":24484}],["op",{"apply.queue_time_us":231,"apply.run_cpu_time_us":559,"apply.run_wall_time_us":559,"num_ops":1,"prepare.queue_time_us":98541,"prepare.run_cpu_time_us":730,"prepare.run_wall_time_us":1364,"replication_time_us":94383}]]}
I20260619 19:54:03.391166 1973 ts_tablet_manager.cc:1929] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.391434 1973 log.cc:1199] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:54:03.392320 1973 ts_tablet_manager.cc:1950] T 9be5cda43d0b4719a82f33a03e2261d3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.393671 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 71) took 4136 ms. Trace:
I20260619 19:54:03.393901 1973 rpcz_store.cc:276] 0619 19:53:59.256764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.257929 (+ 1165us) service_pool.cc:224] Handling call
0619 19:54:03.375862 (+4117933us) ts_tablet_manager.cc:1151] Deleting tablet 9be5cda43d0b4719a82f33a03e2261d3
0619 19:54:03.375872 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.380338 (+ 4466us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.388965 (+ 8627us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.393633 (+ 4668us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4117782}
I20260619 19:54:03.394433 1973 tablet_replica.cc:333] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.394659 1973 raft_consensus.cc:2243] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.394865 1973 raft_consensus.cc:2272] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.395615 1973 ts_tablet_manager.cc:1916] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.396296 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 19d6333b0c8940b2802307d0da8a57ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.401845 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 5f25c0378a6f4e9ea1a62d98f27778ee (table default.Table_8874e3261467434cb5316f5024d06ce7 [id=6acfde9eb89943c9b83cf58165e83ccb]) successfully deleted
W20260619 19:54:03.402240 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b7adec89ed984837a8cf3544679ca617 because the tablet was not found. No further retry: Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
I20260619 19:54:03.404599 760 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.404698 747 tablet_service.cc:1511] Processing CreateTablet for tablet c1539fb656324cfb8e3b05a67115f8ce (DEFAULT_TABLE table=default.Table_a5448851752141fd8c235a5b5e2b43ef [id=8b7640345ca44252b98e9814c7d070ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.405105 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1539fb656324cfb8e3b05a67115f8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.405241 760 tablet_service.cc:1511] Processing CreateTablet for tablet 6066043cb3e04a0f9e56376fc144338e (DEFAULT_TABLE table=default.Table_f0c38d52de164a0faf77ba776b51a3bd [id=a9396ffe9dae4c549124bfbfc17fcfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.405567 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6066043cb3e04a0f9e56376fc144338e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.405807 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:03.405952 1973 ts_tablet_manager.cc:1929] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.406070 1973 log.cc:1199] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/91e43148bb5b47128e08ed7faf8c7c1f
I20260619 19:54:03.406071 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:03.406430 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_069216990ae746dca4b43043b9485658 [id=8d6402c45a4d4456935a213be45b3c51]). Expected version 2 got 1
I20260619 19:54:03.406489 1973 ts_tablet_manager.cc:1950] T 91e43148bb5b47128e08ed7faf8c7c1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.407495 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 75) took 4149 ms. Trace:
I20260619 19:54:03.407599 1973 rpcz_store.cc:276] 0619 19:53:59.257891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.258111 (+ 220us) service_pool.cc:224] Handling call
0619 19:54:03.394364 (+4136253us) ts_tablet_manager.cc:1151] Deleting tablet 91e43148bb5b47128e08ed7faf8c7c1f
0619 19:54:03.394388 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.401845 (+ 7457us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.405898 (+ 4053us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.407467 (+ 1569us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4136132}
I20260619 19:54:03.408034 1973 tablet_replica.cc:333] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.408255 1973 raft_consensus.cc:2243] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.408571 1973 raft_consensus.cc:2272] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.409145 1973 ts_tablet_manager.cc:1916] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.411964 746 tablet_service.cc:1511] Processing CreateTablet for tablet 68ce666522bb468ca8457fe78bec9560 (DEFAULT_TABLE table=default.Table_11ebd5156f0249c0abafdda9c4392b11 [id=80831181a799460da41d2a7a8e9a29c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.412117 749 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0c189a1a614e0cbd0862291eb0962a (DEFAULT_TABLE table=default.Table_f45ecb22649c41cf875aa7f1b1e017b0 [id=a85bed9349da4c70af600c8f333c8aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.412367 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ce666522bb468ca8457fe78bec9560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.412540 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0c189a1a614e0cbd0862291eb0962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.415421 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9229096a47ef4a3d912826fe42bda5b4" } modify_external_catalogs: true
I20260619 19:54:03.415551 2172 raft_consensus.cc:493] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.415421 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_122ef08337114140a4943c821d049ffb" } modify_external_catalogs: true
I20260619 19:54:03.415696 2172 raft_consensus.cc:515] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.415756 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9229096a47ef4a3d912826fe42bda5b4" } modify_external_catalogs: true
I20260619 19:54:03.415759 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_122ef08337114140a4943c821d049ffb" } modify_external_catalogs: true
I20260619 19:54:03.416371 2172 leader_election.cc:290] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:03.417728 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a666e5f020f94fbbbb4aeb87d9f180fe" } modify_external_catalogs: true
I20260619 19:54:03.417943 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a666e5f020f94fbbbb4aeb87d9f180fe" } modify_external_catalogs: true
I20260619 19:54:03.419003 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:03.419627 996 leader_election.cc:343] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.420404 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1e6d16452b4e568745f884cd13ebac (DEFAULT_TABLE table=default.Table_673a1e52cb85474ca009c9f232b8c7d2 [id=5fbcc34aea0e444abedf15cf2f3c4ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.420763 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1e6d16452b4e568745f884cd13ebac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.426723 1973 ts_tablet_manager.cc:1929] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.426951 1973 log.cc:1199] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9c379d780b294b9a863576f53f79ee7b
I20260619 19:54:03.427487 1973 ts_tablet_manager.cc:1950] T 9c379d780b294b9a863576f53f79ee7b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.428465 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 76) took 4170 ms. Trace:
I20260619 19:54:03.428673 1973 rpcz_store.cc:276] 0619 19:53:59.258370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.258410 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:03.407963 (+4149553us) ts_tablet_manager.cc:1151] Deleting tablet 9c379d780b294b9a863576f53f79ee7b
0619 19:54:03.407976 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.413044 (+ 5068us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.426646 (+ 13602us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.428444 (+ 1798us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4149392}
W20260619 19:54:03.429244 720 consensus_peers.cc:597] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:03.403054 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9b08ab9ad59049919649b96890b6785d (table default.Table_9b854aa69df5459692f816d4bdebc8cf [id=4e12ede134634d1a92d756ba9c4b3219]) successfully deleted
I20260619 19:54:03.429244 1973 tablet_replica.cc:333] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.429661 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.429913 920 raft_consensus.cc:2468] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:03.429913 1973 raft_consensus.cc:2243] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.430253 1973 raft_consensus.cc:2272] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.430970 1973 ts_tablet_manager.cc:1916] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.431216 996 leader_election.cc:304] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:03.431553 2114 raft_consensus.cc:2804] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:03.431668 2114 raft_consensus.cc:493] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:03.431777 2114 raft_consensus.cc:3060] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.432837 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2718b9619524430388f0760485d8e4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.433959 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf769db8f5d45bf9c409876322350b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.434877 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3780418b3854889868cf428b2800ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.434897 2114 raft_consensus.cc:515] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.435382 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9be5cda43d0b4719a82f33a03e2261d3 (table default.Table_f17eeb5cd144427d8bf4066856809dfe [id=596e254ea57a41eeae97ee0e8ff2adc9]) successfully deleted
I20260619 19:54:03.435964 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca68b755bf841509b6ffcfbe212278c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.436803 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2156cf3d7664ffc9b4b3f47fa750226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.438884 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 91e43148bb5b47128e08ed7faf8c7c1f (table default.Table_add3279cce4944a1a6e56b997e6093e7 [id=40e068d4874b46e5bd112f84ad360dc6]) successfully deleted
I20260619 19:54:03.441823 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9c379d780b294b9a863576f53f79ee7b (table default.Table_9c718229c76b4c2794a9bd5d5a26fc86 [id=e546025d2806485aa4b7d9ec209ab2d6]) successfully deleted
I20260619 19:54:03.444630 2114 leader_election.cc:290] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:03.445281 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:03.445595 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:03.445835 920 raft_consensus.cc:3060] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.441062 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 68ce666522bb468ca8457fe78bec9560 (DEFAULT_TABLE table=default.Table_11ebd5156f0249c0abafdda9c4392b11 [id=80831181a799460da41d2a7a8e9a29c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.448769 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b8f22a48856a436a9a5abcd9cae20620 (DEFAULT_TABLE table=default.Table_4b57592fb6a44808bcc5312ccbae5c03 [id=0e024a3b9e5a4fd298ed8eae005ca452]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:03.449491 996 leader_election.cc:343] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.449784 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f22a48856a436a9a5abcd9cae20620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.455547 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ce666522bb468ca8457fe78bec9560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.464286 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 6066043cb3e04a0f9e56376fc144338e (DEFAULT_TABLE table=default.Table_f0c38d52de164a0faf77ba776b51a3bd [id=a9396ffe9dae4c549124bfbfc17fcfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.464852 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6066043cb3e04a0f9e56376fc144338e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.467607 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7b94596b0246628b963524983bb226 (DEFAULT_TABLE table=default.Table_a66ca1d30e274d2281b507485193b9b0 [id=68b401194bfd41f0b71116e5b7fc4216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.470800 747 tablet_service.cc:1511] Processing CreateTablet for tablet b8f22a48856a436a9a5abcd9cae20620 (DEFAULT_TABLE table=default.Table_4b57592fb6a44808bcc5312ccbae5c03 [id=0e024a3b9e5a4fd298ed8eae005ca452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.471305 858 leader_election.cc:304] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:03.471694 2272 raft_consensus.cc:2749] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:03.472033 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 151277us
W20260619 19:54:03.473258 858 leader_election.cc:343] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.473388 858 leader_election.cc:304] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:03.473728 2269 raft_consensus.cc:2749] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:03.474261 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22e0f53008c4a96bf56b7f057f81cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.477211 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 087630689da0433ab876dcd3cd6bec0f (DEFAULT_TABLE table=default.Table_b060c9b13fe14e5b877dca744457d580 [id=0970415cc6c046f3a72f0dfb05a62257]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.477682 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087630689da0433ab876dcd3cd6bec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.477888 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904e20649a5f4c49a93bb084c1d3bb9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.481235 760 tablet_service.cc:1511] Processing CreateTablet for tablet 087630689da0433ab876dcd3cd6bec0f (DEFAULT_TABLE table=default.Table_b060c9b13fe14e5b877dca744457d580 [id=0970415cc6c046f3a72f0dfb05a62257]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.483639 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68808ad4f64475782f8fba579fdb8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.487808 920 raft_consensus.cc:2468] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:03.488620 996 leader_election.cc:304] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:03.488927 1973 ts_tablet_manager.cc:1929] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.488999 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7b94596b0246628b963524983bb226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.489068 1973 log.cc:1199] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/37393d7c16594032bf2a69abb0ab5931
I20260619 19:54:03.489413 1973 ts_tablet_manager.cc:1950] T 37393d7c16594032bf2a69abb0ab5931 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.489598 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087630689da0433ab876dcd3cd6bec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.489934 2114 raft_consensus.cc:2804] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:03.490423 2114 raft_consensus.cc:697] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:03.490919 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f22a48856a436a9a5abcd9cae20620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.491170 2114 consensus_queue.cc:237] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.506359 2160 raft_consensus.cc:493] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.507495 2160 raft_consensus.cc:515] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.508849 2160 leader_election.cc:290] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.509513 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb547965fc7e4aa29d427b1acc7d6e51" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:03.509816 1055 raft_consensus.cc:2468] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:03.512482 720 leader_election.cc:304] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:03.513772 2160 raft_consensus.cc:2804] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260619 19:54:03.514336 719 consensus_peers.cc:597] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:03.514817 2160 raft_consensus.cc:493] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:03.515089 2160 raft_consensus.cc:3060] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.515100 902 tablet_service.cc:1511] Processing CreateTablet for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a (DEFAULT_TABLE table=default.Table_88bb3e27be5d41d19ecce9b1881cdb1b [id=7ea73c05d7e54bfe8f3c2acc34670ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.515689 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.519649 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d0a9c96d9c034a4a8a4d05d8518ebcec consensus state has no leader
I20260619 19:54:03.522173 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4ff5cbcad6d34fa7a697088b1b61ffda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.523464 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ff5cbcad6d34fa7a697088b1b61ffda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.552860 895 tablet_service.cc:1511] Processing CreateTablet for tablet 0d32f01411e541a987c0b5902528489b (DEFAULT_TABLE table=default.Table_5930f363db7a44459de1c9115c4051b3 [id=7d73b73b575e487c8ce95074a4b108d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.553644 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d32f01411e541a987c0b5902528489b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.559448 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 86184.3us
I20260619 19:54:03.559856 858 leader_election.cc:304] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:03.560249 2269 raft_consensus.cc:2804] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:03.560379 2269 raft_consensus.cc:493] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:03.560521 2269 raft_consensus.cc:3060] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.561198 894 tablet_service.cc:1511] Processing CreateTablet for tablet 910cf00e57404f1097800e84a2070b26 (DEFAULT_TABLE table=default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.563257 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 73) took 4306 ms. Trace:
I20260619 19:54:03.563400 1973 rpcz_store.cc:276] 0619 19:53:59.257105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.258724 (+ 1619us) service_pool.cc:224] Handling call
0619 19:54:03.429178 (+4170454us) ts_tablet_manager.cc:1151] Deleting tablet 37393d7c16594032bf2a69abb0ab5931
0619 19:54:03.429192 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.435840 (+ 6648us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.488851 (+ 53011us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.563227 (+ 74376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4170278}
I20260619 19:54:03.563828 1973 tablet_replica.cc:333] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.564112 1973 raft_consensus.cc:2243] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.564306 1973 raft_consensus.cc:2272] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.565019 1973 ts_tablet_manager.cc:1916] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.566504 2160 raft_consensus.cc:515] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.567644 2160 leader_election.cc:290] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.567690 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb547965fc7e4aa29d427b1acc7d6e51" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:03.567850 1055 raft_consensus.cc:3060] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.569314 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5eab435484861b8bccece188f7a46 (DEFAULT_TABLE table=default.Table_326c1bc01d404daaa76ea5322feb651f [id=69219d9461cc404098bff7e93aee21fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.569718 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5eab435484861b8bccece188f7a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.578716 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc952b283d94035be1f86f3b90382b6" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:03.579030 783 raft_consensus.cc:2468] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:03.145949 1994 ts_tablet_manager.cc:1916] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.608584 858 leader_election.cc:304] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:03.609027 2272 raft_consensus.cc:2804] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:03.609187 2272 raft_consensus.cc:493] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:03.609321 2272 raft_consensus.cc:3060] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.575503 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 37393d7c16594032bf2a69abb0ab5931 (table default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]) successfully deleted
I20260619 19:54:03.615177 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_326c1bc01d404daaa76ea5322feb651f" } modify_external_catalogs: true
I20260619 19:54:03.615479 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_326c1bc01d404daaa76ea5322feb651f" } modify_external_catalogs: true
I20260619 19:54:03.620584 2290 tablet.cc:1724] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:03.622702 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 32648df603ac442396922383ffbd2e31 (DEFAULT_TABLE table=default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:03.623627 1057 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.586s user 0.000s sys 0.011s
W20260619 19:54:03.623728 1057 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.586s user 0.000s sys 0.011s
I20260619 19:54:03.626546 2035 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95181cc281b946c8b81aa825232d9498)
I20260619 19:54:03.628278 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5eab435484861b8bccece188f7a46 (DEFAULT_TABLE table=default.Table_326c1bc01d404daaa76ea5322feb651f [id=69219d9461cc404098bff7e93aee21fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.639479 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32648df603ac442396922383ffbd2e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.646130 2035 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:03.647234 2035 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:03.648944 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:03.649055 2160 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95181cc281b946c8b81aa825232d9498)
I20260619 19:54:03.649597 2160 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:03.649974 781 raft_consensus.cc:2468] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:03.651631 2160 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.652128 996 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:03.652488 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:03.652951 1061 raft_consensus.cc:2468] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:54:03.653760 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260619 19:54:03.659344 2114 raft_consensus.cc:2804] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:03.659592 2114 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95181cc281b946c8b81aa825232d9498)
I20260619 19:54:03.659745 2114 raft_consensus.cc:3060] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:03.669555 886 tablet_service.cc:1511] Processing CreateTablet for tablet 10c73b679e394f31b9e5d51681e06976 (DEFAULT_TABLE table=default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.683591 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]) successfully deleted
W20260619 19:54:03.684154 1200 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.037s sys 0.128s
W20260619 19:54:03.684223 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d895be304fcf445e9a4d2d8242becdd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d895be304fcf445e9a4d2d8242becdd5 already in progress: creating tablet
W20260619 19:54:03.684340 1200 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.602s user 0.037s sys 0.128s
W20260619 19:54:03.684607 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9f6ec149e1ac475f8038b328dae4af2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f6ec149e1ac475f8038b328dae4af2a already in progress: creating tablet
I20260619 19:54:03.653378 720 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:03.685348 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5eab435484861b8bccece188f7a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.685779 1200 tablet_bootstrap.cc:492] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:03.686034 1200 ts_tablet_manager.cc:1403] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.606s user 0.037s sys 0.129s
I20260619 19:54:03.686015 2160 raft_consensus.cc:2804] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:03.686118 2160 raft_consensus.cc:493] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95181cc281b946c8b81aa825232d9498)
I20260619 19:54:03.686291 2160 raft_consensus.cc:3060] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:03.656934 749 tablet_service.cc:1511] Processing CreateTablet for tablet 32648df603ac442396922383ffbd2e31 (DEFAULT_TABLE table=default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.683632 2149 consensus_queue.cc:1048] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:03.687682 1200 raft_consensus.cc:359] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.687927 1200 raft_consensus.cc:385] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.687980 1200 raft_consensus.cc:740] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.688232 1200 consensus_queue.cc:260] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.696527 1200 ts_tablet_manager.cc:1434] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:54:03.697081 1200 tablet_bootstrap.cc:492] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:03.699251 1200 tablet_bootstrap.cc:654] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:03.699775 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 1202fe45d0964d368989f969e95f880d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.700142 1201 tablet_bootstrap.cc:654] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:03.700521 996 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:03.700960 1208 tablet_bootstrap.cc:492] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
W20260619 19:54:03.700969 2262 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.002s sys 0.009s
I20260619 19:54:03.703636 1208 ts_tablet_manager.cc:1403] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.471s user 0.018s sys 0.023s
I20260619 19:54:03.704521 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e4132f28c434492cbddc8da7d8075c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.704692 1208 raft_consensus.cc:359] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:03.705302 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 51959.9us
I20260619 19:54:03.709524 1200 tablet_bootstrap.cc:492] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:03.709794 1200 ts_tablet_manager.cc:1403] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.007s
I20260619 19:54:03.712141 1200 raft_consensus.cc:359] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.712469 1200 raft_consensus.cc:385] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.712874 1200 raft_consensus.cc:740] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.713192 1200 consensus_queue.cc:260] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.713886 1200 ts_tablet_manager.cc:1434] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:03.714237 1200 tablet_bootstrap.cc:492] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:03.714622 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8ce7f825e5f84d5985427e83ee6a989d
W20260619 19:54:03.715449 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 983faf8557814093bc427291711f3fce consensus state has no leader
W20260619 19:54:03.715796 1820 thread.cc:641] rpc worker (service pool kudu.master.MasterService) Time spent creating pthread: real 0.699s user 0.000s sys 0.006s
W20260619 19:54:03.715946 1820 thread.cc:608] rpc worker (service pool kudu.master.MasterService) Time spent starting thread: real 0.699s user 0.000s sys 0.006s
I20260619 19:54:03.715979 1200 tablet_bootstrap.cc:654] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:03.717087 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910cf00e57404f1097800e84a2070b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.717290 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 76ffe451545c4af6821971384fce483e
I20260619 19:54:03.717634 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.717809 523 catalog_manager.cc:6784] ReplaceTablet: tablet 76ffe451545c4af6821971384fce483e deleted and replaced by tablet 0f3a48eabb574be3bc6883cf555b657f
W20260619 19:54:03.717841 900 consensus_meta.cc:287] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.571s user 0.001s sys 0.005s
I20260619 19:54:03.718240 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc" } modify_external_catalogs: true
I20260619 19:54:03.718393 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 02c5f9405d6a4a16bd49697001c201e1
I20260619 19:54:03.718478 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc" } modify_external_catalogs: true
W20260619 19:54:03.718941 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 76645.7us
I20260619 19:54:03.719089 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dc77e7b8f63e4fe4924fdae4421075e9" } new_table_name: "default.Table_aa310c6c62a340b3a2a9b00ddad42f22" modify_external_catalogs: true
I20260619 19:54:03.719436 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 47ace991ad1a4d52ab609940aacf6681
I20260619 19:54:03.719892 526 catalog_manager.cc:6784] ReplaceTablet: tablet 47ace991ad1a4d52ab609940aacf6681 deleted and replaced by tablet a7100b0bfa6d4e3baf4e7f90217f1fff
I20260619 19:54:03.720274 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_49b9db84d9d64b3bbde7236a42fef5df" } new_table_name: "default.Table_13defec349014a83b249f7db46924c0e" modify_external_catalogs: true
I20260619 19:54:03.722218 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 33ee0b30259741cdb2fb0e3c815e6b17
I20260619 19:54:03.722985 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cfd604dcc65a4500b9c0785d9ae2a562" } new_table_name: "default.Table_8728156791db4d17b967c54596ef94cb" modify_external_catalogs: true
W20260619 19:54:03.723091 2262 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.669s user 0.002s sys 0.010s
I20260619 19:54:03.723654 529 catalog_manager.cc:6784] ReplaceTablet: tablet 8ce7f825e5f84d5985427e83ee6a989d deleted and replaced by tablet bb514fda80e64ac9abc147d9a6adce76
I20260619 19:54:03.698321 2289 tablet.cc:1724] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:03.724159 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_97b6432d47dd4450a21a82a3e15390ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.724977 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97b6432d47dd4450a21a82a3e15390ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.725206 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0991105460f749e1854d512304ff56cd
I20260619 19:54:03.725984 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3ee262be56034610bb8b2369b98281e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.726624 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ee262be56034610bb8b2369b98281e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.729780 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 33ee0b30259741cdb2fb0e3c815e6b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.729876 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d with delete_type TABLET_DATA_DELETED (replaced by tablet bb514fda80e64ac9abc147d9a6adce76) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.730086 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 76ffe451545c4af6821971384fce483e with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3a48eabb574be3bc6883cf555b657f) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.730248 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.730423 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ace991ad1a4d52ab609940aacf6681 with delete_type TABLET_DATA_DELETED (replaced by tablet a7100b0bfa6d4e3baf4e7f90217f1fff) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.730592 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0991105460f749e1854d512304ff56cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.731084 1973 ts_tablet_manager.cc:1929] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.731273 1973 log.cc:1199] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:54:03.731778 1973 ts_tablet_manager.cc:1950] T 467bb41a4e9f46e497726c6b29ddeb04 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.733840 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 76ffe451545c4af6821971384fce483e with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3a48eabb574be3bc6883cf555b657f) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.734479 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.734614 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ace991ad1a4d52ab609940aacf6681 with delete_type TABLET_DATA_DELETED (replaced by tablet a7100b0bfa6d4e3baf4e7f90217f1fff) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.734957 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 33ee0b30259741cdb2fb0e3c815e6b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.735352 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d with delete_type TABLET_DATA_DELETED (replaced by tablet bb514fda80e64ac9abc147d9a6adce76) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.735743 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0991105460f749e1854d512304ff56cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.717824 527 catalog_manager.cc:5696] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:03.738189 901 tablet_service.cc:1558] Processing DeleteTablet for tablet c83c093717ef4424b56d49e2689a6d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.738704 527 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 59123a56731645e1bbfcc94b2a46b1d6 (table default.Table_2e8d0d77f8d24996b929a3d034b24a0c [id=8eedaa1e27904cadb0b52ab19f4c43ff]). Expected version 1 got 0
I20260619 19:54:03.738989 2149 consensus_queue.cc:1048] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:03.755975 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7c2adacdb99143a0a08280f26b2502ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.760258 1208 raft_consensus.cc:385] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.760654 1208 raft_consensus.cc:740] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.761093 1208 consensus_queue.cc:260] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:03.761602 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c2adacdb99143a0a08280f26b2502ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.767256 2290 tablet.cc:1724] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:03.770308 1208 ts_tablet_manager.cc:1434] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.066s user 0.001s sys 0.001s
I20260619 19:54:03.773679 1200 tablet_bootstrap.cc:492] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:03.773944 1200 ts_tablet_manager.cc:1403] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.018s
I20260619 19:54:03.774925 1200 raft_consensus.cc:359] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.775352 1200 raft_consensus.cc:385] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.775467 1200 raft_consensus.cc:740] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.775734 1200 consensus_queue.cc:260] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.776404 1200 ts_tablet_manager.cc:1434] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:03.776365 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 495bafb07abe45da9f62138453dd6636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.776772 1200 tablet_bootstrap.cc:492] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:03.778256 901 tablet_service.cc:1511] Processing CreateTablet for tablet 988e0a8b1b5b4f7cb68674af923454cf (DEFAULT_TABLE table=default.Table_92f5508aef334d42a58426bb75ba972a [id=bbed5d98d45844a0865421f8d166a56b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.783599 1200 tablet_bootstrap.cc:654] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:03.785187 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.785542 891 tablet_service.cc:1511] Processing CreateTablet for tablet c1539fb656324cfb8e3b05a67115f8ce (DEFAULT_TABLE table=default.Table_a5448851752141fd8c235a5b5e2b43ef [id=8b7640345ca44252b98e9814c7d070ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.790910 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.791474 888 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.791747 888 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.792284 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.792500 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.792716 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd210e843db4f58a976af5c28dabc9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.792938 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 with delete_type TABLET_DATA_DELETED (replaced by tablet e4688dc20317479e9c80f6f41b3ea35e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.793138 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 68788824224b426bb433b87763073bae with delete_type TABLET_DATA_DELETED (replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.793347 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.793562 888 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.793749 888 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.793970 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.794165 888 tablet_service.cc:1558] Processing DeleteTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.794380 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.794556 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.794746 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 33cfbae501de432cbcb34d2a6365f806 with delete_type TABLET_DATA_DELETED (replaced by tablet 6532bdfd3c844ff2a25bee6ff1e0c25e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.794935 888 tablet_service.cc:1558] Processing DeleteTablet for tablet bb56767231db42bebb75a45b5d512de3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:03.796270 719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260619 19:54:03.809311 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32648df603ac442396922383ffbd2e31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:03.828619 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb514fda80e64ac9abc147d9a6adce76 has no consensus state
I20260619 19:54:03.829110 1994 ts_tablet_manager.cc:1929] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.829262 1994 log.cc:1199] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/aafe2a956b844c9998c84bbe52070e5d
I20260619 19:54:03.830788 1994 ts_tablet_manager.cc:1950] T aafe2a956b844c9998c84bbe52070e5d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:03.834528 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 77) took 4575 ms. Trace:
I20260619 19:54:03.834653 1973 rpcz_store.cc:276] 0619 19:53:59.258667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.258933 (+ 266us) service_pool.cc:224] Handling call
0619 19:54:03.563771 (+4304838us) ts_tablet_manager.cc:1151] Deleting tablet 467bb41a4e9f46e497726c6b29ddeb04
0619 19:54:03.563783 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.664234 (+100451us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.730981 (+ 66747us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.834501 (+103520us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4304709}
I20260619 19:54:03.835081 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 78) took 4575 ms. Trace:
I20260619 19:54:03.835186 1973 rpcz_store.cc:276] 0619 19:53:59.259216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.259257 (+ 41us) service_pool.cc:224] Handling call
0619 19:54:03.834935 (+4575678us) ts_tablet_manager.cc:1151] Deleting tablet 997cd0b5a8d24b56a2d5b95ab877d95f
0619 19:54:03.834946 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.835063 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4575508}
I20260619 19:54:03.835433 1973 tablet_replica.cc:333] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.835625 1973 raft_consensus.cc:2243] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.835788 1973 raft_consensus.cc:2272] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.836380 1973 ts_tablet_manager.cc:1916] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.837165 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1d03edf897d2401c8e37c1351616b21c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.837940 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d03edf897d2401c8e37c1351616b21c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.841341 1055 raft_consensus.cc:2468] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:03.843863 720 leader_election.cc:304] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:03.845585 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2718b9619524430388f0760485d8e4be consensus state has no leader
W20260619 19:54:03.845715 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fde2b5d12ab7465791f26d214c2dc2f5 consensus state has no leader
I20260619 19:54:03.847461 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d84c42e7f7da440696e7684e3dd52ec2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.849939 2311 raft_consensus.cc:493] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.850113 2311 raft_consensus.cc:515] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.850821 2311 leader_election.cc:290] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:03.851714 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:03.852864 996 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.856338 2149 raft_consensus.cc:2804] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:03.856396 2320 tablet.cc:1724] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:03.857300 2149 raft_consensus.cc:697] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:03.857328 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5e763c81e6e04a5c84aa92c7ad787054"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.858322 2149 consensus_queue.cc:237] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.861311 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c74d4bc43ada4b1aa48e77789c8e04b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.863221 528 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:37030 (request call id 263) took 1158 ms. Trace:
I20260619 19:54:03.871222 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a7c1681538764a19a55ac9927e210067"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:03.872375 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d84c42e7f7da440696e7684e3dd52ec2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:03.874114 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e763c81e6e04a5c84aa92c7ad787054 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.875736 527 master_service.cc:960] ReplaceTablet: received request to replace tablet d6a6ffdcd55d4db6870fe032f72ab3b1 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:03.877202 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1ff5eab435484861b8bccece188f7a46
W20260619 19:54:03.877512 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c74d4bc43ada4b1aa48e77789c8e04b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.878281 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ff5eab435484861b8bccece188f7a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.878753 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:03.878906 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_bc1fc8567cd045b1bd6b1e4679853fd3" } new_table_name: "default.Table_c1244375c2df41a68f9e4cff4248af68" modify_external_catalogs: true
I20260619 19:54:03.879267 2269 raft_consensus.cc:515] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.880563 2269 leader_election.cc:290] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.880766 2114 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:03.881326 2114 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 2 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:03.882176 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690a4fdf60947acb271abe588d4b5c0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:03.884378 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988e0a8b1b5b4f7cb68674af923454cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.885540 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c73b679e394f31b9e5d51681e06976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.885607 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 467bb41a4e9f46e497726c6b29ddeb04 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]) successfully deleted
I20260619 19:54:03.886296 900 tablet_service.cc:1511] Processing CreateTablet for tablet 6066043cb3e04a0f9e56376fc144338e (DEFAULT_TABLE table=default.Table_f0c38d52de164a0faf77ba776b51a3bd [id=a9396ffe9dae4c549124bfbfc17fcfec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.886649 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6066043cb3e04a0f9e56376fc144338e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.888067 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fade40bf3e7145f29076821f091677bd
I20260619 19:54:03.889585 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 65) took 4550 ms. Trace:
I20260619 19:54:03.889694 1994 rpcz_store.cc:276] 0619 19:53:59.339417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.339468 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:03.143508 (+3804040us) ts_tablet_manager.cc:1151] Deleting tablet aafe2a956b844c9998c84bbe52070e5d
0619 19:54:03.143550 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.732198 (+588648us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.829039 (+ 96841us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.889559 (+ 60520us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3803326}
I20260619 19:54:03.890069 1994 tablet_replica.cc:333] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:03.890237 1994 raft_consensus.cc:2243] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.890432 1994 raft_consensus.cc:2272] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.890273 528 rpcz_store.cc:276] 0619 19:54:02.688017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.251120 (+563103us) service_pool.cc:224] Handling call
0619 19:54:03.254560 (+ 3440us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570cf6c3 00007fd74db2b7c6 00007fd74db2b4f5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:03.256723 (+ 2163us) catalog_manager.cc:2126] Acquired catalog manager lock
0619 19:54:03.562500 (+305777us) catalog_manager.cc:2172] Created new table and tablet info
0619 19:54:03.846289 (+283789us) catalog_manager.cc:2232] Wrote table and tablets to system table
0619 19:54:03.846377 (+ 88us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0619 19:54:03.846455 (+ 78us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:03.758302 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:03.758480 (+ 178us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:03.758489 (+ 9us) write_op.cc:435] Acquired schema lock
0619 19:54:03.758491 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:03.758593 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:03.758608 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:03.758613 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:03.758695 (+ 82us) tablet.cc:701] Row locks acquired
0619 19:54:03.758698 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:03.758743 (+ 45us) write_op.cc:270] Start()
0619 19:54:03.758782 (+ 39us) write_op.cc:276] Timestamp: P: 1781898843758581 usec, L: 0
0619 19:54:03.758786 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:03.759022 (+ 236us) log.cc:844] Serialized 433 byte log entry
0619 19:54:03.826824 (+ 67802us) op_driver.cc:464] REPLICATION: finished
0619 19:54:03.827055 (+ 231us) write_op.cc:301] APPLY: starting
0619 19:54:03.827075 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:03.827124 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:03.827184 (+ 60us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:03.827324 (+ 140us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:03.827366 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0619 19:54:03.827373 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:03.827466 (+ 93us) log.cc:844] Serialized 29 byte log entry
0619 19:54:03.827537 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:03.827561 (+ 24us) write_op.cc:454] Released schema lock
0619 19:54:03.827568 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:03.827664 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:03.827670 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":6529792,"child_traces":[["op",{"apply.queue_time_us":170,"apply.run_cpu_time_us":593,"apply.run_wall_time_us":593,"mutex_wait_us":63651,"num_ops":2,"prepare.queue_time_us":195152,"prepare.run_cpu_time_us":887,"prepare.run_wall_time_us":887,"raft.queue_time_us":1376,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":311,"replication_time_us":67997}]]}
I20260619 19:54:03.890950 1994 ts_tablet_manager.cc:1916] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.891594 526 master_service.cc:960] ReplaceTablet: received request to replace tablet fe14a1f35cf14ca480221ee412c087da from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:03.892939 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7c1681538764a19a55ac9927e210067 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.894014 884 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.894728 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1539fb656324cfb8e3b05a67115f8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.890237 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet fade40bf3e7145f29076821f091677bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.896107 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc952b283d94035be1f86f3b90382b6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.896329 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet aafe2a956b844c9998c84bbe52070e5d (table default.Table_06fee996690b44c3ad920d2090ceffa6 [id=129e814ff97d42f188d80f6418013bab]) successfully deleted
I20260619 19:54:03.897210 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ff5eab435484861b8bccece188f7a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.899051 1208 tablet_bootstrap.cc:492] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:03.899289 1994 ts_tablet_manager.cc:1929] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:03.899389 1994 log.cc:1199] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:03.899758 1994 ts_tablet_manager.cc:1950] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:03.900516 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 71) took 4446 ms. Trace:
I20260619 19:54:03.900616 1994 rpcz_store.cc:276] 0619 19:53:59.453698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.486233 (+ 32535us) service_pool.cc:224] Handling call
0619 19:54:03.890027 (+4403794us) ts_tablet_manager.cc:1151] Deleting tablet a690a4fdf60947acb271abe588d4b5c0
0619 19:54:03.890036 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.894319 (+ 4283us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.899228 (+ 4909us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.900491 (+ 1263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4213283}
W20260619 19:54:03.900991 858 consensus_peers.cc:597] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f25c0378a6f4e9ea1a62d98f27778ee. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:03.901021 751 tablet_service.cc:1558] Processing DeleteTablet for tablet fade40bf3e7145f29076821f091677bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.901223 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f]) successfully deleted
I20260619 19:54:03.901485 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 82) took 4172 ms. Trace:
I20260619 19:54:03.902069 1994 rpcz_store.cc:276] 0619 19:53:59.729222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.729662 (+ 440us) service_pool.cc:224] Handling call
0619 19:54:03.901321 (+4171659us) ts_tablet_manager.cc:1151] Deleting tablet 2c71f92f4e3040c09b67e287a19eea74
0619 19:54:03.901331 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.901469 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4093900}
W20260619 19:54:03.902809 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 2c71f92f4e3040c09b67e287a19eea74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c71f92f4e3040c09b67e287a19eea74 already in progress: creating tablet
I20260619 19:54:03.903193 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 85) took 4078 ms. Trace:
I20260619 19:54:03.903986 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.903822 1994 rpcz_store.cc:276] 0619 19:53:59.824452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.824525 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:03.903031 (+4078506us) ts_tablet_manager.cc:1151] Deleting tablet 4b88dd7d19514e83857e2c6108291b9f
0619 19:54:03.903042 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.903175 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4075721}
W20260619 19:54:03.905041 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 4b88dd7d19514e83857e2c6108291b9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b88dd7d19514e83857e2c6108291b9f already in progress: creating tablet
I20260619 19:54:03.905107 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 87) took 4065 ms. Trace:
I20260619 19:54:03.905181 1994 rpcz_store.cc:276] 0619 19:53:59.840104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.840597 (+ 493us) service_pool.cc:224] Handling call
0619 19:54:03.904985 (+4064388us) ts_tablet_manager.cc:1151] Deleting tablet 8bc11c632b514118856ea4c11b431142
0619 19:54:03.904994 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.905090 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4062226}
W20260619 19:54:03.905616 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8bc11c632b514118856ea4c11b431142 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8bc11c632b514118856ea4c11b431142 already in progress: creating tablet
I20260619 19:54:03.906111 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 84) took 4082 ms. Trace:
I20260619 19:54:03.906589 1994 rpcz_store.cc:276] 0619 19:53:59.824136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.824241 (+ 105us) service_pool.cc:224] Handling call
0619 19:54:03.905987 (+4081746us) ts_tablet_manager.cc:1151] Deleting tablet f8a589ce3ae94cd1bb28b15e4e0e4a22
0619 19:54:03.905996 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.906093 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4051505}
I20260619 19:54:03.906706 1208 tablet_bootstrap.cc:654] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:03.907240 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 already in progress: creating tablet
I20260619 19:54:03.907328 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 86) took 4079 ms. Trace:
I20260619 19:54:03.907399 1994 rpcz_store.cc:276] 0619 19:53:59.827951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.828017 (+ 66us) service_pool.cc:224] Handling call
0619 19:54:03.907222 (+4079205us) ts_tablet_manager.cc:1151] Deleting tablet e6dcf87d57044279a218cbb21c383352
0619 19:54:03.907230 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.907314 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4044670}
W20260619 19:54:03.907810 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e6dcf87d57044279a218cbb21c383352 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6dcf87d57044279a218cbb21c383352 already in progress: creating tablet
I20260619 19:54:03.908285 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 83) took 4103 ms. Trace:
I20260619 19:54:03.908658 1994 rpcz_store.cc:276] 0619 19:53:59.804677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.806075 (+ 1398us) service_pool.cc:224] Handling call
0619 19:54:03.908172 (+4102097us) ts_tablet_manager.cc:1151] Deleting tablet 74949d09466f42e2852389e10192989d
0619 19:54:03.908181 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.908271 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3949477}
I20260619 19:54:03.909421 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 92) took 3948 ms. Trace:
W20260619 19:54:03.909524 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 74949d09466f42e2852389e10192989d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74949d09466f42e2852389e10192989d already in progress: creating tablet
I20260619 19:54:03.909793 1994 rpcz_store.cc:276] 0619 19:53:59.961168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.961917 (+ 749us) service_pool.cc:224] Handling call
0619 19:54:03.909318 (+3947401us) ts_tablet_manager.cc:1151] Deleting tablet 68788824224b426bb433b87763073bae
0619 19:54:03.909328 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.909405 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3938637}
W20260619 19:54:03.910168 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 68788824224b426bb433b87763073bae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68788824224b426bb433b87763073bae already in progress: creating tablet
I20260619 19:54:03.910436 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 93) took 3914 ms. Trace:
I20260619 19:54:03.910804 1994 rpcz_store.cc:276] 0619 19:53:59.996286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.996555 (+ 269us) service_pool.cc:224] Handling call
0619 19:54:03.910347 (+3913792us) ts_tablet_manager.cc:1151] Deleting tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
0619 19:54:03.910355 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.910423 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3913372}
W20260619 19:54:03.911391 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d already in progress: creating tablet
I20260619 19:54:03.911456 1994 tablet_replica.cc:333] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:03.911882 1994 raft_consensus.cc:2243] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.912352 1994 raft_consensus.cc:2272] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:03.912884 996 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:03.913007 996 leader_election.cc:304] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:03.913358 2114 raft_consensus.cc:2749] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:03.913532 996 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:03.913843 1994 ts_tablet_manager.cc:1916] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.915007 884 tablet_service.cc:1511] Processing CreateTablet for tablet 68ce666522bb468ca8457fe78bec9560 (DEFAULT_TABLE table=default.Table_11ebd5156f0249c0abafdda9c4392b11 [id=80831181a799460da41d2a7a8e9a29c1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:03.916715 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 88764.6us
I20260619 19:54:03.918802 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d6a6ffdcd55d4db6870fe032f72ab3b1
I20260619 19:54:03.919440 527 catalog_manager.cc:6784] ReplaceTablet: tablet d6a6ffdcd55d4db6870fe032f72ab3b1 deleted and replaced by tablet ac80d8fb9d874148bc8b0c508448804c
W20260619 19:54:03.919436 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f33c2c00b414fbebf1965510e1e2b96 consensus state has no leader
I20260619 19:54:03.921007 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 with delete_type TABLET_DATA_DELETED (replaced by tablet ac80d8fb9d874148bc8b0c508448804c) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.920954 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.921625 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb547965fc7e4aa29d427b1acc7d6e51" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:03.924357 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e01bf9476bef42e98a895c3e39d404e4" } modify_external_catalogs: true
I20260619 19:54:03.924618 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e01bf9476bef42e98a895c3e39d404e4" } modify_external_catalogs: true
I20260619 19:54:03.925303 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_107d4f6ff8314ea1b5ea10925d7f52bd" } modify_external_catalogs: true
I20260619 19:54:03.925508 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_107d4f6ff8314ea1b5ea10925d7f52bd" } modify_external_catalogs: true
I20260619 19:54:03.926100 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e0ce0d7cc0c64198a4c44d4bbd6a154f" } new_table_name: "default.Table_58686549f5974cedb2fc3a15c08d9207" modify_external_catalogs: true
I20260619 19:54:03.926680 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ce666522bb468ca8457fe78bec9560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.930145 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fe14a1f35cf14ca480221ee412c087da
I20260619 19:54:03.926017 887 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0c189a1a614e0cbd0862291eb0962a (DEFAULT_TABLE table=default.Table_f45ecb22649c41cf875aa7f1b1e017b0 [id=a85bed9349da4c70af600c8f333c8aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.931111 526 catalog_manager.cc:6784] ReplaceTablet: tablet fe14a1f35cf14ca480221ee412c087da deleted and replaced by tablet d84c4053cd194a27b86d9a924137dc15
I20260619 19:54:03.931373 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet fe14a1f35cf14ca480221ee412c087da with delete_type TABLET_DATA_DELETED (replaced by tablet d84c4053cd194a27b86d9a924137dc15) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:03.932502 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b79ac240d4f14940b5676186655549bc" } modify_external_catalogs: true
I20260619 19:54:03.932842 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b79ac240d4f14940b5676186655549bc" } modify_external_catalogs: true
I20260619 19:54:03.933562 1994 ts_tablet_manager.cc:1929] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:03.933720 1994 log.cc:1199] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/58e9d98ec1084b2ea9c087238686ed38
I20260619 19:54:03.934111 1994 ts_tablet_manager.cc:1950] T 58e9d98ec1084b2ea9c087238686ed38 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:03.935062 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 94) took 3676 ms. Trace:
I20260619 19:54:03.936839 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 58e9d98ec1084b2ea9c087238686ed38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:03.937326 2269 raft_consensus.cc:493] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:03.937460 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 with delete_type TABLET_DATA_DELETED (replaced by tablet ac80d8fb9d874148bc8b0c508448804c) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.937867 1994 rpcz_store.cc:276] 0619 19:54:00.259040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.259099 (+ 59us) service_pool.cc:224] Handling call
0619 19:54:03.911414 (+3652315us) ts_tablet_manager.cc:1151] Deleting tablet 58e9d98ec1084b2ea9c087238686ed38
0619 19:54:03.911423 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.926789 (+ 15366us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.933490 (+ 6701us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.935039 (+ 1549us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3652082}
I20260619 19:54:03.938993 1994 tablet_replica.cc:333] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:03.938993 751 tablet_service.cc:1558] Processing DeleteTablet for tablet fe14a1f35cf14ca480221ee412c087da with delete_type TABLET_DATA_DELETED (replaced by tablet d84c4053cd194a27b86d9a924137dc15) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:03.939375 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]) successfully deleted
I20260619 19:54:03.939445 1994 raft_consensus.cc:2243] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.939752 1994 raft_consensus.cc:2272] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.941409 1994 ts_tablet_manager.cc:1916] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.948001 923 raft_consensus.cc:2393] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:03.948311 922 raft_consensus.cc:2468] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:03.948689 2272 raft_consensus.cc:515] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.949327 1994 ts_tablet_manager.cc:1929] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.949446 1994 log.cc:1199] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/bb56767231db42bebb75a45b5d512de3
I20260619 19:54:03.949468 920 raft_consensus.cc:2393] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:03.949796 1994 ts_tablet_manager.cc:1950] T bb56767231db42bebb75a45b5d512de3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:03.950498 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0c189a1a614e0cbd0862291eb0962a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.951324 2269 raft_consensus.cc:515] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:03.952351 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1e6d16452b4e568745f884cd13ebac (DEFAULT_TABLE table=default.Table_673a1e52cb85474ca009c9f232b8c7d2 [id=5fbcc34aea0e444abedf15cf2f3c4ba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.952941 897 tablet_service.cc:1511] Processing CreateTablet for tablet 1e7b94596b0246628b963524983bb226 (DEFAULT_TABLE table=default.Table_a66ca1d30e274d2281b507485193b9b0 [id=68b401194bfd41f0b71116e5b7fc4216]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:03.953179 858 consensus_peers.cc:597] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd9c959792fa48e89b669520f7332b26. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:03.953807 2267 consensus_queue.cc:1048] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:03.955005 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:03.955216 776 raft_consensus.cc:3060] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.956435 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 95) took 3695 ms. Trace:
I20260619 19:54:03.956990 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1d0c78451479462d835429361c1cb37d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:03.957407 1994 rpcz_store.cc:276] 0619 19:54:00.261065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.261123 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:03.938942 (+3677819us) ts_tablet_manager.cc:1151] Deleting tablet bb56767231db42bebb75a45b5d512de3
0619 19:54:03.938953 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.946465 (+ 7512us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.949271 (+ 2806us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.956411 (+ 7140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3677611}
W20260619 19:54:03.957897 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d0c78451479462d835429361c1cb37d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:03.958348 1994 tablet_replica.cc:333] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:03.958416 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet bb56767231db42bebb75a45b5d512de3 (table default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]) successfully deleted
I20260619 19:54:03.958798 1994 raft_consensus.cc:2243] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:03.959396 1994 raft_consensus.cc:2272] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.960383 1994 ts_tablet_manager.cc:1916] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.964684 903 tablet_service.cc:1511] Processing CreateTablet for tablet b8f22a48856a436a9a5abcd9cae20620 (DEFAULT_TABLE table=default.Table_4b57592fb6a44808bcc5312ccbae5c03 [id=0e024a3b9e5a4fd298ed8eae005ca452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.970032 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb547965fc7e4aa29d427b1acc7d6e51" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:03.970269 917 raft_consensus.cc:3060] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:03.972898 1994 ts_tablet_manager.cc:1929] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.973786 1994 log.cc:1199] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/33cfbae501de432cbcb34d2a6365f806
I20260619 19:54:03.974350 1994 ts_tablet_manager.cc:1950] T 33cfbae501de432cbcb34d2a6365f806 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:03.975610 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 96) took 3655 ms. Trace:
W20260619 19:54:03.975652 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ae6164970ec4977a8c0c9fd24ab7275 consensus state has no leader
I20260619 19:54:03.976650 1994 rpcz_store.cc:276] 0619 19:54:00.319749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.319818 (+ 69us) service_pool.cc:224] Handling call
0619 19:54:03.958295 (+3638477us) ts_tablet_manager.cc:1151] Deleting tablet 33cfbae501de432cbcb34d2a6365f806
0619 19:54:03.958307 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.964265 (+ 5958us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.972832 (+ 8567us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.975587 (+ 2755us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3638244}
I20260619 19:54:03.977525 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 33cfbae501de432cbcb34d2a6365f806 (table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]) successfully deleted
I20260619 19:54:03.977923 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 101) took 3436 ms. Trace:
I20260619 19:54:03.969763 776 raft_consensus.cc:2468] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:03.978233 1994 rpcz_store.cc:276] 0619 19:54:00.541731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.541970 (+ 239us) service_pool.cc:224] Handling call
0619 19:54:03.977560 (+3435590us) ts_tablet_manager.cc:1151] Deleting tablet 56ba47943b9d4123985ea6ca1478cd93
0619 19:54:03.977572 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.977906 (+ 334us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3410322}
I20260619 19:54:03.966379 1973 ts_tablet_manager.cc:1929] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:03.978950 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 56ba47943b9d4123985ea6ca1478cd93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56ba47943b9d4123985ea6ca1478cd93 already in progress: creating tablet
I20260619 19:54:03.979288 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 102) took 3433 ms. Trace:
I20260619 19:54:03.979522 1994 rpcz_store.cc:276] 0619 19:54:00.545720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.545778 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:03.978968 (+3433190us) ts_tablet_manager.cc:1151] Deleting tablet 05c9a91f95bb4bcdafe493bab8c393b4
0619 19:54:03.978979 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.979272 (+ 293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3411652}
I20260619 19:54:03.978732 1973 log.cc:1199] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fbc952b283d94035be1f86f3b90382b6
W20260619 19:54:03.980270 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 05c9a91f95bb4bcdafe493bab8c393b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05c9a91f95bb4bcdafe493bab8c393b4 already in progress: creating tablet
I20260619 19:54:03.980588 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 105) took 3382 ms. Trace:
I20260619 19:54:03.971365 2160 raft_consensus.cc:515] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:03.980810 1994 rpcz_store.cc:276] 0619 19:54:00.606166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.609954 (+ 3788us) service_pool.cc:224] Handling call
0619 19:54:03.980274 (+3370320us) ts_tablet_manager.cc:1151] Deleting tablet b2902c7f67a1402987315ee426ddf1d2
0619 19:54:03.980286 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.980570 (+ 284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289242}
W20260619 19:54:03.981200 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b2902c7f67a1402987315ee426ddf1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2902c7f67a1402987315ee426ddf1d2 already in progress: creating tablet
I20260619 19:54:03.981412 1994 tablet_replica.cc:333] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:03.981829 1994 raft_consensus.cc:2243] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:03.982287 1994 raft_consensus.cc:2272] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:03.982722 783 raft_consensus.cc:2393] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 2: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:03.983089 1994 ts_tablet_manager.cc:1916] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:03.984619 1973 ts_tablet_manager.cc:1950] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:03.984901 996 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:03.985144 996 raft_consensus.cc:2686] T a690a4fdf60947acb271abe588d4b5c0 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:03.988142 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 70) took 4731 ms. Trace:
I20260619 19:54:03.989042 1994 ts_tablet_manager.cc:1929] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:03.989558 1973 rpcz_store.cc:276] 0619 19:53:59.256625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.260793 (+ 4168us) service_pool.cc:224] Handling call
0619 19:54:03.835388 (+4574595us) ts_tablet_manager.cc:1151] Deleting tablet fbc952b283d94035be1f86f3b90382b6
0619 19:54:03.835397 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.901403 (+ 66006us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.966069 (+ 64666us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.987942 (+ 21873us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4574419}
I20260619 19:54:03.992033 2272 leader_election.cc:290] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:03.993568 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fbc952b283d94035be1f86f3b90382b6 (table default.Table_03e300273881446b96748d3f1700e660 [id=54877119611f4e15a110f1c502001db6]) successfully deleted
I20260619 19:54:03.993914 899 tablet_service.cc:1511] Processing CreateTablet for tablet 087630689da0433ab876dcd3cd6bec0f (DEFAULT_TABLE table=default.Table_b060c9b13fe14e5b877dca744457d580 [id=0970415cc6c046f3a72f0dfb05a62257]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:03.994395 1208 tablet_bootstrap.cc:492] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:03.994555 1208 ts_tablet_manager.cc:1403] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.096s user 0.005s sys 0.000s
I20260619 19:54:03.995658 1208 raft_consensus.cc:359] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.995955 1208 raft_consensus.cc:385] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:03.996176 1208 raft_consensus.cc:740] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:03.996596 1208 consensus_queue.cc:260] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:03.997103 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1e6d16452b4e568745f884cd13ebac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:03.998420 1973 tablet_replica.cc:333] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:03.998762 2269 leader_election.cc:290] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:03.999058 1208 ts_tablet_manager.cc:1434] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 19:54:04.003086 1994 log.cc:1199] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/0dd210e843db4f58a976af5c28dabc9c
I20260619 19:54:04.003911 1994 ts_tablet_manager.cc:1950] T 0dd210e843db4f58a976af5c28dabc9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.005369 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 112) took 3094 ms. Trace:
W20260619 19:54:04.001842 720 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:03.999320 1973 raft_consensus.cc:2243] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.007570 1994 rpcz_store.cc:276] 0619 19:54:00.910831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.911091 (+ 260us) service_pool.cc:224] Handling call
0619 19:54:03.981361 (+3070270us) ts_tablet_manager.cc:1151] Deleting tablet 0dd210e843db4f58a976af5c28dabc9c
0619 19:54:03.981373 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.986085 (+ 4712us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:03.988988 (+ 2903us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.005320 (+ 16332us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3029543}
I20260619 19:54:04.008844 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 113) took 3095 ms. Trace:
W20260619 19:54:04.008908 898 consensus_meta.cc:287] T 788550efad2f4dbc917131cff1e76f09 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.503s user 0.005s sys 0.000s
I20260619 19:54:04.009290 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 0dd210e843db4f58a976af5c28dabc9c (table default.Table_4957c483382c45d7a305c7b4fd2ea6c8 [id=2daa177012434787b804b7721c3f91d2]) successfully deleted
I20260619 19:54:04.009378 1994 rpcz_store.cc:276] 0619 19:54:00.913184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.913260 (+ 76us) service_pool.cc:224] Handling call
0619 19:54:04.008699 (+3095439us) ts_tablet_manager.cc:1151] Deleting tablet 0b55debc1b064192a56d2453364ba260
0619 19:54:04.008712 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.008825 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3056704}
W20260619 19:54:04.011246 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0b55debc1b064192a56d2453364ba260 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b55debc1b064192a56d2453364ba260 already in progress: creating tablet
I20260619 19:54:04.011827 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1ca68b755bf841509b6ffcfbe212278c
I20260619 19:54:04.012168 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 114) took 3091 ms. Trace:
I20260619 19:54:04.012256 1994 rpcz_store.cc:276] 0619 19:54:00.920375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.920433 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:04.012052 (+3091619us) ts_tablet_manager.cc:1151] Deleting tablet a75baa585102481fa0ea01e87e394e32
0619 19:54:04.012063 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.012148 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3056558}
W20260619 19:54:04.013381 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a75baa585102481fa0ea01e87e394e32 because the tablet was not found. No further retry: Not found: Tablet not found: a75baa585102481fa0ea01e87e394e32
I20260619 19:54:04.013523 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca68b755bf841509b6ffcfbe212278c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.013223 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 115) took 3092 ms. Trace:
I20260619 19:54:04.014268 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca68b755bf841509b6ffcfbe212278c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.014744 1994 rpcz_store.cc:276] 0619 19:54:00.920712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.920768 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:04.013103 (+3092335us) ts_tablet_manager.cc:1151] Deleting tablet 10f6e202e8fd4a7292774d5eb4c7266b
0619 19:54:04.013113 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.013205 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3057522}
I20260619 19:54:04.014997 1973 raft_consensus.cc:2272] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:04.015583 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 10f6e202e8fd4a7292774d5eb4c7266b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6e202e8fd4a7292774d5eb4c7266b already in progress: creating tablet
I20260619 19:54:04.015995 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 117) took 2987 ms. Trace:
I20260619 19:54:04.016378 1994 rpcz_store.cc:276] 0619 19:54:01.028068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.028655 (+ 587us) service_pool.cc:224] Handling call
0619 19:54:04.015873 (+2987218us) ts_tablet_manager.cc:1151] Deleting tablet d895be304fcf445e9a4d2d8242becdd5
0619 19:54:04.015882 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.015979 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2885761}
I20260619 19:54:04.017076 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 4cd6b786bd844781af7fdc5849e90009
I20260619 19:54:04.017364 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 118) took 2989 ms. Trace:
I20260619 19:54:04.017434 1994 rpcz_store.cc:276] 0619 19:54:01.028188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.028902 (+ 714us) service_pool.cc:224] Handling call
0619 19:54:04.017249 (+2988347us) ts_tablet_manager.cc:1151] Deleting tablet 9f6ec149e1ac475f8038b328dae4af2a
0619 19:54:04.017258 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.017348 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2887075}
W20260619 19:54:04.017102 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d895be304fcf445e9a4d2d8242becdd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d895be304fcf445e9a4d2d8242becdd5 already in progress: creating tablet
W20260619 19:54:04.018626 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9f6ec149e1ac475f8038b328dae4af2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f6ec149e1ac475f8038b328dae4af2a already in progress: creating tablet
I20260619 19:54:04.018795 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd6b786bd844781af7fdc5849e90009 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.019277 1994 tablet_replica.cc:333] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.019488 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd6b786bd844781af7fdc5849e90009 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.020066 1994 raft_consensus.cc:2243] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.019757 1208 tablet_bootstrap.cc:492] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.020537 1994 raft_consensus.cc:2272] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.021814 532 catalog_manager.cc:5696] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:04.022307 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:04.022346 1994 ts_tablet_manager.cc:1916] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.022687 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:04.022943 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_069216990ae746dca4b43043b9485658 [id=8d6402c45a4d4456935a213be45b3c51]). Expected version 2 got 1
I20260619 19:54:04.023151 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:04.023373 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]). Expected version 2 got 0
I20260619 19:54:04.023515 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:04.026368 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f22a48856a436a9a5abcd9cae20620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.027335 917 raft_consensus.cc:2468] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:04.031723 751 tablet_service.cc:1511] Processing CreateTablet for tablet 8330e7df55694a7387cb9bdde32d2ba0 (DEFAULT_TABLE table=default.Table_9fa8c861b0b0409cae36b17be2580b3c [id=ddb04060197c492f86a18edc870b3305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.032137 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8330e7df55694a7387cb9bdde32d2ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.033543 1994 ts_tablet_manager.cc:1929] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:04.033646 1994 log.cc:1199] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/2448429656934063887b63d9a6e79894
I20260619 19:54:04.033986 1994 ts_tablet_manager.cc:1950] T 2448429656934063887b63d9a6e79894 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.039336 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e902d26af2734b138a7beda9b1fc800c" } new_table_name: "default.Table_064db418935f4a01a304fc26453b254e" modify_external_catalogs: true
I20260619 19:54:04.040089 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 116) took 3033 ms. Trace:
I20260619 19:54:04.040202 1994 rpcz_store.cc:276] 0619 19:54:01.006339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.050774 (+ 44435us) service_pool.cc:224] Handling call
0619 19:54:04.019230 (+2968456us) ts_tablet_manager.cc:1151] Deleting tablet 2448429656934063887b63d9a6e79894
0619 19:54:04.019240 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.028994 (+ 9754us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.033486 (+ 4492us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.040065 (+ 6579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2888290}
I20260619 19:54:04.040689 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]) successfully deleted
I20260619 19:54:04.041280 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 130) took 2536 ms. Trace:
I20260619 19:54:04.041374 1994 rpcz_store.cc:276] 0619 19:54:01.504395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.504464 (+ 69us) service_pool.cc:224] Handling call
0619 19:54:04.041157 (+2536693us) ts_tablet_manager.cc:1151] Deleting tablet 9b78d8a4d8dd42859be248b698257e2c
0619 19:54:04.041167 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.041260 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2536470}
W20260619 19:54:04.041828 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9b78d8a4d8dd42859be248b698257e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b78d8a4d8dd42859be248b698257e2c already in progress: creating tablet
I20260619 19:54:04.042740 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 131) took 2454 ms. Trace:
I20260619 19:54:04.043147 1994 rpcz_store.cc:276] 0619 19:54:01.588531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.589093 (+ 562us) service_pool.cc:224] Handling call
0619 19:54:04.042632 (+2453539us) ts_tablet_manager.cc:1151] Deleting tablet ba0cd4cd0661415d8b2b2339363e7aca
0619 19:54:04.042641 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.042721 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2401597}
W20260619 19:54:04.043876 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ba0cd4cd0661415d8b2b2339363e7aca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0cd4cd0661415d8b2b2339363e7aca already in progress: creating tablet
I20260619 19:54:04.044317 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 155) took 1932 ms. Trace:
I20260619 19:54:04.044715 1994 rpcz_store.cc:276] 0619 19:54:02.111731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.111941 (+ 210us) service_pool.cc:224] Handling call
0619 19:54:04.044212 (+1932271us) ts_tablet_manager.cc:1151] Deleting tablet 56640f773efb4123b93f4ca3799ddde7
0619 19:54:04.044221 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.044301 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1932021}
I20260619 19:54:04.045133 2160 leader_election.cc:290] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.045269 2314 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:04.045377 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 56640f773efb4123b93f4ca3799ddde7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56640f773efb4123b93f4ca3799ddde7 already in progress: creating tablet
I20260619 19:54:04.045439 2314 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.045686 1994 tablet_replica.cc:333] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.045861 1994 raft_consensus.cc:2243] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.046030 1994 raft_consensus.cc:2272] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.046169 2314 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.046643 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:04.047236 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:54:04.047269 720 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.048283 1994 ts_tablet_manager.cc:1916] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.048444 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc952b283d94035be1f86f3b90382b6" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:04.039880 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f658e85be0c843f2b02e4567a80521c4
I20260619 19:54:04.050086 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f658e85be0c843f2b02e4567a80521c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.050798 749 tablet_service.cc:1558] Processing DeleteTablet for tablet f658e85be0c843f2b02e4567a80521c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.053383 858 leader_election.cc:304] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:04.058609 1994 ts_tablet_manager.cc:1929] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:04.058764 1994 log.cc:1199] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/30e606b958d940c6a353a09a2eb627ee
I20260619 19:54:04.059428 1994 ts_tablet_manager.cc:1950] T 30e606b958d940c6a353a09a2eb627ee P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:04.059736 893 consensus_meta.cc:287] T 3bf769db8f5d45bf9c409876322350b3 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.557s user 0.007s sys 0.001s
W20260619 19:54:04.060245 890 consensus_meta.cc:287] T f96563f57f844df4814397f76ec42007 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.570s user 0.004s sys 0.000s
I20260619 19:54:04.060292 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 164) took 1724 ms. Trace:
I20260619 19:54:04.060418 1994 rpcz_store.cc:276] 0619 19:54:02.335874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.335920 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:04.045639 (+1709719us) ts_tablet_manager.cc:1151] Deleting tablet 30e606b958d940c6a353a09a2eb627ee
0619 19:54:04.045648 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.055408 (+ 9760us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.058540 (+ 3132us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.060265 (+ 1725us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1649574}
I20260619 19:54:04.060953 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]) successfully deleted
I20260619 19:54:04.063843 2026 ts_tablet_manager.cc:1929] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:04.063985 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0e0855e579384853b163816bd5b2efd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.064926 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e0855e579384853b163816bd5b2efd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:04.065836 889 consensus_meta.cc:287] T e68808ad4f64475782f8fba579fdb8bd P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.578s user 0.004s sys 0.000s
I20260619 19:54:04.066726 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b060c9b13fe14e5b877dca744457d580" } new_table_name: "default.Table_ab203fd14efa49c38a83e70eedd900f7" modify_external_catalogs: true
I20260619 19:54:04.068629 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2d0ef958689042fdaa6588675b99b3ec" } new_table_name: "default.Table_674e1047a5ad4fe2a56f104962de4b06" modify_external_catalogs: true
I20260619 19:54:04.069132 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 163) took 1733 ms. Trace:
I20260619 19:54:04.069640 1994 rpcz_store.cc:276] 0619 19:54:02.335750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.336191 (+ 441us) service_pool.cc:224] Handling call
0619 19:54:04.068961 (+1732770us) ts_tablet_manager.cc:1151] Deleting tablet c54b2e4f657245c2aa23d138968b3b0d
0619 19:54:04.068977 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.069107 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1672689}
W20260619 19:54:04.070508 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c54b2e4f657245c2aa23d138968b3b0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c54b2e4f657245c2aa23d138968b3b0d already in progress: creating tablet
I20260619 19:54:04.070888 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_945d82ba234a4bb78a5202e011447107"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.071012 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 165) took 1717 ms. Trace:
I20260619 19:54:04.071399 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_fd9dcd6a21e24888866aa67ba27aa6dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.071556 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_945d82ba234a4bb78a5202e011447107 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.071511 1994 rpcz_store.cc:276] 0619 19:54:02.353151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.353211 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:04.070882 (+1717671us) ts_tablet_manager.cc:1151] Deleting tablet fe814880d9984bbd83fa121cb2a34eac
0619 19:54:04.070893 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.070994 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1674557}
W20260619 19:54:04.072093 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fe814880d9984bbd83fa121cb2a34eac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe814880d9984bbd83fa121cb2a34eac already in progress: creating tablet
W20260619 19:54:04.072314 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd9dcd6a21e24888866aa67ba27aa6dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:04.073243 859 leader_election.cc:343] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.073633 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 166) took 1651 ms. Trace:
I20260619 19:54:04.073729 1994 rpcz_store.cc:276] 0619 19:54:02.422153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.422225 (+ 72us) service_pool.cc:224] Handling call
0619 19:54:04.073509 (+1651284us) ts_tablet_manager.cc:1151] Deleting tablet b4f7122fa5f94eeaa3b99cae107d8c9a
0619 19:54:04.073520 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.073615 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1650957}
W20260619 19:54:04.074256 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b4f7122fa5f94eeaa3b99cae107d8c9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f7122fa5f94eeaa3b99cae107d8c9a already in progress: creating tablet
W20260619 19:54:04.074625 859 consensus_peers.cc:597] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.075119 1994 tablet_replica.cc:333] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.075402 1994 raft_consensus.cc:2243] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.075560 1994 raft_consensus.cc:2272] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.076124 1994 ts_tablet_manager.cc:1916] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:04.076557 859 leader_election.cc:343] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:04.076925 859 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
I20260619 19:54:04.080503 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4d84da14868f41e5afe84ea58bd57ab9" } modify_external_catalogs: true
I20260619 19:54:04.080775 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4d84da14868f41e5afe84ea58bd57ab9" } modify_external_catalogs: true
I20260619 19:54:04.080979 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2d03b1734ab843dc98881985c497b171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.081537 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d03b1734ab843dc98881985c497b171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.085815 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087630689da0433ab876dcd3cd6bec0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.088877 1994 ts_tablet_manager.cc:1929] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:04.089043 1994 log.cc:1199] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:04.089408 1994 ts_tablet_manager.cc:1950] T 9a4c335fc5ca4885b5482c6b749f76f9 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.090286 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 167) took 1604 ms. Trace:
I20260619 19:54:04.090404 1994 rpcz_store.cc:276] 0619 19:54:02.485507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.485583 (+ 76us) service_pool.cc:224] Handling call
0619 19:54:04.075072 (+1589489us) ts_tablet_manager.cc:1151] Deleting tablet 9a4c335fc5ca4885b5482c6b749f76f9
0619 19:54:04.075081 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.082667 (+ 7586us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.088798 (+ 6131us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.090260 (+ 1462us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1589219}
I20260619 19:54:04.090950 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]) successfully deleted
I20260619 19:54:04.091365 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7babf9e56d174c6abc66c591fff1eace" } modify_external_catalogs: true
I20260619 19:54:04.091684 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7babf9e56d174c6abc66c591fff1eace" } modify_external_catalogs: true
I20260619 19:54:04.092903 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ce03fd125da04cad939b16878d300094"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.093593 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce03fd125da04cad939b16878d300094 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.093770 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7b94596b0246628b963524983bb226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.096028 1994 tablet_replica.cc:333] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.096251 1994 raft_consensus.cc:2243] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.096469 1994 raft_consensus.cc:2272] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:04.096508 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 54466.8us
I20260619 19:54:04.099675 1994 ts_tablet_manager.cc:1916] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.107012 2289 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:35892 (request call id 197) took 1437 ms. Trace:
W20260619 19:54:04.109521 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d77de42bb514452a8dc6a4a71289dc59 consensus state has no leader
I20260619 19:54:04.110146 2026 log.cc:1199] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/33935217c1f44ce0ad5b8610d368f2eb
I20260619 19:54:04.110812 2026 ts_tablet_manager.cc:1950] T 33935217c1f44ce0ad5b8610d368f2eb P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:04.111039 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 087630689da0433ab876dcd3cd6bec0f consensus state has no leader
I20260619 19:54:04.112054 1994 ts_tablet_manager.cc:1929] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:04.112185 1994 log.cc:1199] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/e4132f28c434492cbddc8da7d8075c43
I20260619 19:54:04.112607 1994 ts_tablet_manager.cc:1950] T e4132f28c434492cbddc8da7d8075c43 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.113765 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet e4132f28c434492cbddc8da7d8075c43 (table default.Table_93a36817c65c48b5b2e86a7b7a2937be [id=a57b082016f14ff48e4194fcbd7b63c1]) successfully deleted
W20260619 19:54:04.114666 858 leader_election.cc:343] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fbc952b283d94035be1f86f3b90382b6
I20260619 19:54:04.115468 2269 raft_consensus.cc:2804] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:04.116173 2269 raft_consensus.cc:697] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
W20260619 19:54:04.118038 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1202fe45d0964d368989f969e95f880d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1202fe45d0964d368989f969e95f880d already in progress: creating tablet
I20260619 19:54:04.117743 2269 consensus_queue.cc:237] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:04.119227 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 710fae36dd674b1786aa75013284684e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 710fae36dd674b1786aa75013284684e already in progress: creating tablet
W20260619 19:54:04.120216 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 495bafb07abe45da9f62138453dd6636 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495bafb07abe45da9f62138453dd6636 already in progress: creating tablet
I20260619 19:54:04.123541 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 93) took 3011 ms. Trace:
W20260619 19:54:04.123865 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 33935217c1f44ce0ad5b8610d368f2eb because the tablet was not found. No further retry: Not found: Tablet not found: 33935217c1f44ce0ad5b8610d368f2eb
W20260619 19:54:04.124578 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 550297c4d14f4d679d11fded97b671ae because the tablet was not found. No further retry: Not found: Tablet not found: 550297c4d14f4d679d11fded97b671ae
I20260619 19:54:04.124955 2026 rpcz_store.cc:276] 0619 19:54:01.099873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.099949 (+ 76us) service_pool.cc:224] Handling call
0619 19:54:03.050565 (+1950616us) ts_tablet_manager.cc:1151] Deleting tablet 33935217c1f44ce0ad5b8610d368f2eb
0619 19:54:03.050573 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:03.728189 (+677616us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.063767 (+335578us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.111587 (+ 47820us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1900020}
W20260619 19:54:04.125504 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e151dc97ad13456ba35708d50c9d7b26 because the tablet was not found. No further retry: Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26
W20260619 19:54:04.126286 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 2d1b7b743e594e2aaeaeedd8613d9789 because the tablet was not found. No further retry: Not found: Tablet not found: 2d1b7b743e594e2aaeaeedd8613d9789
W20260619 19:54:04.126943 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 467bb41a4e9f46e497726c6b29ddeb04 because the tablet was not found. No further retry: Not found: Tablet not found: 467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:54:04.127094 2026 tablet_replica.cc:333] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:04.127374 2026 raft_consensus.cc:2243] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.127765 2114 raft_consensus.cc:493] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.127903 2114 raft_consensus.cc:515] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.128232 2026 raft_consensus.cc:2272] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.128566 2114 leader_election.cc:290] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:04.129173 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:04.129241 720 consensus_peers.cc:597] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58e9d98ec1084b2ea9c087238686ed38. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.127914 1200 tablet_bootstrap.cc:492] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
W20260619 19:54:04.129659 996 leader_election.cc:343] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.129698 1208 tablet_bootstrap.cc:654] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.130282 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 8330e7df55694a7387cb9bdde32d2ba0 (DEFAULT_TABLE table=default.Table_9fa8c861b0b0409cae36b17be2580b3c [id=ddb04060197c492f86a18edc870b3305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.130664 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8330e7df55694a7387cb9bdde32d2ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.130656 2026 ts_tablet_manager.cc:1916] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.137233 1200 ts_tablet_manager.cc:1403] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.361s user 0.066s sys 0.069s
I20260619 19:54:04.137404 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_256452144ec04479a8f18bd678b4c377"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.138065 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_256452144ec04479a8f18bd678b4c377 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.138320 1200 raft_consensus.cc:359] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.138586 1200 raft_consensus.cc:385] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.138700 1200 raft_consensus.cc:740] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.138963 1200 consensus_queue.cc:260] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.139544 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2e8d0d77f8d24996b929a3d034b24a0c" } new_table_name: "default.Table_028e9140ed9c4ee1b7074363c4764cd9" modify_external_catalogs: true
W20260619 19:54:04.140332 720 consensus_peers.cc:597] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2448429656934063887b63d9a6e79894. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.140965 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b1a301cf915e4323bf1cd7290e158617"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.141342 1200 ts_tablet_manager.cc:1434] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260619 19:54:04.141564 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1a301cf915e4323bf1cd7290e158617 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.141848 1200 tablet_bootstrap.cc:492] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.142916 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_76a61e7b4ba448518ff8dc334fbffdbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.143497 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76a61e7b4ba448518ff8dc334fbffdbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:04.144079 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b7adec89ed984837a8cf3544679ca617 because the tablet was not found. No further retry: Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
W20260619 19:54:04.144788 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 45c0ffb4629a46349ccfe473cc20cdfc because the tablet was not found. No further retry: Not found: Tablet not found: 45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:54:04.145316 1200 tablet_bootstrap.cc:654] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.145781 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5ea9f17d5e75499a8433fc9a3043a88e because the tablet was not found. No further retry: Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:54:04.146440 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d91ecd7e40024b0d8a7ef143e32e2975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.146973 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5bae5be1340f4158a0b243415e232ae5 because the tablet was not found. No further retry: Not found: Tablet not found: 5bae5be1340f4158a0b243415e232ae5
W20260619 19:54:04.147500 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d91ecd7e40024b0d8a7ef143e32e2975 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:04.147919 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1a686826694b49b9bb5bcdefd61c9a15 because the tablet was not found. No further retry: Not found: Tablet not found: 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:04.148718 1994 tablet_replica.cc:333] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.148875 2272 raft_consensus.cc:493] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:04.149073 2272 raft_consensus.cc:515] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.149822 2272 leader_election.cc:290] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.149794 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 1202fe45d0964d368989f969e95f880d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.148970 1994 raft_consensus.cc:2243] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:04.151377 1994 raft_consensus.cc:2272] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.152062 1994 ts_tablet_manager.cc:1916] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.158193 1994 ts_tablet_manager.cc:1929] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260619 19:54:04.158839 859 leader_election.cc:343] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 620f3a56e57e49b7b520012857e71187
W20260619 19:54:04.161036 719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260619 19:54:04.161345 2149 raft_consensus.cc:493] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.161741 2149 raft_consensus.cc:515] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.162348 1994 log.cc:1199] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:04.162779 1994 ts_tablet_manager.cc:1950] T c83c093717ef4424b56d49e2689a6d0b P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.163368 2149 leader_election.cc:290] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.163903 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet c83c093717ef4424b56d49e2689a6d0b (table default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]) successfully deleted
W20260619 19:54:04.164265 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet dcc9c4167c58495fbfcf5fb60952c884 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcc9c4167c58495fbfcf5fb60952c884 already in progress: creating tablet
I20260619 19:54:04.164661 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:04.164933 1061 raft_consensus.cc:2468] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:04.164973 1038 tablet_service.cc:1511] Processing CreateTablet for tablet a9bdcbcf35e14a7ca2c0241478d278cd (DEFAULT_TABLE table=default.Table_9f78e22f0138463888f10d7f72494936 [id=8fcca511ff11429cb310e8c25b9b22ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.163331 751 tablet_service.cc:1511] Processing CreateTablet for tablet a9bdcbcf35e14a7ca2c0241478d278cd (DEFAULT_TABLE table=default.Table_9f78e22f0138463888f10d7f72494936 [id=8fcca511ff11429cb310e8c25b9b22ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.165349 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bdcbcf35e14a7ca2c0241478d278cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.166062 749 tablet_service.cc:1511] Processing CreateTablet for tablet c1a802a23b8149aab0ff6acfffbaf8a1 (DEFAULT_TABLE table=default.Table_aebafa0524114fdfac5a48b2f2ceedea [id=0a60a825f43645db8a914faee225f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:04.167318 717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260619 19:54:04.167879 720 leader_election.cc:304] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:04.175544 2149 raft_consensus.cc:2804] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:04.175769 2149 raft_consensus.cc:493] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:04.175899 2149 raft_consensus.cc:3060] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:04.177320 1994 tablet_replica.cc:333] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.177848 1994 raft_consensus.cc:2243] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.178364 1994 raft_consensus.cc:2272] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.179280 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6354f0bf977c438d9ffcf548901ac7af" } new_table_name: "default.Table_9b463251c2ed4c56aeccc8c045d3dd06" modify_external_catalogs: true
I20260619 19:54:04.181144 1994 ts_tablet_manager.cc:1916] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.182590 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:04.183511 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c40742ccfff440839dde7425edcac1d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.184084 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c40742ccfff440839dde7425edcac1d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.186522 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d905e7076014c818e1fb1ef09c15342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.130403 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:04.192185 1994 ts_tablet_manager.cc:1929] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:04.192320 1994 log.cc:1199] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/19d6333b0c8940b2802307d0da8a57ac
I20260619 19:54:04.192691 1994 ts_tablet_manager.cc:1950] T 19d6333b0c8940b2802307d0da8a57ac P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.193706 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 19d6333b0c8940b2802307d0da8a57ac (table default.Table_62d0e0d461a74b99bac5c2251f7f7f63 [id=73d986c5f5974ea790e236843abdf930]) successfully deleted
W20260619 19:54:04.196633 996 consensus_peers.cc:597] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.197785 1994 tablet_replica.cc:333] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.197991 1994 raft_consensus.cc:2243] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.198182 1994 raft_consensus.cc:2272] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.198722 1994 ts_tablet_manager.cc:1916] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.199559 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d905e7076014c818e1fb1ef09c15342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.200143 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d703c5c2820642aab6dd1e500ce1e9fd
I20260619 19:54:04.200891 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.201740 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.204813 1038 tablet_service.cc:1511] Processing CreateTablet for tablet c1a802a23b8149aab0ff6acfffbaf8a1 (DEFAULT_TABLE table=default.Table_aebafa0524114fdfac5a48b2f2ceedea [id=0a60a825f43645db8a914faee225f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.205245 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a802a23b8149aab0ff6acfffbaf8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.207784 1208 tablet_bootstrap.cc:492] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.207921 1208 ts_tablet_manager.cc:1403] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.193s user 0.004s sys 0.000s
I20260619 19:54:04.208660 1208 raft_consensus.cc:359] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.208818 1208 raft_consensus.cc:385] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.208876 1208 raft_consensus.cc:740] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.209100 1208 consensus_queue.cc:260] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.209944 1208 ts_tablet_manager.cc:1434] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:04.215229 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3ee262be56034610bb8b2369b98281e1" } modify_external_catalogs: true
I20260619 19:54:04.215675 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3ee262be56034610bb8b2369b98281e1" } modify_external_catalogs: true
I20260619 19:54:04.214833 1994 ts_tablet_manager.cc:1929] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:04.219305 1994 log.cc:1199] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/33ee0b30259741cdb2fb0e3c815e6b17
I20260619 19:54:04.219421 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3a52ed0a914a41d39dbd362b643ed5f2" } modify_external_catalogs: true
I20260619 19:54:04.219641 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3a52ed0a914a41d39dbd362b643ed5f2" } modify_external_catalogs: true
I20260619 19:54:04.219937 760 tablet_service.cc:1511] Processing CreateTablet for tablet 477afa2ffe2a4a56af72743159ccce95 (DEFAULT_TABLE table=default.Table_43e48f948c9d4202b33eec58d213f63b [id=57cba30507ad42768b085c1c47f925c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.220158 1994 ts_tablet_manager.cc:1950] T 33ee0b30259741cdb2fb0e3c815e6b17 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.221246 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]) successfully deleted
I20260619 19:54:04.221666 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 01fe4b37c74b4fb496f2842407c65eb1 from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:04.223172 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8ce7f825e5f84d5985427e83ee6a989d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ce7f825e5f84d5985427e83ee6a989d already in progress: creating tablet
I20260619 19:54:04.224557 1994 tablet_replica.cc:333] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.224982 1994 raft_consensus.cc:2243] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:04.225543 1994 raft_consensus.cc:2272] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.226572 1994 ts_tablet_manager.cc:1916] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.226542 2149 raft_consensus.cc:515] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:04.228690 996 leader_election.cc:343] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.228816 996 leader_election.cc:304] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:04.229048 2114 raft_consensus.cc:2749] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:04.234963 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 477afa2ffe2a4a56af72743159ccce95 (DEFAULT_TABLE table=default.Table_43e48f948c9d4202b33eec58d213f63b [id=57cba30507ad42768b085c1c47f925c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.235641 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477afa2ffe2a4a56af72743159ccce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.236030 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 33935217c1f44ce0ad5b8610d368f2eb (table default.Table_7ed722632f664c4f83d095f3acee831b [id=02f9b7422ad049e19c6d57b58f7fbc96]) successfully deleted
I20260619 19:54:04.244128 1200 tablet_bootstrap.cc:492] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.244379 1200 ts_tablet_manager.cc:1403] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.103s user 0.011s sys 0.019s
I20260619 19:54:04.245334 1200 raft_consensus.cc:359] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.245589 1200 raft_consensus.cc:385] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.245693 1200 raft_consensus.cc:740] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.245935 1200 consensus_queue.cc:260] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.247711 2114 consensus_queue.cc:1048] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:04.248240 2114 raft_consensus.cc:493] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.248351 2114 raft_consensus.cc:515] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.248919 2114 leader_election.cc:290] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:04.249439 1200 ts_tablet_manager.cc:1434] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:54:04.249779 1200 tablet_bootstrap.cc:492] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.251260 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 56ba47943b9d4123985ea6ca1478cd93 with delete_type TABLET_DATA_DELETED (replaced by tablet e4688dc20317479e9c80f6f41b3ea35e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.252323 1200 tablet_bootstrap.cc:654] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.253700 2267 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:04.254146 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8728156791db4d17b967c54596ef94cb" } modify_external_catalogs: true
I20260619 19:54:04.254356 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8728156791db4d17b967c54596ef94cb" } modify_external_catalogs: true
I20260619 19:54:04.255846 523 master_service.cc:960] ReplaceTablet: received request to replace tablet f658e85be0c843f2b02e4567a80521c4 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:04.256507 1994 ts_tablet_manager.cc:1929] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:04.256616 1994 log.cc:1199] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/76ffe451545c4af6821971384fce483e
I20260619 19:54:04.256996 1994 ts_tablet_manager.cc:1950] T 76ffe451545c4af6821971384fce483e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.253881 2267 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:04.258131 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 76ffe451545c4af6821971384fce483e (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]) successfully deleted
I20260619 19:54:04.258262 2272 raft_consensus.cc:493] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
W20260619 19:54:04.259599 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 02c5f9405d6a4a16bd49697001c201e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02c5f9405d6a4a16bd49697001c201e1 already in progress: creating tablet
W20260619 19:54:04.261058 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 47ace991ad1a4d52ab609940aacf6681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ace991ad1a4d52ab609940aacf6681 already in progress: creating tablet
I20260619 19:54:04.261108 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:04.262320 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0991105460f749e1854d512304ff56cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0991105460f749e1854d512304ff56cd already in progress: creating tablet
W20260619 19:54:04.263043 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1ff5eab435484861b8bccece188f7a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ff5eab435484861b8bccece188f7a46 already in progress: creating tablet
I20260619 19:54:04.263648 1994 tablet_replica.cc:333] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.264096 1994 raft_consensus.cc:2243] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.265129 1038 tablet_service.cc:1511] Processing CreateTablet for tablet b12efc4264ae48e29fbcd446ea161307 (DEFAULT_TABLE table=default.Table_94637363307d4dca9da129b82be2b4b5 [id=e8a646cb152d4b93a6c6807465e1c7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.265563 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12efc4264ae48e29fbcd446ea161307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.266695 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a918fc9dd9df4b9d928067cbd4dd0756" } new_table_name: "default.Table_027c74de9bf64a99bcca213da312268c" modify_external_catalogs: true
I20260619 19:54:04.267361 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 76ffe451545c4af6821971384fce483e with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3a48eabb574be3bc6883cf555b657f) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:04.239418 719 leader_election.cc:343] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.250923 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ba47943b9d4123985ea6ca1478cd93" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:04.271193 2267 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:04.271816 996 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:04.271044 719 leader_election.cc:343] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.272773 1994 raft_consensus.cc:2272] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.273104 719 leader_election.cc:304] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.273562 2328 raft_consensus.cc:2749] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:04.273770 719 leader_election.cc:304] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:04.273941 719 raft_consensus.cc:2686] T fbc952b283d94035be1f86f3b90382b6 P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:04.274025 1994 ts_tablet_manager.cc:1916] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:04.274770 719 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:04.275463 2328 consensus_queue.cc:1048] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:04.275550 719 leader_election.cc:343] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:04.275656 719 leader_election.cc:304] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:04.275784 719 raft_consensus.cc:2686] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:04.276412 2328 raft_consensus.cc:493] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.276543 2328 raft_consensus.cc:515] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.277201 2328 leader_election.cc:290] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.277137 747 tablet_service.cc:1511] Processing CreateTablet for tablet b12efc4264ae48e29fbcd446ea161307 (DEFAULT_TABLE table=default.Table_94637363307d4dca9da129b82be2b4b5 [id=e8a646cb152d4b93a6c6807465e1c7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.277195 2149 leader_election.cc:290] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.278121 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcb1050f57246feb65f7e8948856c21" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:04.278358 1061 raft_consensus.cc:2468] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:04.278692 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:04.278841 1057 raft_consensus.cc:3060] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:04.282215 1057 raft_consensus.cc:2468] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:04.283005 1994 ts_tablet_manager.cc:1929] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:04.283154 1994 log.cc:1199] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fade40bf3e7145f29076821f091677bd
I20260619 19:54:04.283540 1994 ts_tablet_manager.cc:1950] T fade40bf3e7145f29076821f091677bd P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.284754 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]) successfully deleted
I20260619 19:54:04.283288 720 leader_election.cc:304] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:04.285519 720 leader_election.cc:304] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:04.286249 2328 raft_consensus.cc:2804] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:04.286355 2328 raft_consensus.cc:493] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:04.286432 2328 raft_consensus.cc:3060] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:04.288017 1038 tablet_service.cc:1511] Processing CreateTablet for tablet ff91d9b348fe4990a0f9e260cb8745c0 (DEFAULT_TABLE table=default.Table_d0f21486f95f46bc925b3c31432fab7f [id=bb2b6fa519f442ff976ccb56f92ed8d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.288480 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff91d9b348fe4990a0f9e260cb8745c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.289925 2328 raft_consensus.cc:515] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.290683 2328 leader_election.cc:290] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.290877 2328 raft_consensus.cc:2804] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:04.291371 2328 raft_consensus.cc:697] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:04.291734 2328 consensus_queue.cc:237] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:04.292102 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90b8468df4a449d088f47b3b150ce54a consensus state has no leader
I20260619 19:54:04.292709 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcb1050f57246feb65f7e8948856c21" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:04.292959 1057 raft_consensus.cc:3060] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:04.293848 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 55695.2us
I20260619 19:54:04.296738 1057 raft_consensus.cc:2468] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:04.297837 720 leader_election.cc:304] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:04.298581 2324 raft_consensus.cc:2804] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:04.298727 2324 raft_consensus.cc:697] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:04.298947 2324 consensus_queue.cc:237] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.300261 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cfe3af94594f4627b2472e46a9473733"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.301148 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfe3af94594f4627b2472e46a9473733 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:04.306321 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6a6ffdcd55d4db6870fe032f72ab3b1 already in progress: creating tablet
W20260619 19:54:04.307940 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fe14a1f35cf14ca480221ee412c087da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe14a1f35cf14ca480221ee412c087da already in progress: creating tablet
W20260619 19:54:04.309213 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1ca68b755bf841509b6ffcfbe212278c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca68b755bf841509b6ffcfbe212278c already in progress: creating tablet
W20260619 19:54:04.310154 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 4cd6b786bd844781af7fdc5849e90009 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd6b786bd844781af7fdc5849e90009 already in progress: creating tablet
I20260619 19:54:04.310611 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_aa52395b83cb4c0e925e6cb80fe138fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.310820 996 consensus_peers.cc:597] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:04.311249 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f658e85be0c843f2b02e4567a80521c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f658e85be0c843f2b02e4567a80521c4 already in progress: creating tablet
W20260619 19:54:04.311299 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa52395b83cb4c0e925e6cb80fe138fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.311877 1994 tablet_replica.cc:333] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.312322 1994 raft_consensus.cc:2243] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.312788 1994 raft_consensus.cc:2272] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.314392 1994 ts_tablet_manager.cc:1916] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.303355 2272 raft_consensus.cc:515] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.315045 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7fecc933f5c14c979a3a376db9937ae0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.315201 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d7ba1a44bb894e6c96ae35d7fcc4c8da" } new_table_name: "default.Table_7adacc85728b464dbf461645536524d3" modify_external_catalogs: true
W20260619 19:54:04.315759 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fecc933f5c14c979a3a376db9937ae0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.317970 761 tablet_service.cc:1511] Processing CreateTablet for tablet ff91d9b348fe4990a0f9e260cb8745c0 (DEFAULT_TABLE table=default.Table_d0f21486f95f46bc925b3c31432fab7f [id=bb2b6fa519f442ff976ccb56f92ed8d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.321307 1994 ts_tablet_manager.cc:1929] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:04.321453 1994 log.cc:1199] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/1202fe45d0964d368989f969e95f880d
I20260619 19:54:04.321542 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 201) took 1008 ms. Trace:
I20260619 19:54:04.321661 892 rpcz_store.cc:276] 0619 19:54:03.060493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.060585 (+ 92us) service_pool.cc:224] Handling call
0619 19:54:03.070168 (+ 9583us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:03.070195 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:03.729102 (+658907us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.068738 (+339636us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:04.069122 (+ 384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:04.321761 1994 ts_tablet_manager.cc:1950] T 1202fe45d0964d368989f969e95f880d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.322845 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]) successfully deleted
I20260619 19:54:04.322990 746 tablet_service.cc:1511] Processing CreateTablet for tablet 277d68dd1d1d4b8b897f5e0b341ab47e (DEFAULT_TABLE table=default.Table_e7943a3044fe46f783ae56e66daf2120 [id=e90092810e4440b0bc4022f546c3b730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.323665 858 leader_election.cc:304] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.305708 902 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5eab435484861b8bccece188f7a46 (DEFAULT_TABLE table=default.Table_326c1bc01d404daaa76ea5322feb651f [id=69219d9461cc404098bff7e93aee21fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.325788 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.326308 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ace991ad1a4d52ab609940aacf6681 with delete_type TABLET_DATA_DELETED (replaced by tablet a7100b0bfa6d4e3baf4e7f90217f1fff) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.326534 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ba47943b9d4123985ea6ca1478cd93" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:04.332243 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9d905e7076014c818e1fb1ef09c15342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d905e7076014c818e1fb1ef09c15342 already in progress: creating tablet
I20260619 19:54:04.333232 1200 tablet_bootstrap.cc:492] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.333451 1200 ts_tablet_manager.cc:1403] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.084s user 0.006s sys 0.018s
I20260619 19:54:04.334300 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5f333b129935494783c07771a7db1b73" } new_table_name: "default.Table_32b31412506340c7ac33a174eda95f6b" modify_external_catalogs: true
I20260619 19:54:04.334378 1200 raft_consensus.cc:359] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.334714 2272 leader_election.cc:290] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.334793 1200 raft_consensus.cc:385] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.334956 1200 raft_consensus.cc:740] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.335582 1200 consensus_queue.cc:260] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.338780 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 277d68dd1d1d4b8b897f5e0b341ab47e (DEFAULT_TABLE table=default.Table_e7943a3044fe46f783ae56e66daf2120 [id=e90092810e4440b0bc4022f546c3b730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.339118 2324 raft_consensus.cc:493] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.339249 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277d68dd1d1d4b8b897f5e0b341ab47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.339275 2324 raft_consensus.cc:515] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.340050 2324 leader_election.cc:290] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.343878 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:04.344846 720 leader_election.cc:343] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:04.347232 720 consensus_peers.cc:597] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0dd210e843db4f58a976af5c28dabc9c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.347915 532 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet fb009a03ec6542c7ac63d90dad487f3f
I20260619 19:54:04.326251 2289 rpcz_store.cc:276] 0619 19:54:02.657676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.657888 (+ 212us) service_pool.cc:224] Handling call
0619 19:54:04.095269 (+1437381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:02.658292 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:54:02.658417 (+ 125us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:54:02.658428 (+ 11us) alter_schema_op.cc:66] Acquired schema lock
0619 19:54:02.658438 (+ 10us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:54:02.658486 (+ 48us) alter_schema_op.cc:128] START. Timestamp: 1781898842658440
0619 19:54:02.658489 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:02.658705 (+ 216us) log.cc:844] Serialized 173 byte log entry
0619 19:54:03.032333 (+373628us) op_driver.cc:464] REPLICATION: finished
0619 19:54:03.663863 (+631530us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:03.730694 (+ 66831us) log.cc:844] Serialized 5 byte log entry
0619 19:54:04.091558 (+360864us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.095177 (+ 3619us) log.cc:844] Serialized 14 byte log entry
0619 19:54:04.095219 (+ 42us) alter_schema_op.cc:73] Released schema lock
0619 19:54:04.095226 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":621178,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":23731,"prepare.run_wall_time_us":152432,"raft.queue_time_us":46543,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":38372,"replication_time_us":373808,"thread_start_us":842635,"threads_started":3,"wal-append.queue_time_us":138082}]]}
I20260619 19:54:04.348765 2289 tablet.cc:1724] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:04.350073 1200 ts_tablet_manager.cc:1434] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260619 19:54:04.351840 1200 tablet_bootstrap.cc:492] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.354061 1200 tablet_bootstrap.cc:654] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.355274 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d703c5c2820642aab6dd1e500ce1e9fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d703c5c2820642aab6dd1e500ce1e9fd already in progress: creating tablet
I20260619 19:54:04.355921 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 74949d09466f42e2852389e10192989d with delete_type TABLET_DATA_DELETED (replaced by tablet 5482cf46c91d426484938c387b785d61) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.356491 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 365c0bb1e9ac480e96e7f4d604048663 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:04.356688 1201 tablet_bootstrap.cc:492] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:04.356230 1994 tablet_replica.cc:333] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.358647 1994 raft_consensus.cc:2243] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.359087 1994 raft_consensus.cc:2272] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.360323 1994 ts_tablet_manager.cc:1916] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.361425 758 tablet_service.cc:1511] Processing CreateTablet for tablet fd8a4eb92c604f58adc35919f6bee273 (DEFAULT_TABLE table=default.Table_0d3189fcabab4e4d898b875f885c0c30 [id=5cd1c80889da435cab8e294c07bd69c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.365725 1038 tablet_service.cc:1511] Processing CreateTablet for tablet fd8a4eb92c604f58adc35919f6bee273 (DEFAULT_TABLE table=default.Table_0d3189fcabab4e4d898b875f885c0c30 [id=5cd1c80889da435cab8e294c07bd69c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.366333 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8a4eb92c604f58adc35919f6bee273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.369849 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ff5eab435484861b8bccece188f7a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.370172 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 33ee0b30259741cdb2fb0e3c815e6b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.370534 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5eab435484861b8bccece188f7a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.373080 894 tablet_service.cc:1558] Processing DeleteTablet for tablet fade40bf3e7145f29076821f091677bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.373996 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e68808ad4f64475782f8fba579fdb8bd
I20260619 19:54:04.374189 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 221) took 1008 ms. Trace:
I20260619 19:54:04.376420 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet e68808ad4f64475782f8fba579fdb8bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.377877 1201 ts_tablet_manager.cc:1403] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 1.496s user 0.013s sys 0.000s
I20260619 19:54:04.380852 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d with delete_type TABLET_DATA_DELETED (replaced by tablet bb514fda80e64ac9abc147d9a6adce76) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.381218 1994 ts_tablet_manager.cc:1929] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:04.382310 1200 tablet_bootstrap.cc:492] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.383953 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e68808ad4f64475782f8fba579fdb8bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.384137 1200 ts_tablet_manager.cc:1403] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.006s
I20260619 19:54:04.385011 1200 raft_consensus.cc:359] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.385298 1200 raft_consensus.cc:385] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.385411 1200 raft_consensus.cc:740] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.385704 1200 consensus_queue.cc:260] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.388065 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1b35a09aad46039677eb3d800b0051 (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.389264 1200 ts_tablet_manager.cc:1434] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260619 19:54:04.389631 1200 tablet_bootstrap.cc:492] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:04.391386 720 consensus_peers.cc:597] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a4c335fc5ca4885b5482c6b749f76f9. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.393018 1200 tablet_bootstrap.cc:654] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.399627 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bdcbcf35e14a7ca2c0241478d278cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.405999 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a802a23b8149aab0ff6acfffbaf8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.406371 1200 tablet_bootstrap.cc:492] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.406543 1200 ts_tablet_manager.cc:1403] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.003s
I20260619 19:54:04.406755 891 tablet_service.cc:1511] Processing CreateTablet for tablet 32648df603ac442396922383ffbd2e31 (DEFAULT_TABLE table=default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.407218 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32648df603ac442396922383ffbd2e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.407402 1200 raft_consensus.cc:359] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.407599 1200 raft_consensus.cc:385] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.407651 1200 raft_consensus.cc:740] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.407923 1200 consensus_queue.cc:260] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.410014 1200 ts_tablet_manager.cc:1434] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:04.410336 1200 tablet_bootstrap.cc:492] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.410488 886 rpcz_store.cc:276] 0619 19:54:03.293676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.647610 (+353934us) service_pool.cc:224] Handling call
0619 19:54:03.882170 (+234560us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:03.882205 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:04.013490 (+131285us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.302357 (+288867us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:04.302513 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:04.411686 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:04.411965 1200 tablet_bootstrap.cc:654] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.412478 1208 tablet_bootstrap.cc:492] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.413343 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477afa2ffe2a4a56af72743159ccce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.413936 1208 tablet_bootstrap.cc:654] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.416180 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dcf53365a32c41d199527fbf3350633f" } modify_external_catalogs: true
I20260619 19:54:04.416373 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dcf53365a32c41d199527fbf3350633f" } modify_external_catalogs: true
I20260619 19:54:04.419448 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12efc4264ae48e29fbcd446ea161307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.420712 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 0991105460f749e1854d512304ff56cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.422189 1994 log.cc:1199] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:04.422788 1994 ts_tablet_manager.cc:1950] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.423484 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff91d9b348fe4990a0f9e260cb8745c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.423514 1994 tablet_replica.cc:333] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.424310 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1b35a09aad46039677eb3d800b0051 (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.424813 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1b35a09aad46039677eb3d800b0051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.426509 1994 raft_consensus.cc:2243] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.426699 1994 raft_consensus.cc:2272] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.426779 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca68b755bf841509b6ffcfbe212278c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.427446 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]) successfully deleted
I20260619 19:54:04.427532 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277d68dd1d1d4b8b897f5e0b341ab47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.427858 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8a4eb92c604f58adc35919f6bee273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.427920 1994 ts_tablet_manager.cc:1916] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.431389 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1b35a09aad46039677eb3d800b0051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.432164 892 tablet_service.cc:1511] Processing CreateTablet for tablet a9bdcbcf35e14a7ca2c0241478d278cd (DEFAULT_TABLE table=default.Table_9f78e22f0138463888f10d7f72494936 [id=8fcca511ff11429cb310e8c25b9b22ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.435343 1994 ts_tablet_manager.cc:1929] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:04.435456 1994 log.cc:1199] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/74949d09466f42e2852389e10192989d
I20260619 19:54:04.435727 1994 ts_tablet_manager.cc:1950] T 74949d09466f42e2852389e10192989d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.436615 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bdcbcf35e14a7ca2c0241478d278cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.443754 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 74949d09466f42e2852389e10192989d (table default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07 [id=fcf00dfcc0374847883336aee0a57d34]) successfully deleted
W20260619 19:54:04.445591 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e68808ad4f64475782f8fba579fdb8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e68808ad4f64475782f8fba579fdb8bd already in progress: creating tablet
I20260619 19:54:04.456449 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 01fe4b37c74b4fb496f2842407c65eb1
I20260619 19:54:04.457439 526 catalog_manager.cc:6784] ReplaceTablet: tablet 01fe4b37c74b4fb496f2842407c65eb1 deleted and replaced by tablet f39a95a0ac714de388ed04a8a14e4f6d
I20260619 19:54:04.457787 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet f39a95a0ac714de388ed04a8a14e4f6d) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:04.458599 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 01fe4b37c74b4fb496f2842407c65eb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01fe4b37c74b4fb496f2842407c65eb1 already in progress: creating tablet
I20260619 19:54:04.458829 890 tablet_service.cc:1511] Processing CreateTablet for tablet b12efc4264ae48e29fbcd446ea161307 (DEFAULT_TABLE table=default.Table_94637363307d4dca9da129b82be2b4b5 [id=e8a646cb152d4b93a6c6807465e1c7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.468039 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:04.470036 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet f39a95a0ac714de388ed04a8a14e4f6d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.470044 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet fbc952b283d94035be1f86f3b90382b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:53 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.470316 1994 tablet_replica.cc:333] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:04.470510 1994 raft_consensus.cc:2243] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.470680 1994 raft_consensus.cc:2272] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.471797 1994 ts_tablet_manager.cc:1916] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.473326 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]). Expected version 2 got 0
I20260619 19:54:04.473726 526 catalog_manager.cc:5696] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:04.475633 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:04.476034 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d905e7076014c818e1fb1ef09c15342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.476538 894 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 with delete_type TABLET_DATA_DELETED (replaced by tablet ac80d8fb9d874148bc8b0c508448804c) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.476845 1201 raft_consensus.cc:359] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.477047 1201 raft_consensus.cc:385] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.477106 1201 raft_consensus.cc:740] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.477334 1201 consensus_queue.cc:260] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.477787 1201 ts_tablet_manager.cc:1434] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.100s user 0.002s sys 0.000s
I20260619 19:54:04.477797 1973 ts_tablet_manager.cc:1916] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.477903 1994 ts_tablet_manager.cc:1929] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:04.478017 1994 log.cc:1199] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fbc952b283d94035be1f86f3b90382b6
I20260619 19:54:04.478304 1994 ts_tablet_manager.cc:1950] T fbc952b283d94035be1f86f3b90382b6 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:04.479025 885 tablet_service.cc:1558] Processing DeleteTablet for tablet fe14a1f35cf14ca480221ee412c087da with delete_type TABLET_DATA_DELETED (replaced by tablet d84c4053cd194a27b86d9a924137dc15) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.479280 901 tablet_service.cc:1558] Processing DeleteTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.479416 896 tablet_service.cc:1511] Processing CreateTablet for tablet c1a802a23b8149aab0ff6acfffbaf8a1 (DEFAULT_TABLE table=default.Table_aebafa0524114fdfac5a48b2f2ceedea [id=0a60a825f43645db8a914faee225f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.479635 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fbc952b283d94035be1f86f3b90382b6 (table default.Table_03e300273881446b96748d3f1700e660 [id=54877119611f4e15a110f1c502001db6]) successfully deleted
I20260619 19:54:04.479949 2262 raft_consensus.cc:2749] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:04.476262 526 catalog_manager.cc:5696] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } }
I20260619 19:54:04.482506 889 tablet_service.cc:1511] Processing CreateTablet for tablet 477afa2ffe2a4a56af72743159ccce95 (DEFAULT_TABLE table=default.Table_43e48f948c9d4202b33eec58d213f63b [id=57cba30507ad42768b085c1c47f925c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.482976 886 tablet_service.cc:1511] Processing CreateTablet for tablet 8330e7df55694a7387cb9bdde32d2ba0 (DEFAULT_TABLE table=default.Table_9fa8c861b0b0409cae36b17be2580b3c [id=ddb04060197c492f86a18edc870b3305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.484395 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:04.488688 1201 tablet_bootstrap.cc:492] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:04.497464 1973 ts_tablet_manager.cc:1929] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260619 19:54:04.498507 996 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.498667 996 leader_election.cc:304] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:04.498839 996 raft_consensus.cc:2686] T 56ba47943b9d4123985ea6ca1478cd93 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:04.500669 893 tablet_service.cc:1511] Processing CreateTablet for tablet ff91d9b348fe4990a0f9e260cb8745c0 (DEFAULT_TABLE table=default.Table_d0f21486f95f46bc925b3c31432fab7f [id=bb2b6fa519f442ff976ccb56f92ed8d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.501123 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12efc4264ae48e29fbcd446ea161307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.503166 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd6b786bd844781af7fdc5849e90009 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.508496 1973 log.cc:1199] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:04.509040 1973 ts_tablet_manager.cc:1950] T a690a4fdf60947acb271abe588d4b5c0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:04.508174 2358 tablet.cc:1724] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:04.510792 1208 tablet_bootstrap.cc:492] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.511826 1208 ts_tablet_manager.cc:1403] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.099s user 0.005s sys 0.005s
I20260619 19:54:04.512807 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 85) took 5055 ms. Trace:
I20260619 19:54:04.513984 1973 rpcz_store.cc:276] 0619 19:53:59.457178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.457300 (+ 122us) service_pool.cc:224] Handling call
0619 19:54:03.992239 (+4534939us) ts_tablet_manager.cc:1151] Deleting tablet a690a4fdf60947acb271abe588d4b5c0
0619 19:54:03.992253 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.485042 (+492789us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.497387 (+ 12345us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.512784 (+ 15397us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4525029}
I20260619 19:54:04.514722 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a690a4fdf60947acb271abe588d4b5c0 (table default.Table_29f6e1631fc74719994ace470407f3e7 [id=dc9ba30342a24a7daaa7ffa73975cc9f]) successfully deleted
I20260619 19:54:04.514546 1208 raft_consensus.cc:359] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.515098 1208 raft_consensus.cc:385] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.515360 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 96) took 4348 ms. Trace:
I20260619 19:54:04.515265 1208 raft_consensus.cc:740] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.516939 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1b35a09aad46039677eb3d800b0051 (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.515496 1973 rpcz_store.cc:276] 0619 19:54:00.166908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.166956 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:04.515167 (+4348211us) ts_tablet_manager.cc:1151] Deleting tablet 74949d09466f42e2852389e10192989d
0619 19:54:04.515178 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.515341 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4339786}
W20260619 19:54:04.517549 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 74949d09466f42e2852389e10192989d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74949d09466f42e2852389e10192989d already in progress: creating tablet
I20260619 19:54:04.518435 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:04.522128 719 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.522253 719 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.523432 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:04.524062 719 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:04.524638 719 consensus_peers.cc:597] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.526165 2149 raft_consensus.cc:2749] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:04.527202 2362 tablet.cc:1724] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:04.527380 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet f39a95a0ac714de388ed04a8a14e4f6d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.530583 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:04.533632 719 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.535928 1208 consensus_queue.cc:260] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.537655 1208 ts_tablet_manager.cc:1434] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260619 19:54:04.538432 1208 tablet_bootstrap.cc:492] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.538709 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff91d9b348fe4990a0f9e260cb8745c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.540174 884 tablet_service.cc:1511] Processing CreateTablet for tablet 277d68dd1d1d4b8b897f5e0b341ab47e (DEFAULT_TABLE table=default.Table_e7943a3044fe46f783ae56e66daf2120 [id=e90092810e4440b0bc4022f546c3b730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.541419 903 tablet_service.cc:1558] Processing DeleteTablet for tablet e68808ad4f64475782f8fba579fdb8bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.540051 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcb1050f57246feb65f7e8948856c21" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:04.542476 917 raft_consensus.cc:2468] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:04.543334 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcb1050f57246feb65f7e8948856c21" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:04.544034 922 raft_consensus.cc:3060] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:04.544659 913 raft_consensus.cc:2468] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:04.550050 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 97) took 4350 ms. Trace:
I20260619 19:54:04.551682 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1b35a09aad46039677eb3d800b0051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.551244 1973 rpcz_store.cc:276] 0619 19:54:00.167292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.167336 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:04.517871 (+4350535us) ts_tablet_manager.cc:1151] Deleting tablet 2c71f92f4e3040c09b67e287a19eea74
0619 19:54:04.517882 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.517968 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4342448}
I20260619 19:54:04.552943 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8330e7df55694a7387cb9bdde32d2ba0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:04.553086 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2c71f92f4e3040c09b67e287a19eea74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c71f92f4e3040c09b67e287a19eea74 already in progress: creating tablet
I20260619 19:54:04.553798 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477afa2ffe2a4a56af72743159ccce95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.554497 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 98) took 4386 ms. Trace:
I20260619 19:54:04.555254 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a802a23b8149aab0ff6acfffbaf8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.555895 887 tablet_service.cc:1558] Processing DeleteTablet for tablet f658e85be0c843f2b02e4567a80521c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.555099 1973 rpcz_store.cc:276] 0619 19:54:00.167750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.167803 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:04.553752 (+4385949us) ts_tablet_manager.cc:1151] Deleting tablet f8a589ce3ae94cd1bb28b15e4e0e4a22
0619 19:54:04.553769 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.554357 (+ 588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4377971}
W20260619 19:54:04.557103 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 already in progress: creating tablet
I20260619 19:54:04.557557 1201 tablet_bootstrap.cc:654] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.558466 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 2718b9619524430388f0760485d8e4be
W20260619 19:54:04.558534 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42a3f254125141bf8783626e669717d2 consensus state has no leader
I20260619 19:54:04.561094 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 2718b9619524430388f0760485d8e4be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.561443 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277d68dd1d1d4b8b897f5e0b341ab47e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:04.561506 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9f33c2c00b414fbebf1965510e1e2b96 consensus state has no leader
W20260619 19:54:04.561910 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 2718b9619524430388f0760485d8e4be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2718b9619524430388f0760485d8e4be already in progress: creating tablet
I20260619 19:54:04.562108 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 2718b9619524430388f0760485d8e4be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.562755 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 99) took 4394 ms. Trace:
I20260619 19:54:04.563354 1973 rpcz_store.cc:276] 0619 19:54:00.168060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.168104 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:04.562586 (+4394482us) ts_tablet_manager.cc:1151] Deleting tablet 4b88dd7d19514e83857e2c6108291b9f
0619 19:54:04.562604 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.562732 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4382489}
I20260619 19:54:04.564297 899 tablet_service.cc:1511] Processing CreateTablet for tablet fd8a4eb92c604f58adc35919f6bee273 (DEFAULT_TABLE table=default.Table_0d3189fcabab4e4d898b875f885c0c30 [id=5cd1c80889da435cab8e294c07bd69c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:04.564746 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd8a4eb92c604f58adc35919f6bee273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:04.564777 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_20aa0629677a402ebdd6d659c87697d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.565510 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 100) took 4397 ms. Trace:
W20260619 19:54:04.565599 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20aa0629677a402ebdd6d659c87697d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.565987 1973 rpcz_store.cc:276] 0619 19:54:00.168525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.168572 (+ 47us) service_pool.cc:224] Handling call
0619 19:54:04.565372 (+4396800us) ts_tablet_manager.cc:1151] Deleting tablet e6dcf87d57044279a218cbb21c383352
0619 19:54:04.565383 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.565489 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4389581}
I20260619 19:54:04.566608 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 101) took 4397 ms. Trace:
I20260619 19:54:04.566565 2289 tablet.cc:1724] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:04.567305 1973 rpcz_store.cc:276] 0619 19:54:00.168866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.168917 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:04.566495 (+4397578us) ts_tablet_manager.cc:1151] Deleting tablet 8bc11c632b514118856ea4c11b431142
0619 19:54:04.566504 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.566593 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390662}
I20260619 19:54:04.568464 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 2718b9619524430388f0760485d8e4be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.568542 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 106) took 4340 ms. Trace:
I20260619 19:54:04.573333 1973 rpcz_store.cc:276] 0619 19:54:00.227647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.228291 (+ 644us) service_pool.cc:224] Handling call
0619 19:54:04.568434 (+4340143us) ts_tablet_manager.cc:1151] Deleting tablet 68788824224b426bb433b87763073bae
0619 19:54:04.568443 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.568526 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4339876}
I20260619 19:54:04.574226 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 107) took 4345 ms. Trace:
I20260619 19:54:04.574812 1973 rpcz_store.cc:276] 0619 19:54:00.228723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.229087 (+ 364us) service_pool.cc:224] Handling call
0619 19:54:04.574067 (+4344980us) ts_tablet_manager.cc:1151] Deleting tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
0619 19:54:04.574081 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.574206 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4344712}
I20260619 19:54:04.575461 1973 tablet_replica.cc:333] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:04.575984 1973 raft_consensus.cc:2243] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
W20260619 19:54:04.576766 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 470488us
I20260619 19:54:04.577306 1973 raft_consensus.cc:2272] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.582026 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_83bb8d4286d24179baa0a9b7155f15d7" } new_table_name: "default.Table_1da1f33c963f4f9dbddc94cb16006622" modify_external_catalogs: true
I20260619 19:54:04.584015 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8e946647b6d04169af7519314919e899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.585198 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e946647b6d04169af7519314919e899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.585242 1973 ts_tablet_manager.cc:1916] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.589267 1200 tablet_bootstrap.cc:492] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.589915 1200 ts_tablet_manager.cc:1403] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.180s user 0.044s sys 0.067s
I20260619 19:54:04.590906 1200 raft_consensus.cc:359] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.596062 1200 raft_consensus.cc:385] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.596374 1200 raft_consensus.cc:740] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.596938 1200 consensus_queue.cc:260] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.597301 719 leader_election.cc:304] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:04.598093 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 4b88dd7d19514e83857e2c6108291b9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b88dd7d19514e83857e2c6108291b9f already in progress: creating tablet
W20260619 19:54:04.598414 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e6dcf87d57044279a218cbb21c383352 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6dcf87d57044279a218cbb21c383352 already in progress: creating tablet
W20260619 19:54:04.598642 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8bc11c632b514118856ea4c11b431142 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8bc11c632b514118856ea4c11b431142 already in progress: creating tablet
I20260619 19:54:04.598731 2328 raft_consensus.cc:2804] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260619 19:54:04.598830 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 68788824224b426bb433b87763073bae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68788824224b426bb433b87763073bae already in progress: creating tablet
I20260619 19:54:04.598862 2328 raft_consensus.cc:493] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:04.598950 2328 raft_consensus.cc:3060] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:04.599081 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d already in progress: creating tablet
I20260619 19:54:04.595759 2358 tablet.cc:1724] T a33cb04fdb8944e8817d51bd56806665 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:04.601876 2328 raft_consensus.cc:515] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.604346 2328 leader_election.cc:290] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.607124 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:04.610239 1208 tablet_bootstrap.cc:654] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.611333 720 leader_election.cc:343] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.612830 2358 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33622 (request call id 224) took 1103 ms. Trace:
W20260619 19:54:04.613875 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e7877d111a0438da74b7bcf396e2c71 consensus state has no leader
W20260619 19:54:04.613860 720 consensus_peers.cc:597] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33ee0b30259741cdb2fb0e3c815e6b17. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.614338 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_34389f8a6c6a46a58a7b548dc552be87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.614559 1200 ts_tablet_manager.cc:1434] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.024s user 0.003s sys 0.001s
I20260619 19:54:04.614885 1200 tablet_bootstrap.cc:492] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:04.615087 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34389f8a6c6a46a58a7b548dc552be87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.612929 2358 rpcz_store.cc:276] 0619 19:54:03.509463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.509517 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:04.612811 (+1103294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:03.510046 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:54:03.510176 (+ 130us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:54:03.510190 (+ 14us) alter_schema_op.cc:66] Acquired schema lock
0619 19:54:03.510202 (+ 12us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:54:03.510255 (+ 53us) alter_schema_op.cc:128] START. Timestamp: 1781898843510205
0619 19:54:03.510258 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:03.510482 (+ 224us) log.cc:844] Serialized 173 byte log entry
0619 19:54:04.595482 (+1085000us) op_driver.cc:464] REPLICATION: finished
0619 19:54:04.595730 (+ 248us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:04.602413 (+ 6683us) log.cc:844] Serialized 5 byte log entry
0619 19:54:04.606314 (+ 3901us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.612492 (+ 6178us) log.cc:844] Serialized 14 byte log entry
0619 19:54:04.612769 (+ 277us) alter_schema_op.cc:73] Released schema lock
0619 19:54:04.612777 (+ 8us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":183,"mutex_wait_us":1076,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":10827,"prepare.run_wall_time_us":51923,"raft.queue_time_us":47,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1085183,"thread_start_us":51265,"threads_started":1,"wal-append.queue_time_us":48942}]]}
I20260619 19:54:04.618201 1200 tablet_bootstrap.cc:654] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.624723 1200 tablet_bootstrap.cc:492] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.625038 1200 ts_tablet_manager.cc:1403] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260619 19:54:04.626222 1200 raft_consensus.cc:359] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.626482 1200 raft_consensus.cc:385] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.626582 1200 raft_consensus.cc:740] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.626888 1200 consensus_queue.cc:260] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.627445 1200 ts_tablet_manager.cc:1434] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:04.630386 1200 tablet_bootstrap.cc:492] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.636359 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1d74433076a3413f90471ec48b668e5f" } modify_external_catalogs: true
I20260619 19:54:04.636633 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1d74433076a3413f90471ec48b668e5f" } modify_external_catalogs: true
I20260619 19:54:04.637177 1200 tablet_bootstrap.cc:654] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.638180 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74813bf79789451f90bcf7779aff9290 consensus state has no leader
I20260619 19:54:04.638770 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_adb64c17de7440e7b466da4499897ca7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.639514 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adb64c17de7440e7b466da4499897ca7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.641008 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:04.641603 532 catalog_manager.cc:6784] ReplaceTablet: tablet 365c0bb1e9ac480e96e7f4d604048663 deleted and replaced by tablet 85564712c0584e3f9c9a399a36709e5a
I20260619 19:54:04.642057 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_97566a6b6a6041ac9fceff103e3be47b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.642176 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 with delete_type TABLET_DATA_DELETED (replaced by tablet 85564712c0584e3f9c9a399a36709e5a) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:04.642681 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97566a6b6a6041ac9fceff103e3be47b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:04.643075 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 365c0bb1e9ac480e96e7f4d604048663 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 365c0bb1e9ac480e96e7f4d604048663 already in progress: creating tablet
I20260619 19:54:04.646171 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 with delete_type TABLET_DATA_DELETED (replaced by tablet 85564712c0584e3f9c9a399a36709e5a) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.652498 1973 ts_tablet_manager.cc:1929] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:04.653494 1973 log.cc:1199] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/58e9d98ec1084b2ea9c087238686ed38
I20260619 19:54:04.654146 1973 ts_tablet_manager.cc:1950] T 58e9d98ec1084b2ea9c087238686ed38 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:04.655588 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 108) took 4291 ms. Trace:
I20260619 19:54:04.657380 1200 tablet_bootstrap.cc:492] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.658186 1200 ts_tablet_manager.cc:1403] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.006s
I20260619 19:54:04.659561 1200 raft_consensus.cc:359] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.659960 1200 raft_consensus.cc:385] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.660145 1200 raft_consensus.cc:740] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.660562 1200 consensus_queue.cc:260] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.664060 1200 ts_tablet_manager.cc:1434] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260619 19:54:04.665328 1200 tablet_bootstrap.cc:492] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.675940 1200 tablet_bootstrap.cc:654] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.683569 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 910cf00e57404f1097800e84a2070b26
I20260619 19:54:04.684441 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_eaf224b2c52848e8a662b28c139cfa86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.685137 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eaf224b2c52848e8a662b28c139cfa86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.687610 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 910cf00e57404f1097800e84a2070b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:04.688416 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 910cf00e57404f1097800e84a2070b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 910cf00e57404f1097800e84a2070b26 already in progress: creating tablet
I20260619 19:54:04.669581 1208 tablet_bootstrap.cc:492] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.690109 1973 rpcz_store.cc:276] 0619 19:54:00.364162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.364208 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:04.575399 (+4211191us) ts_tablet_manager.cc:1151] Deleting tablet 58e9d98ec1084b2ea9c087238686ed38
0619 19:54:04.575411 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.631587 (+ 56176us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.652400 (+ 20813us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.655563 (+ 3163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4210703}
I20260619 19:54:04.683058 2362 tablet.cc:1719] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Skipping requested alter to schema version 3, tablet already version 3
I20260619 19:54:04.690497 1973 tablet_replica.cc:333] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:04.689826 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 910cf00e57404f1097800e84a2070b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.690699 1973 raft_consensus.cc:2243] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.690722 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 58e9d98ec1084b2ea9c087238686ed38 (table default.Table_3c367a8e42c347f890d88beca48e6c25 [id=3a2bdff6f24249e590394880488be413]) successfully deleted
I20260619 19:54:04.690883 1973 raft_consensus.cc:2272] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.691047 1208 ts_tablet_manager.cc:1403] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.006s
I20260619 19:54:04.691493 2362 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:56684 (request call id 254) took 1074 ms. Trace:
I20260619 19:54:04.692013 1200 tablet_bootstrap.cc:492] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.691610 2362 rpcz_store.cc:276] 0619 19:54:03.617048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.619221 (+ 2173us) service_pool.cc:224] Handling call
0619 19:54:04.691475 (+1072254us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:03.620148 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:54:03.620268 (+ 120us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:54:04.534674 (+914406us) alter_schema_op.cc:66] Acquired schema lock
0619 19:54:04.534687 (+ 13us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:54:04.534750 (+ 63us) alter_schema_op.cc:128] START. Timestamp: 1781898844534688
0619 19:54:04.534753 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:04.534967 (+ 214us) log.cc:844] Serialized 173 byte log entry
0619 19:54:04.682782 (+147815us) op_driver.cc:464] REPLICATION: finished
0619 19:54:04.683002 (+ 220us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:04.691169 (+ 8167us) log.cc:844] Serialized 94 byte log entry
0619 19:54:04.691430 (+ 261us) alter_schema_op.cc:73] Released schema lock
0619 19:54:04.691435 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":156,"prepare.queue_time_us":382,"prepare.run_cpu_time_us":64320,"prepare.run_wall_time_us":915391,"raft.queue_time_us":137,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":147980}]]}
I20260619 19:54:04.692225 1200 ts_tablet_manager.cc:1403] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.001s
I20260619 19:54:04.692319 1208 raft_consensus.cc:359] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.692500 1208 raft_consensus.cc:385] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.692612 1208 raft_consensus.cc:740] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.693416 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 910cf00e57404f1097800e84a2070b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.693485 1208 consensus_queue.cc:260] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.693535 1200 raft_consensus.cc:359] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.693784 1200 raft_consensus.cc:385] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.693928 1200 raft_consensus.cc:740] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.694389 1200 consensus_queue.cc:260] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.697154 1200 ts_tablet_manager.cc:1434] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:54:04.698199 1200 tablet_bootstrap.cc:492] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.698961 2324 consensus_queue.cc:1048] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:04.701525 1208 ts_tablet_manager.cc:1434] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260619 19:54:04.704665 1208 tablet_bootstrap.cc:492] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.706278 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:04.706508 917 raft_consensus.cc:3060] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:04.707741 1200 tablet_bootstrap.cc:654] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.708875 1208 tablet_bootstrap.cc:654] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.711855 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 with delete_type TABLET_DATA_DELETED (replaced by tablet 85564712c0584e3f9c9a399a36709e5a) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.712185 2337 tablet.cc:1724] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:04.712749 2026 ts_tablet_manager.cc:1929] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:04.713001 2026 log.cc:1199] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/1d0fe0c67fe84e5b866fd2553ea26d91
I20260619 19:54:04.713527 2026 ts_tablet_manager.cc:1950] T 1d0fe0c67fe84e5b866fd2553ea26d91 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:04.714427 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 94) took 3609 ms. Trace:
I20260619 19:54:04.714614 2026 rpcz_store.cc:276] 0619 19:54:01.104625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.104688 (+ 63us) service_pool.cc:224] Handling call
0619 19:54:04.125528 (+3020840us) ts_tablet_manager.cc:1151] Deleting tablet 1d0fe0c67fe84e5b866fd2553ea26d91
0619 19:54:04.125542 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.385703 (+260161us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.685023 (+299320us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.714376 (+ 29353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2974887}
I20260619 19:54:04.715170 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 96) took 3608 ms. Trace:
I20260619 19:54:04.715418 2026 rpcz_store.cc:276] 0619 19:54:01.107069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.107124 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:04.715020 (+3607896us) ts_tablet_manager.cc:1151] Deleting tablet b65f88b43b4e45c481aa7d43ef59fe7a
0619 19:54:04.715030 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.715115 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3564316}
I20260619 19:54:04.715948 922 raft_consensus.cc:2468] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:04.716360 1208 tablet_bootstrap.cc:492] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.716598 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 97) took 3608 ms. Trace:
I20260619 19:54:04.716694 1208 ts_tablet_manager.cc:1403] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260619 19:54:04.716841 2026 rpcz_store.cc:276] 0619 19:54:01.108109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.108166 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:04.716390 (+3608224us) ts_tablet_manager.cc:1151] Deleting tablet e3031a45cf534814bbece8d271c0420e
0619 19:54:04.716402 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:04.716533 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3565633}
I20260619 19:54:04.717407 2026 tablet_replica.cc:333] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:04.717882 2026 raft_consensus.cc:2243] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:04.718575 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 1d0fe0c67fe84e5b866fd2553ea26d91 (table default.Table_a40ad9bc744448b78938f33623ed8d56 [id=f848b07a0fe748fe9168a487db41e041]) successfully deleted
W20260619 19:54:04.719031 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b65f88b43b4e45c481aa7d43ef59fe7a because the tablet was not found. No further retry: Not found: Tablet not found: b65f88b43b4e45c481aa7d43ef59fe7a
W20260619 19:54:04.719377 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e3031a45cf534814bbece8d271c0420e because the tablet was not found. No further retry: Not found: Tablet not found: e3031a45cf534814bbece8d271c0420e
I20260619 19:54:04.719349 2026 raft_consensus.cc:2272] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:04.722193 1208 raft_consensus.cc:359] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.723732 1208 raft_consensus.cc:385] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.724306 1208 raft_consensus.cc:740] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:54:04.723455 858 leader_election.cc:343] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 6baa466f30c2460697217f526fc4617f
W20260619 19:54:04.724942 859 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:04.726214 1208 consensus_queue.cc:260] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.730803 1208 ts_tablet_manager.cc:1434] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.014s user 0.000s sys 0.003s
I20260619 19:54:04.691511 1973 ts_tablet_manager.cc:1916] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:04.736851 1208 tablet_bootstrap.cc:492] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.741080 1200 tablet_bootstrap.cc:492] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.741434 1200 ts_tablet_manager.cc:1403] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.007s
I20260619 19:54:04.742812 1200 raft_consensus.cc:359] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.743191 1200 raft_consensus.cc:385] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.743369 1200 raft_consensus.cc:740] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.743358 858 leader_election.cc:304] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.743772 1200 consensus_queue.cc:260] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.744868 1200 ts_tablet_manager.cc:1434] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:54:04.746057 1200 tablet_bootstrap.cc:492] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.750021 1201 tablet_bootstrap.cc:492] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:04.755817 1208 tablet_bootstrap.cc:654] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.756443 1200 tablet_bootstrap.cc:654] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.757107 2114 consensus_queue.cc:1048] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:04.767731 523 master_service.cc:960] ReplaceTablet: received request to replace tablet d703c5c2820642aab6dd1e500ce1e9fd from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:04.768409 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3091dd1a525a4f779c68b8b77afa5b26 consensus state has no leader
I20260619 19:54:04.782083 524 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_069216990ae746dca4b43043b9485658 [id=8d6402c45a4d4456935a213be45b3c51] alter complete (version 2)
I20260619 19:54:04.782550 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9b463251c2ed4c56aeccc8c045d3dd06" } modify_external_catalogs: true
I20260619 19:54:04.782753 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9b463251c2ed4c56aeccc8c045d3dd06" } modify_external_catalogs: true
I20260619 19:54:04.782965 1208 tablet_bootstrap.cc:492] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.784163 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a0283e721db2406c8c1a487f6cab6f46" } new_table_name: "default.Table_b5b750f7d094451590e28703c841b6c5" modify_external_catalogs: true
I20260619 19:54:04.785560 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:04.786159 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.786442 1208 ts_tablet_manager.cc:1403] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.007s
I20260619 19:54:04.787732 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_36823837347942e5b5cbe3975e6b0ce6" } modify_external_catalogs: true
I20260619 19:54:04.787961 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_36823837347942e5b5cbe3975e6b0ce6" } modify_external_catalogs: true
I20260619 19:54:04.790457 1200 tablet_bootstrap.cc:492] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.790768 1200 ts_tablet_manager.cc:1403] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.005s
I20260619 19:54:04.792150 1200 raft_consensus.cc:359] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.792507 1200 raft_consensus.cc:385] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.792742 1200 raft_consensus.cc:740] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.793270 1200 consensus_queue.cc:260] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.793578 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f305a99e3481419196532cb5c62c2500
I20260619 19:54:04.794628 525 master_service.cc:960] ReplaceTablet: received request to replace tablet f658e85be0c843f2b02e4567a80521c4 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:04.795809 1200 ts_tablet_manager.cc:1434] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260619 19:54:04.796269 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f305a99e3481419196532cb5c62c2500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:04.795730 1208 raft_consensus.cc:359] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.797339 1200 tablet_bootstrap.cc:492] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.797405 1208 raft_consensus.cc:385] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:54:04.798066 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f305a99e3481419196532cb5c62c2500 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f305a99e3481419196532cb5c62c2500 already in progress: creating tablet
I20260619 19:54:04.797844 1208 raft_consensus.cc:740] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.798885 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_945d82ba234a4bb78a5202e011447107" } modify_external_catalogs: true
I20260619 19:54:04.799077 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_945d82ba234a4bb78a5202e011447107" } modify_external_catalogs: true
I20260619 19:54:04.799785 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 1b18a61d955e4929998b90c6c8fa844e from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:04.799415 1208 consensus_queue.cc:260] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.805048 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_841448a18d3d49318e834d44004ae04e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:04.804942 1208 ts_tablet_manager.cc:1434] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
W20260619 19:54:04.806092 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_841448a18d3d49318e834d44004ae04e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:04.807722 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d91ecd7e40024b0d8a7ef143e32e2975" } new_table_name: "default.Table_7bf9ce3ed31647a9a20aaf013540e19f" modify_external_catalogs: true
I20260619 19:54:04.808043 1208 tablet_bootstrap.cc:492] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.811668 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f305a99e3481419196532cb5c62c2500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:04.812026 1200 tablet_bootstrap.cc:654] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.822144 1208 tablet_bootstrap.cc:654] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.833659 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 53101.5us
I20260619 19:54:04.837113 2273 raft_consensus.cc:493] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:04.837405 2269 raft_consensus.cc:493] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.841008 1200 tablet_bootstrap.cc:492] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.841317 1200 ts_tablet_manager.cc:1403] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.004s
I20260619 19:54:04.842602 1200 raft_consensus.cc:359] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.842947 1200 raft_consensus.cc:385] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.843158 1200 raft_consensus.cc:740] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.843600 1200 consensus_queue.cc:260] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.846791 1200 ts_tablet_manager.cc:1434] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260619 19:54:04.848263 2363 log.cc:927] Time spent T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260619 19:54:04.847517 1208 tablet_bootstrap.cc:492] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.848258 2314 consensus_queue.cc:1048] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:04.848860 2347 raft_consensus.cc:2749] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:04.849427 1201 ts_tablet_manager.cc:1403] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.319s user 0.009s sys 0.005s
I20260619 19:54:04.849555 1200 tablet_bootstrap.cc:492] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.849480 2114 raft_consensus.cc:493] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.849825 2114 raft_consensus.cc:515] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.850379 1201 raft_consensus.cc:359] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.850473 2114 leader_election.cc:290] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:04.850651 887 tablet_service.cc:1558] Processing DeleteTablet for tablet f305a99e3481419196532cb5c62c2500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:04.851423 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:04.851516 2358 tablet.cc:1724] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:04.851635 779 raft_consensus.cc:2393] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
W20260619 19:54:04.851948 859 leader_election.cc:343] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 2d64ccbb2f2840f4ac51cf8556da4a2c
I20260619 19:54:04.849609 1208 ts_tablet_manager.cc:1403] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.003s
I20260619 19:54:04.855227 1201 raft_consensus.cc:385] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.855347 1201 raft_consensus.cc:740] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.855585 1201 consensus_queue.cc:260] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.856124 1201 ts_tablet_manager.cc:1434] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:54:04.856439 1201 tablet_bootstrap.cc:492] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:04.858088 1201 tablet_bootstrap.cc:654] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.859759 1208 raft_consensus.cc:359] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.860677 1208 raft_consensus.cc:385] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.861215 1208 raft_consensus.cc:740] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.863956 917 raft_consensus.cc:2468] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:04.864460 719 leader_election.cc:304] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.864508 1208 consensus_queue.cc:260] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.864729 2314 raft_consensus.cc:2804] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:04.864960 2314 raft_consensus.cc:697] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:04.865180 2314 consensus_queue.cc:237] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.865442 1208 ts_tablet_manager.cc:1434] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:54:04.867301 1200 tablet_bootstrap.cc:654] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.867713 1208 tablet_bootstrap.cc:492] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.870148 1208 tablet_bootstrap.cc:654] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.873744 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 166692us
W20260619 19:54:04.875196 2357 log.cc:927] Time spent T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.112s user 0.000s sys 0.000s
I20260619 19:54:04.878841 1208 tablet_bootstrap.cc:492] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.879079 1208 ts_tablet_manager.cc:1403] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260619 19:54:04.879900 1208 raft_consensus.cc:359] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.880147 1208 raft_consensus.cc:385] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.880242 1208 raft_consensus.cc:740] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.880475 1208 consensus_queue.cc:260] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.885015 1208 ts_tablet_manager.cc:1434] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260619 19:54:04.893054 1208 tablet_bootstrap.cc:492] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.898646 1208 tablet_bootstrap.cc:654] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.907739 1200 tablet_bootstrap.cc:492] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.908015 1200 ts_tablet_manager.cc:1403] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.002s
I20260619 19:54:04.908963 1200 raft_consensus.cc:359] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.909221 1200 raft_consensus.cc:385] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.909323 1200 raft_consensus.cc:740] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.910161 1200 consensus_queue.cc:260] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.910869 1200 ts_tablet_manager.cc:1434] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:04.911233 1200 tablet_bootstrap.cc:492] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.913695 1200 tablet_bootstrap.cc:654] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.909763 2289 tablet.cc:1724] T a33cb04fdb8944e8817d51bd56806665 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:04.915548 2273 raft_consensus.cc:515] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.916392 2273 leader_election.cc:290] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.917467 2269 raft_consensus.cc:515] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:04.917807 1208 tablet_bootstrap.cc:492] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.917939 1208 ts_tablet_manager.cc:1403] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260619 19:54:04.918056 2269 leader_election.cc:290] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:04.918658 1208 raft_consensus.cc:359] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.918903 1208 raft_consensus.cc:385] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.919008 1208 raft_consensus.cc:740] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.919389 1208 consensus_queue.cc:260] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.920464 1208 ts_tablet_manager.cc:1434] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:54:04.921762 1208 tablet_bootstrap.cc:492] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:54:04.923555 2361 log.cc:927] Time spent T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.103s user 0.000s sys 0.000s
I20260619 19:54:04.923072 2350 raft_consensus.cc:493] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.925280 1200 tablet_bootstrap.cc:492] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.925402 2324 raft_consensus.cc:493] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.925498 1200 ts_tablet_manager.cc:1403] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260619 19:54:04.925527 2324 raft_consensus.cc:515] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.926664 2324 leader_election.cc:290] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.926873 1200 raft_consensus.cc:359] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.927094 1200 raft_consensus.cc:385] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.927206 1200 raft_consensus.cc:740] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.927536 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991c877feeae43c580d9471c25c4424c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:04.927681 1057 raft_consensus.cc:2468] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:04.927994 720 leader_election.cc:304] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:04.927963 1200 consensus_queue.cc:260] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.928493 2328 raft_consensus.cc:2804] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:04.928572 2328 raft_consensus.cc:493] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:04.928627 2328 raft_consensus.cc:3060] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:04.928710 1200 ts_tablet_manager.cc:1434] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:04.928974 1200 tablet_bootstrap.cc:492] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.930934 1200 tablet_bootstrap.cc:654] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.931877 2328 raft_consensus.cc:515] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.933058 2328 leader_election.cc:290] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.933143 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991c877feeae43c580d9471c25c4424c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:04.933323 1057 raft_consensus.cc:3060] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:04.934410 2337 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.222s user 0.000s sys 0.000s
I20260619 19:54:04.935887 1057 raft_consensus.cc:2468] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:04.936287 720 leader_election.cc:304] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:04.936579 2324 raft_consensus.cc:2804] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:04.936683 2324 raft_consensus.cc:697] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:04.936923 2324 consensus_queue.cc:237] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:04.939275 720 consensus_peers.cc:597] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fade40bf3e7145f29076821f091677bd. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.942173 1208 tablet_bootstrap.cc:654] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.949033 2350 raft_consensus.cc:515] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.951421 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991c877feeae43c580d9471c25c4424c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:04.954540 2350 leader_election.cc:290] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.956554 1200 tablet_bootstrap.cc:492] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.951741 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991c877feeae43c580d9471c25c4424c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:04.957219 1200 ts_tablet_manager.cc:1403] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
W20260619 19:54:04.957963 719 leader_election.cc:343] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.957983 1200 raft_consensus.cc:359] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:04.958390 719 leader_election.cc:343] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:04.958683 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 253) took 1405 ms. Trace:
I20260619 19:54:04.958799 897 rpcz_store.cc:276] 0619 19:54:03.513673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.940515 (+426842us) service_pool.cc:224] Handling call
0619 19:54:04.021574 (+ 81059us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:04.021602 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:04.433878 (+412276us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:04.919350 (+485472us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:04.919510 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:04.959316 1200 raft_consensus.cc:385] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.959579 1200 raft_consensus.cc:740] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.961663 1200 consensus_queue.cc:260] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.962723 1200 ts_tablet_manager.cc:1434] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:54:04.963418 1200 tablet_bootstrap.cc:492] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:04.958616 859 consensus_peers.cc:597] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30e606b958d940c6a353a09a2eb627ee. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.965416 1200 tablet_bootstrap.cc:654] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:04.965605 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 95778.2us
W20260619 19:54:04.966027 859 consensus_peers.cc:597] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4132f28c434492cbddc8da7d8075c43. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:04.967438 2328 raft_consensus.cc:493] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:04.967612 2328 raft_consensus.cc:515] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.968940 2328 leader_election.cc:290] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:04.969027 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:04.970314 1208 tablet_bootstrap.cc:492] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:04.970497 1208 ts_tablet_manager.cc:1403] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.007s
I20260619 19:54:04.971299 1208 raft_consensus.cc:359] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.971531 1208 raft_consensus.cc:385] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.971627 1208 raft_consensus.cc:740] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.971905 1208 consensus_queue.cc:260] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.972431 1208 ts_tablet_manager.cc:1434] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:04.972980 1208 tablet_bootstrap.cc:492] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:04.975095 1208 tablet_bootstrap.cc:654] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.975386 2432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.188:44433 every 8 connection(s)
I20260619 19:54:04.975752 1820 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.188:44433
I20260619 19:54:04.976974 1200 tablet_bootstrap.cc:492] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:04.977208 1200 ts_tablet_manager.cc:1403] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260619 19:54:04.978132 1820 server_base.cc:1193] Dumped server information to /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
I20260619 19:54:04.978101 1200 raft_consensus.cc:359] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.980351 2389 tablet.cc:1719] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Skipping requested alter to schema version 3, tablet already version 3
I20260619 19:54:04.984887 1200 raft_consensus.cc:385] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:04.985127 1200 raft_consensus.cc:740] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:04.985468 1200 consensus_queue.cc:260] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.986182 1200 ts_tablet_manager.cc:1434] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260619 19:54:04.986536 1200 tablet_bootstrap.cc:492] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:04.986649 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f32e1c7a27941ca9377901b19b32af3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:04.986851 776 raft_consensus.cc:2468] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:04.988703 1200 tablet_bootstrap.cc:654] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:04.990731 422 external_mini_cluster.cc:1434] Started /tmp/dist-test-task38CK2r/build/asan/bin/kudu as pid 1820
I20260619 19:54:04.993291 2347 raft_consensus.cc:493] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:04.993490 2347 raft_consensus.cc:515] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:04.994248 2347 leader_election.cc:290] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:04.994645 858 leader_election.cc:343] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 620f3a56e57e49b7b520012857e71187
I20260619 19:54:04.995420 858 leader_election.cc:304] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.996165 2273 raft_consensus.cc:2749] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:04.997474 858 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:04.997906 858 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:04.998205 2273 raft_consensus.cc:2749] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260619 19:54:04.999653 858 leader_election.cc:343] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 2d64ccbb2f2840f4ac51cf8556da4a2c
I20260619 19:54:04.999866 858 leader_election.cc:304] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.000200 2273 raft_consensus.cc:2749] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.006336 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33cb04fdb8944e8817d51bd56806665" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:05.007915 891 consensus_meta.cc:287] T 32648df603ac442396922383ffbd2e31 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.553s user 0.002s sys 0.002s
I20260619 19:54:05.010076 2026 ts_tablet_manager.cc:1916] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.010464 719 leader_election.cc:304] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.010772 2314 raft_consensus.cc:2749] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.026696 2365 raft_consensus.cc:493] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.026867 2365 raft_consensus.cc:515] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.027626 2365 leader_election.cc:290] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:05.028748 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.039263 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f32e1c7a27941ca9377901b19b32af3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.040699 1208 tablet_bootstrap.cc:492] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:05.040899 1208 ts_tablet_manager.cc:1403] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.004s
I20260619 19:54:05.048161 1208 raft_consensus.cc:359] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.048444 1208 raft_consensus.cc:385] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.048537 1208 raft_consensus.cc:740] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.048882 1208 consensus_queue.cc:260] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.049480 1208 ts_tablet_manager.cc:1434] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260619 19:54:05.049996 1208 tablet_bootstrap.cc:492] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:05.051980 1208 tablet_bootstrap.cc:654] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:05.056144 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 56491.6us
I20260619 19:54:05.063885 1208 tablet_bootstrap.cc:492] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:05.064049 1208 ts_tablet_manager.cc:1403] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260619 19:54:05.064868 1208 raft_consensus.cc:359] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.065030 1208 raft_consensus.cc:385] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.065086 1208 raft_consensus.cc:740] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.065287 1208 consensus_queue.cc:260] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.065717 1208 ts_tablet_manager.cc:1434] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:05.065953 1208 tablet_bootstrap.cc:492] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:05.072038 2434 sys_catalog.cc:263] Verifying existing consensus state
I20260619 19:54:05.074625 1058 raft_consensus.cc:3060] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.075493 2314 raft_consensus.cc:493] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.075618 2314 raft_consensus.cc:515] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.076202 2314 leader_election.cc:290] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.076783 1208 tablet_bootstrap.cc:654] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.076747 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.082130 1208 tablet_bootstrap.cc:492] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:05.082273 1208 ts_tablet_manager.cc:1403] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
W20260619 19:54:05.082306 859 leader_election.cc:343] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:05.082988 1208 raft_consensus.cc:359] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.083189 1208 raft_consensus.cc:385] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.083247 1208 raft_consensus.cc:740] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.085615 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:05.086210 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Bootstrap starting.
W20260619 19:54:05.085584 859 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:54:05.083436 1208 consensus_queue.cc:260] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:05.092418 859 leader_election.cc:343] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.092821 1208 ts_tablet_manager.cc:1434] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:54:05.093139 1208 tablet_bootstrap.cc:492] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:54:05.093619 859 leader_election.cc:343] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 184d655694434b0bbfa178fcd3110405
I20260619 19:54:05.102914 1208 tablet_bootstrap.cc:654] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:05.103413 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61adf222e10c490c9c8dd6f83edc1643 consensus state has no leader
I20260619 19:54:05.107816 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_02cea83081424efcbda7f7700b976e6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:05.108671 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 950b8e74d12f46a68ba5eae3186c87a9
W20260619 19:54:05.109046 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b2e40a7328d42dd864703db24c1fa3c has no consensus state
I20260619 19:54:05.109378 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ce03fd125da04cad939b16878d300094" } new_table_name: "default.Table_1297e60fa2f449378cd87ab38fa206b1" modify_external_catalogs: true
I20260619 19:54:05.110948 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cae61bfa5a3c4fa8b9eb4ab07b327be0" } new_table_name: "default.Table_8e9360a87f5a4f8b990df38ad739a3c5" modify_external_catalogs: true
I20260619 19:54:05.115602 2328 raft_consensus.cc:493] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.115814 2328 raft_consensus.cc:515] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.116659 2328 leader_election.cc:290] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.119977 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:05.124382 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c396a42add84c62acecb9bbb5d57f1d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.124596 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56ba47943b9d4123985ea6ca1478cd93" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.126353 2269 raft_consensus.cc:493] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:05.126488 2269 raft_consensus.cc:515] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:05.127175 2269 leader_election.cc:290] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.127293 2269 raft_consensus.cc:493] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:05.127384 2269 raft_consensus.cc:515] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:05.127530 719 leader_election.cc:304] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.127861 2269 leader_election.cc:290] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:05.127941 719 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.128645 751 tablet_service.cc:1511] Processing CreateTablet for tablet 180c3fd33d854a06a7cfd2f9671557a7 (DEFAULT_TABLE table=default.Table_c40742ccfff440839dde7425edcac1d8 [id=3691298b6c35435dbfbb423617072f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.129086 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180c3fd33d854a06a7cfd2f9671557a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.129050 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 180c3fd33d854a06a7cfd2f9671557a7 (DEFAULT_TABLE table=default.Table_c40742ccfff440839dde7425edcac1d8 [id=3691298b6c35435dbfbb423617072f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.129483 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180c3fd33d854a06a7cfd2f9671557a7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:05.131321 720 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:05.131433 720 leader_election.cc:304] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.131898 2324 raft_consensus.cc:2749] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.132074 2324 raft_consensus.cc:2749] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.134171 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:05.135985 523 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]). Expected version 2 got 0
I20260619 19:54:05.136226 523 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:05.136408 523 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:05.137199 523 catalog_manager.cc:5696] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:05.137799 523 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]). Expected version 2 got 0
I20260619 19:54:05.138124 523 catalog_manager.cc:5696] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:05.138547 523 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
W20260619 19:54:05.141903 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 84631.8us
I20260619 19:54:05.142788 2289 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260619 19:54:05.144923 858 consensus_peers.cc:597] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91e43148bb5b47128e08ed7faf8c7c1f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:05.145262 858 leader_election.cc:304] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.146961 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ef46cfced54742832fd3c01f952a9d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.147204 919 raft_consensus.cc:2393] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:05.147493 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365c0bb1e9ac480e96e7f4d604048663" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:05.148265 858 leader_election.cc:343] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:05.148370 858 leader_election.cc:304] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.148551 2272 raft_consensus.cc:2749] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.148761 2337 tablet.cc:1724] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:05.149718 858 leader_election.cc:343] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 68746ca7888e4af891238f79dcfdde10
I20260619 19:54:05.150205 996 leader_election.cc:304] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.149935 858 leader_election.cc:304] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.150485 2365 raft_consensus.cc:3060] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.151223 996 leader_election.cc:304] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.151535 2367 raft_consensus.cc:2749] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.152894 2365 raft_consensus.cc:2749] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.154429 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4ee47551aa224e8eb4ecb0fa3d80243b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:05.154654 2358 tablet.cc:1719] T 59123a56731645e1bbfcc94b2a46b1d6 P e78a44e2c8824fe7bce462e9d33f660c: Skipping requested alter to schema version 2, tablet already version 2
W20260619 19:54:05.155244 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ee47551aa224e8eb4ecb0fa3d80243b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.157831 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 950b8e74d12f46a68ba5eae3186c87a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.157723 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 950b8e74d12f46a68ba5eae3186c87a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.158288 1994 tablet_replica.cc:333] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:05.158535 1994 raft_consensus.cc:2243] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.158710 1994 raft_consensus.cc:2272] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.159391 1994 ts_tablet_manager.cc:1916] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:05.163827 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02cea83081424efcbda7f7700b976e6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.167755 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 789f44a51430454db30e41ad2dd2efb0 (DEFAULT_TABLE table=default.Table_256452144ec04479a8f18bd678b4c377 [id=206afee239284a8296ea0c97b8473de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.168191 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789f44a51430454db30e41ad2dd2efb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.170964 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 148cf851ef5f4ed18ce82ee94d567d55 (DEFAULT_TABLE table=default.Table_fd9dcd6a21e24888866aa67ba27aa6dc [id=8ba100d8990b41d2b5a236dc824443db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.175194 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148cf851ef5f4ed18ce82ee94d567d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.177495 760 tablet_service.cc:1511] Processing CreateTablet for tablet 148cf851ef5f4ed18ce82ee94d567d55 (DEFAULT_TABLE table=default.Table_fd9dcd6a21e24888866aa67ba27aa6dc [id=8ba100d8990b41d2b5a236dc824443db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.177886 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148cf851ef5f4ed18ce82ee94d567d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.179081 1026 tablet_service.cc:1511] Processing CreateTablet for tablet ce5569cf131d418db24aa0a36869ea69 (DEFAULT_TABLE table=default.Table_0e0855e579384853b163816bd5b2efd0 [id=d5336137bdc94a14a666cea088d28997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.179560 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5569cf131d418db24aa0a36869ea69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.184304 751 tablet_service.cc:1511] Processing CreateTablet for tablet 789f44a51430454db30e41ad2dd2efb0 (DEFAULT_TABLE table=default.Table_256452144ec04479a8f18bd678b4c377 [id=206afee239284a8296ea0c97b8473de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.184762 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789f44a51430454db30e41ad2dd2efb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.157469 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 950b8e74d12f46a68ba5eae3186c87a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.197049 2273 raft_consensus.cc:2749] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:05.197118 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 47406.2us
I20260619 19:54:05.197971 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
W20260619 19:54:05.157505 859 leader_election.cc:343] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d97025f1e0634720bc68d0a6196bd20b
I20260619 19:54:05.166908 896 tablet_service.cc:1511] Processing CreateTablet for tablet 180c3fd33d854a06a7cfd2f9671557a7 (DEFAULT_TABLE table=default.Table_c40742ccfff440839dde7425edcac1d8 [id=3691298b6c35435dbfbb423617072f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.200598 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180c3fd33d854a06a7cfd2f9671557a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.202632 760 tablet_service.cc:1511] Processing CreateTablet for tablet ce5569cf131d418db24aa0a36869ea69 (DEFAULT_TABLE table=default.Table_0e0855e579384853b163816bd5b2efd0 [id=d5336137bdc94a14a666cea088d28997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.202840 884 tablet_service.cc:1511] Processing CreateTablet for tablet ce5569cf131d418db24aa0a36869ea69 (DEFAULT_TABLE table=default.Table_0e0855e579384853b163816bd5b2efd0 [id=d5336137bdc94a14a666cea088d28997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.203251 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5569cf131d418db24aa0a36869ea69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.203537 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5569cf131d418db24aa0a36869ea69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.204180 749 tablet_service.cc:1511] Processing CreateTablet for tablet 71ddb48c4b48459791bd3aaa7982a7e6 (DEFAULT_TABLE table=default.Table_1d0c78451479462d835429361c1cb37d [id=a1c535a77d1d41beb14d391f77471055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.204527 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ddb48c4b48459791bd3aaa7982a7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.207394 761 tablet_service.cc:1511] Processing CreateTablet for tablet 47eb6580ead349188460a0fb8ada1262 (DEFAULT_TABLE table=default.Table_a7c1681538764a19a55ac9927e210067 [id=748d8068846d4927a60ee5d041028f01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.207544 892 tablet_service.cc:1511] Processing CreateTablet for tablet 47eb6580ead349188460a0fb8ada1262 (DEFAULT_TABLE table=default.Table_a7c1681538764a19a55ac9927e210067 [id=748d8068846d4927a60ee5d041028f01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.207760 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47eb6580ead349188460a0fb8ada1262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.207845 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47eb6580ead349188460a0fb8ada1262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.212680 1994 ts_tablet_manager.cc:1929] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:05.212824 1994 log.cc:1199] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/950b8e74d12f46a68ba5eae3186c87a9
I20260619 19:54:05.213260 1994 ts_tablet_manager.cc:1950] T 950b8e74d12f46a68ba5eae3186c87a9 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:05.217584 779 raft_consensus.cc:3060] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.219844 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 950b8e74d12f46a68ba5eae3186c87a9 (table default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]) successfully deleted
I20260619 19:54:05.220497 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 71ddb48c4b48459791bd3aaa7982a7e6 (DEFAULT_TABLE table=default.Table_1d0c78451479462d835429361c1cb37d [id=a1c535a77d1d41beb14d391f77471055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.179440 2347 raft_consensus.cc:2804] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:05.221035 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ddb48c4b48459791bd3aaa7982a7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.221068 2347 raft_consensus.cc:493] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:05.221170 2347 raft_consensus.cc:3060] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.182510 891 tablet_service.cc:1511] Processing CreateTablet for tablet 789f44a51430454db30e41ad2dd2efb0 (DEFAULT_TABLE table=default.Table_256452144ec04479a8f18bd678b4c377 [id=206afee239284a8296ea0c97b8473de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.222332 1973 ts_tablet_manager.cc:1929] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:05.222447 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789f44a51430454db30e41ad2dd2efb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.222441 1973 log.cc:1199] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/bb56767231db42bebb75a45b5d512de3
I20260619 19:54:05.222771 1973 ts_tablet_manager.cc:1950] T bb56767231db42bebb75a45b5d512de3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:05.224020 1200 tablet_bootstrap.cc:492] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:05.224131 1200 ts_tablet_manager.cc:1403] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.238s user 0.025s sys 0.045s
I20260619 19:54:05.224871 1200 raft_consensus.cc:359] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.225039 1200 raft_consensus.cc:385] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.225087 1200 raft_consensus.cc:740] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.225253 1026 tablet_service.cc:1511] Processing CreateTablet for tablet bdaa6ef43cab4cb384b92bd43c472901 (DEFAULT_TABLE table=default.Table_d84c42e7f7da440696e7684e3dd52ec2 [id=e3ef68b633dd478da71a802305824355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.225260 1200 consensus_queue.cc:260] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.225674 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdaa6ef43cab4cb384b92bd43c472901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.225787 1200 ts_tablet_manager.cc:1434] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:05.226022 1200 tablet_bootstrap.cc:492] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:05.228097 1200 tablet_bootstrap.cc:654] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.228159 2347 raft_consensus.cc:515] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.228741 2347 leader_election.cc:290] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.230461 2367 raft_consensus.cc:493] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.230580 2367 raft_consensus.cc:515] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.231356 2367 leader_election.cc:290] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:05.231910 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cad702900111463fa298c76098746bfb consensus state has no leader
I20260619 19:54:05.232065 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.232272 780 raft_consensus.cc:2393] T 369cb2f2b599469680eed94a221c2f27 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:05.232255 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 79f8635b919a44a8a1e5fe48420ca4b7 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:05.232700 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1b18a61d955e4929998b90c6c8fa844e
I20260619 19:54:05.233428 531 catalog_manager.cc:6784] ReplaceTablet: tablet 1b18a61d955e4929998b90c6c8fa844e deleted and replaced by tablet ca02c454eec840eb9289950b6da7b131
I20260619 19:54:05.234287 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 28a09107b11d480dba8c456fc8753ad1
I20260619 19:54:05.235193 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5a96ee39da6c4a1a8987e658455b7ebf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:05.235459 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 90b8468df4a449d088f47b3b150ce54a
W20260619 19:54:05.235968 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a96ee39da6c4a1a8987e658455b7ebf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.236310 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6fa059c58932422ab8d776397d5a3379" } new_table_name: "default.Table_f79091265bad4f8dbe6a97b1a36a81d2" modify_external_catalogs: true
I20260619 19:54:05.189469 2026 ts_tablet_manager.cc:1929] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:05.191927 889 tablet_service.cc:1511] Processing CreateTablet for tablet 148cf851ef5f4ed18ce82ee94d567d55 (DEFAULT_TABLE table=default.Table_fd9dcd6a21e24888866aa67ba27aa6dc [id=8ba100d8990b41d2b5a236dc824443db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.240422 1200 tablet_bootstrap.cc:492] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:05.240470 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148cf851ef5f4ed18ce82ee94d567d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.240566 1200 ts_tablet_manager.cc:1403] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.005s
W20260619 19:54:05.241079 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f39a95a0ac714de388ed04a8a14e4f6d consensus state has no leader
I20260619 19:54:05.241312 1200 raft_consensus.cc:359] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.241487 1200 raft_consensus.cc:385] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.241534 1200 raft_consensus.cc:740] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.241482 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a427aad23ffe4518bea23a19e106d9da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:05.242203 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a427aad23ffe4518bea23a19e106d9da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.243000 1200 consensus_queue.cc:260] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.195353 2337 tablet.cc:1719] T 59123a56731645e1bbfcc94b2a46b1d6 P 95181cc281b946c8b81aa825232d9498: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:54:05.244011 1200 ts_tablet_manager.cc:1434] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:05.244289 1200 tablet_bootstrap.cc:492] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:05.246096 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_acb740f517fd4c61bff72f7ceafb5f75" } modify_external_catalogs: true
I20260619 19:54:05.246214 886 tablet_service.cc:1511] Processing CreateTablet for tablet 71ddb48c4b48459791bd3aaa7982a7e6 (DEFAULT_TABLE table=default.Table_1d0c78451479462d835429361c1cb37d [id=a1c535a77d1d41beb14d391f77471055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.246330 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_acb740f517fd4c61bff72f7ceafb5f75" } modify_external_catalogs: true
I20260619 19:54:05.246644 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ddb48c4b48459791bd3aaa7982a7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.247735 2026 log.cc:1199] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a75baa585102481fa0ea01e87e394e32
I20260619 19:54:05.248075 2026 ts_tablet_manager.cc:1950] T a75baa585102481fa0ea01e87e394e32 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:05.248368 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 98) took 4139 ms. Trace:
I20260619 19:54:05.248435 2026 rpcz_store.cc:276] 0619 19:54:01.109052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.109100 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:04.717256 (+3608156us) ts_tablet_manager.cc:1151] Deleting tablet a75baa585102481fa0ea01e87e394e32
0619 19:54:04.717268 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.161662 (+444394us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.189257 (+ 27595us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.248351 (+ 59094us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3566451}
I20260619 19:54:05.249114 1200 tablet_bootstrap.cc:654] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.250273 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_899273cda1db49d083179e31919b0526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:05.250526 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f32e1c7a27941ca9377901b19b32af3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:05.250710 780 raft_consensus.cc:3060] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:05.251025 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_899273cda1db49d083179e31919b0526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.253494 780 raft_consensus.cc:2468] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:05.254810 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 28a09107b11d480dba8c456fc8753ad1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.255244 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b8468df4a449d088f47b3b150ce54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.256304 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet a75baa585102481fa0ea01e87e394e32 (table default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]) successfully deleted
I20260619 19:54:05.257522 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_62fe6139c5d044fdbbb960537c4609d2" } modify_external_catalogs: true
I20260619 19:54:05.257758 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_62fe6139c5d044fdbbb960537c4609d2" } modify_external_catalogs: true
I20260619 19:54:05.259034 2451 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260619 19:54:05.260063 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b18a61d955e4929998b90c6c8fa844e with delete_type TABLET_DATA_DELETED (replaced by tablet ca02c454eec840eb9289950b6da7b131) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.260502 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 28a09107b11d480dba8c456fc8753ad1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.260759 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b18a61d955e4929998b90c6c8fa844e with delete_type TABLET_DATA_DELETED (replaced by tablet ca02c454eec840eb9289950b6da7b131) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:05.261039 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 103536us
I20260619 19:54:05.262387 526 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:05.262444 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 28a09107b11d480dba8c456fc8753ad1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.262523 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 47eb6580ead349188460a0fb8ada1262 (DEFAULT_TABLE table=default.Table_a7c1681538764a19a55ac9927e210067 [id=748d8068846d4927a60ee5d041028f01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.262852 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b8468df4a449d088f47b3b150ce54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.262969 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47eb6580ead349188460a0fb8ada1262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.263118 526 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:05.263841 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057] alter complete (version 2)
I20260619 19:54:05.265715 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_964ffc6514a5430fbe8b02896e73a88d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:05.266467 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_964ffc6514a5430fbe8b02896e73a88d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.268376 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369cb2f2b599469680eed94a221c2f27" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.269783 2273 raft_consensus.cc:493] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.269915 2273 raft_consensus.cc:515] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.270514 2273 leader_election.cc:290] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.271090 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_02cb77fd6301496d895a8deaf26a694c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:05.271327 859 leader_election.cc:343] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 82d2dd6eedd24f44a6a17aceb20e62bb
W20260619 19:54:05.272151 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02cb77fd6301496d895a8deaf26a694c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.268587 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet fe14a1f35cf14ca480221ee412c087da with delete_type TABLET_DATA_DELETED (replaced by tablet d84c4053cd194a27b86d9a924137dc15) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.268919 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 with delete_type TABLET_DATA_DELETED (replaced by tablet 85564712c0584e3f9c9a399a36709e5a) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.272827 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3091dd1a525a4f779c68b8b77afa5b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.273015 1057 raft_consensus.cc:2468] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:05.274065 2272 raft_consensus.cc:493] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:05.274190 2272 raft_consensus.cc:515] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.274732 2272 leader_election.cc:290] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.268980 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.270131 2114 raft_consensus.cc:493] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.275120 2114 raft_consensus.cc:515] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.275290 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f32e1c7a27941ca9377901b19b32af3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:05.275472 1056 raft_consensus.cc:3060] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.275887 2114 leader_election.cc:290] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.270509 996 leader_election.cc:304] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.276991 2114 raft_consensus.cc:3060] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.278074 1056 raft_consensus.cc:2468] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:05.278664 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f32e1c7a27941ca9377901b19b32af3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.278880 917 raft_consensus.cc:2393] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:05.279731 2272 raft_consensus.cc:493] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:05.279860 2272 raft_consensus.cc:515] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.280048 2114 raft_consensus.cc:2749] T 369cb2f2b599469680eed94a221c2f27 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.280440 2272 leader_election.cc:290] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:05.281687 920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s user 0.005s sys 0.004s
W20260619 19:54:05.281780 920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s user 0.005s sys 0.004s
W20260619 19:54:05.283504 2357 log.cc:927] Time spent T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.084s user 0.001s sys 0.000s
I20260619 19:54:05.283497 859 leader_election.cc:304] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:05.283820 2272 raft_consensus.cc:2804] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:05.283882 2272 raft_consensus.cc:493] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:05.283942 2272 raft_consensus.cc:3060] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.286899 2272 raft_consensus.cc:515] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.287385 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 33935217c1f44ce0ad5b8610d368f2eb with delete_type TABLET_DATA_DELETED (replaced by tablet c2f9e5a4dedd4c81901cb99fecff0919) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.287575 2272 leader_election.cc:290] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.287986 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f32e1c7a27941ca9377901b19b32af3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.288420 777 raft_consensus.cc:2393] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:05.288980 996 leader_election.cc:304] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.289630 2114 raft_consensus.cc:2749] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.290051 859 leader_election.cc:304] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:05.290407 859 leader_election.cc:343] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 2d1b7b743e594e2aaeaeedd8613d9789
I20260619 19:54:05.290597 2347 raft_consensus.cc:2804] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:05.291774 2347 raft_consensus.cc:697] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:05.292701 2347 consensus_queue.cc:237] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.293809 2324 consensus_queue.cc:1048] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:05.290998 858 leader_election.cc:343] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 184d655694434b0bbfa178fcd3110405
I20260619 19:54:05.295722 858 leader_election.cc:304] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:05.296264 858 consensus_peers.cc:597] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b08ab9ad59049919649b96890b6785d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:05.296540 2273 raft_consensus.cc:2749] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.298903 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3091dd1a525a4f779c68b8b77afa5b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:05.299197 1057 raft_consensus.cc:3060] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.302059 1057 raft_consensus.cc:2468] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:05.303493 2358 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260619 19:54:05.307700 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 28a09107b11d480dba8c456fc8753ad1 because the tablet was not found. No further retry: Not found: Tablet not found: 28a09107b11d480dba8c456fc8753ad1
I20260619 19:54:05.309963 2026 tablet_replica.cc:333] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:05.310324 2026 raft_consensus.cc:2243] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.310598 2026 raft_consensus.cc:2272] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.313643 2026 ts_tablet_manager.cc:1916] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.315631 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 109) took 4951 ms. Trace:
I20260619 19:54:05.312361 859 leader_election.cc:304] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:05.317550 2273 raft_consensus.cc:2804] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:05.317703 2273 raft_consensus.cc:697] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:05.317993 2273 consensus_queue.cc:237] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.292865 1201 tablet_bootstrap.cc:492] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:05.325167 1201 ts_tablet_manager.cc:1403] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.469s user 0.002s sys 0.010s
I20260619 19:54:05.326434 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
W20260619 19:54:05.331700 720 consensus_peers.cc:597] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19d6333b0c8940b2802307d0da8a57ac. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:05.332973 1973 rpcz_store.cc:276] 0619 19:54:00.364287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.364718 (+ 431us) service_pool.cc:224] Handling call
0619 19:54:04.690438 (+4325720us) ts_tablet_manager.cc:1151] Deleting tablet bb56767231db42bebb75a45b5d512de3
0619 19:54:04.690451 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.063265 (+372814us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.222278 (+159013us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.315600 (+ 93322us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4321839}
W20260619 19:54:05.312647 858 leader_election.cc:343] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 82d2dd6eedd24f44a6a17aceb20e62bb
W20260619 19:54:05.327373 859 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
I20260619 19:54:05.333657 1201 raft_consensus.cc:359] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.344496 1201 raft_consensus.cc:385] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.344592 1201 raft_consensus.cc:740] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.344874 1201 consensus_queue.cc:260] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.345561 1201 ts_tablet_manager.cc:1434] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.013s user 0.000s sys 0.000s
I20260619 19:54:05.345883 1201 tablet_bootstrap.cc:492] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:05.340392 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:05.340032 858 leader_election.cc:304] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.346671 2343 raft_consensus.cc:2749] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:05.346932 858 leader_election.cc:343] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d97025f1e0634720bc68d0a6196bd20b
I20260619 19:54:05.347000 1994 tablet_replica.cc:333] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:05.347075 858 leader_election.cc:304] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.347234 1994 raft_consensus.cc:2243] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.347332 2343 raft_consensus.cc:2749] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.347441 1994 raft_consensus.cc:2272] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.348358 1994 ts_tablet_manager.cc:1916] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.348774 2453 tablet.cc:1724] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:05.351972 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3091dd1a525a4f779c68b8b77afa5b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.352237 781 raft_consensus.cc:2468] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:05.354549 2272 raft_consensus.cc:493] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:05.354561 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3091dd1a525a4f779c68b8b77afa5b26" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:05.354734 779 raft_consensus.cc:3060] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.354849 2272 raft_consensus.cc:515] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.357553 779 raft_consensus.cc:2468] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:05.358453 1058 raft_consensus.cc:3060] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.359419 2324 consensus_queue.cc:1048] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:05.360412 858 leader_election.cc:343] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 2d1b7b743e594e2aaeaeedd8613d9789
I20260619 19:54:05.360544 858 leader_election.cc:304] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.360920 2343 raft_consensus.cc:2749] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:05.360956 858 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
I20260619 19:54:05.361030 858 leader_election.cc:304] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.361202 2343 raft_consensus.cc:2749] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.333650 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet bb56767231db42bebb75a45b5d512de3 (table default.Table_ddb7644529644ea3ab7f8fcca9fdfc34 [id=532778a39cbd483ba4711f67365c992a]) successfully deleted
I20260619 19:54:05.363298 896 tablet_service.cc:1511] Processing CreateTablet for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba (DEFAULT_TABLE table=default.Table_c74d4bc43ada4b1aa48e77789c8e04b2 [id=fad8a846289946d696cd2467b360eb77]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:05.346477 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 90b8468df4a449d088f47b3b150ce54a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90b8468df4a449d088f47b3b150ce54a already in progress: creating tablet
W20260619 19:54:05.364948 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1b18a61d955e4929998b90c6c8fa844e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b18a61d955e4929998b90c6c8fa844e already in progress: creating tablet
I20260619 19:54:05.364583 891 tablet_service.cc:1511] Processing CreateTablet for tablet f7696e1f927f4877b720964c7b8af02c (DEFAULT_TABLE table=default.Table_4ff5cbcad6d34fa7a697088b1b61ffda [id=2737b15c643e492f9e29cc1e7173583f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.365547 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7696e1f927f4877b720964c7b8af02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.366464 884 tablet_service.cc:1511] Processing CreateTablet for tablet c3c0937d5fea430da4dbdf9381157268 (DEFAULT_TABLE table=default.Table_c0d72f12910c4e988c146acf69ec7224 [id=9ae31428fe5d4fcd9ff29dfda58cc4ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.366901 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c0937d5fea430da4dbdf9381157268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.368613 761 tablet_service.cc:1511] Processing CreateTablet for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba (DEFAULT_TABLE table=default.Table_c74d4bc43ada4b1aa48e77789c8e04b2 [id=fad8a846289946d696cd2467b360eb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.369585 749 tablet_service.cc:1511] Processing CreateTablet for tablet c3c0937d5fea430da4dbdf9381157268 (DEFAULT_TABLE table=default.Table_c0d72f12910c4e988c146acf69ec7224 [id=9ae31428fe5d4fcd9ff29dfda58cc4ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.370352 747 tablet_service.cc:1511] Processing CreateTablet for tablet f7696e1f927f4877b720964c7b8af02c (DEFAULT_TABLE table=default.Table_4ff5cbcad6d34fa7a697088b1b61ffda [id=2737b15c643e492f9e29cc1e7173583f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:05.370939 858 leader_election.cc:343] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:54:05.371420 746 tablet_service.cc:1511] Processing CreateTablet for tablet ac80d8fb9d874148bc8b0c508448804c (DEFAULT_TABLE table=default.Table_1755ba072da64e428c5dece315b1543b [id=7370eb5e3dbe439aa632b217ba8b0ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.371454 892 tablet_service.cc:1511] Processing CreateTablet for tablet ac80d8fb9d874148bc8b0c508448804c (DEFAULT_TABLE table=default.Table_1755ba072da64e428c5dece315b1543b [id=7370eb5e3dbe439aa632b217ba8b0ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.371789 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac80d8fb9d874148bc8b0c508448804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.332654 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b8468df4a449d088f47b3b150ce54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.372146 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c3c0937d5fea430da4dbdf9381157268 (DEFAULT_TABLE table=default.Table_c0d72f12910c4e988c146acf69ec7224 [id=9ae31428fe5d4fcd9ff29dfda58cc4ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.372578 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c0937d5fea430da4dbdf9381157268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.375689 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f7696e1f927f4877b720964c7b8af02c (DEFAULT_TABLE table=default.Table_4ff5cbcad6d34fa7a697088b1b61ffda [id=2737b15c643e492f9e29cc1e7173583f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.376116 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7696e1f927f4877b720964c7b8af02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.379254 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.379716 1973 tablet_replica.cc:333] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:05.379931 1973 raft_consensus.cc:2243] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.380102 1973 raft_consensus.cc:2272] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.380637 1973 ts_tablet_manager.cc:1916] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.381055 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba (DEFAULT_TABLE table=default.Table_c74d4bc43ada4b1aa48e77789c8e04b2 [id=fad8a846289946d696cd2467b360eb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.381511 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.384310 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7696e1f927f4877b720964c7b8af02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.384871 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac80d8fb9d874148bc8b0c508448804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.385298 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.385713 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c0937d5fea430da4dbdf9381157268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.391498 2272 leader_election.cc:290] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.391980 760 tablet_service.cc:1511] Processing CreateTablet for tablet bdaa6ef43cab4cb384b92bd43c472901 (DEFAULT_TABLE table=default.Table_d84c42e7f7da440696e7684e3dd52ec2 [id=e3ef68b633dd478da71a802305824355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.392225 2272 raft_consensus.cc:493] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.392403 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdaa6ef43cab4cb384b92bd43c472901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.392371 2272 raft_consensus.cc:515] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.393052 2272 leader_election.cc:290] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.393785 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b55debc1b064192a56d2453364ba260" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:05.394302 858 leader_election.cc:343] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.395713 886 tablet_service.cc:1511] Processing CreateTablet for tablet bdaa6ef43cab4cb384b92bd43c472901 (DEFAULT_TABLE table=default.Table_d84c42e7f7da440696e7684e3dd52ec2 [id=e3ef68b633dd478da71a802305824355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.396246 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdaa6ef43cab4cb384b92bd43c472901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.397764 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b18a61d955e4929998b90c6c8fa844e with delete_type TABLET_DATA_DELETED (replaced by tablet ca02c454eec840eb9289950b6da7b131) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.399722 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ac80d8fb9d874148bc8b0c508448804c (DEFAULT_TABLE table=default.Table_1755ba072da64e428c5dece315b1543b [id=7370eb5e3dbe439aa632b217ba8b0ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.400223 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac80d8fb9d874148bc8b0c508448804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.401121 900 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 248) took 1888 ms. Trace:
I20260619 19:54:05.401204 900 rpcz_store.cc:276] 0619 19:54:03.513095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.882679 (+369584us) service_pool.cc:224] Handling call
0619 19:54:03.886495 (+ 3816us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:03.886518 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:05.322227 (+1435709us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.400949 (+ 78722us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:05.401098 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:05.404641 1201 tablet_bootstrap.cc:654] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.405314 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b55debc1b064192a56d2453364ba260" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.405975 1056 raft_consensus.cc:2468] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:05.408937 2368 raft_consensus.cc:493] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.409117 2368 raft_consensus.cc:515] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:05.406785 859 leader_election.cc:343] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:54:05.409551 859 leader_election.cc:304] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.409945 2368 leader_election.cc:290] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.410115 2368 raft_consensus.cc:493] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.410228 2368 raft_consensus.cc:515] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.410362 2272 raft_consensus.cc:2749] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.410851 2368 leader_election.cc:290] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.411319 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997cd0b5a8d24b56a2d5b95ab877d95f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:05.411801 996 leader_election.cc:343] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.415105 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:05.415550 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:05.415968 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]). Expected version 2 got 0
I20260619 19:54:05.418462 524 catalog_manager.cc:5696] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:05.419482 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]). Expected version 2 got 0
I20260619 19:54:05.420872 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_a3f0b91866884789b9a1ddc76a59ca8f [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 2 got 0
I20260619 19:54:05.421504 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:05.422104 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:05.422524 524 catalog_manager.cc:5696] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:05.423120 859 leader_election.cc:304] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.423661 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 59123a56731645e1bbfcc94b2a46b1d6 (table default.Table_028e9140ed9c4ee1b7074363c4764cd9 [id=8eedaa1e27904cadb0b52ab19f4c43ff]). Expected version 2 got 0
I20260619 19:54:05.423591 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.424206 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:05.424773 2272 raft_consensus.cc:2804] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260619 19:54:05.424773 996 leader_election.cc:343] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.424897 2272 raft_consensus.cc:493] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:05.426962 2273 raft_consensus.cc:493] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:05.431854 2272 raft_consensus.cc:3060] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.427205 2273 raft_consensus.cc:515] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.434536 2273 leader_election.cc:290] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.434703 2272 raft_consensus.cc:515] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.435981 2272 leader_election.cc:290] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.437237 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b55debc1b064192a56d2453364ba260" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:05.437656 858 leader_election.cc:343] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
W20260619 19:54:05.438004 858 leader_election.cc:343] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.439054 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b55debc1b064192a56d2453364ba260" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:05.439321 1055 raft_consensus.cc:3060] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.441498 2324 consensus_queue.cc:1048] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:05.442741 1055 raft_consensus.cc:2468] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:05.445186 2337 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:54:05.456866 2453 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260619 19:54:05.460511 859 leader_election.cc:343] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:54:05.460920 859 leader_election.cc:304] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.465611 2273 raft_consensus.cc:2749] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.466209 859 leader_election.cc:304] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.467192 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.467478 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997cd0b5a8d24b56a2d5b95ab877d95f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.473767 2273 raft_consensus.cc:2804] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:05.474220 2273 raft_consensus.cc:697] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:05.474596 2273 consensus_queue.cc:237] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.481705 2343 consensus_queue.cc:1048] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:05.486994 2026 ts_tablet_manager.cc:1929] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260619 19:54:05.488178 996 leader_election.cc:343] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.488355 996 leader_election.cc:304] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.488843 2114 raft_consensus.cc:2749] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:05.493680 719 consensus_peers.cc:597] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:05.497359 1208 tablet_bootstrap.cc:492] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:05.497512 1208 ts_tablet_manager.cc:1403] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.404s user 0.019s sys 0.132s
I20260619 19:54:05.497846 2328 raft_consensus.cc:493] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.497983 2328 raft_consensus.cc:515] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.498292 1208 raft_consensus.cc:359] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.498451 1208 raft_consensus.cc:385] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.498503 1208 raft_consensus.cc:740] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.498544 2328 leader_election.cc:290] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.498739 1208 consensus_queue.cc:260] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.499053 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.499266 1208 ts_tablet_manager.cc:1434] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260619 19:54:05.499579 996 leader_election.cc:343] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.499683 996 leader_election.cc:304] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.500093 2114 raft_consensus.cc:2749] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.500885 524 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:05.429323 526 master_service.cc:960] ReplaceTablet: received request to replace tablet a54231986cca44258942dbc3373870b2 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:05.430330 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_bf2b7abe28794d908335b963f81ec478"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:05.502450 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf2b7abe28794d908335b963f81ec478 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.448572 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 774938222588473e90c513232c82aece
I20260619 19:54:05.507406 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 774938222588473e90c513232c82aece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.508812 2314 raft_consensus.cc:493] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.508973 2314 raft_consensus.cc:515] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.509974 2314 leader_election.cc:290] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.510407 1208 tablet_bootstrap.cc:492] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:05.512034 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:05.512661 720 leader_election.cc:343] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.513113 2314 raft_consensus.cc:493] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.513236 2314 raft_consensus.cc:515] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.513608 1208 tablet_bootstrap.cc:654] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.514004 2314 leader_election.cc:290] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.514264 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.514475 1061 raft_consensus.cc:2468] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:05.514957 720 leader_election.cc:304] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:05.515249 2328 raft_consensus.cc:493] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.515367 2328 raft_consensus.cc:515] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.516307 2328 leader_election.cc:290] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.515367 2314 raft_consensus.cc:2804] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:05.517303 2314 raft_consensus.cc:493] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:05.517401 2314 raft_consensus.cc:3060] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.522014 2314 raft_consensus.cc:515] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.529831 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dcf2293e2d461ca1be171069867d1f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.526532 1973 ts_tablet_manager.cc:1929] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:05.527980 2328 raft_consensus.cc:493] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:05.530815 720 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.532462 2328 raft_consensus.cc:515] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.532894 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:05.533118 1056 raft_consensus.cc:3060] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.533047 1973 log.cc:1199] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/33cfbae501de432cbcb34d2a6365f806
I20260619 19:54:05.534528 1973 ts_tablet_manager.cc:1950] T 33cfbae501de432cbcb34d2a6365f806 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:05.534626 2328 leader_election.cc:290] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:05.535411 720 leader_election.cc:343] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 550297c4d14f4d679d11fded97b671ae
I20260619 19:54:05.535580 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 110) took 5171 ms. Trace:
I20260619 19:54:05.535787 1973 rpcz_store.cc:276] 0619 19:54:00.364636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:00.364814 (+ 178us) service_pool.cc:224] Handling call
0619 19:54:05.333934 (+4969120us) ts_tablet_manager.cc:1151] Deleting tablet 33cfbae501de432cbcb34d2a6365f806
0619 19:54:05.379642 (+ 45708us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.479714 (+100072us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.526376 (+ 46662us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.535565 (+ 9189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4959522}
I20260619 19:54:05.536427 1973 tablet_replica.cc:333] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:05.536769 1973 raft_consensus.cc:2243] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.537098 1973 raft_consensus.cc:2272] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.538203 1973 ts_tablet_manager.cc:1916] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.539414 2314 leader_election.cc:290] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.540678 2114 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.540853 2114 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.541582 2114 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:05.541899 1056 raft_consensus.cc:2468] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:05.542366 720 leader_election.cc:304] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:05.542672 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.542857 779 raft_consensus.cc:2468] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:05.543320 996 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:05.543478 2314 raft_consensus.cc:2804] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:05.543567 2114 raft_consensus.cc:2804] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:05.543609 2314 raft_consensus.cc:697] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:05.543637 2114 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:05.543697 2114 raft_consensus.cc:3060] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.545367 2314 consensus_queue.cc:237] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.546478 2114 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.547716 2114 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:05.548259 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:05.548444 779 raft_consensus.cc:3060] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.551951 1200 tablet_bootstrap.cc:492] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:05.553371 779 raft_consensus.cc:2468] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:05.553880 996 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:05.553491 1200 ts_tablet_manager.cc:1403] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.309s user 0.033s sys 0.071s
I20260619 19:54:05.554296 2114 raft_consensus.cc:2804] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:05.554442 2114 raft_consensus.cc:697] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:05.554703 2114 consensus_queue.cc:237] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.559163 2328 raft_consensus.cc:493] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.559361 2328 raft_consensus.cc:515] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.561214 2328 leader_election.cc:290] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.562453 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e73d38af8241b29b8d47a5f9db1834" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:05.563275 720 leader_election.cc:343] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:05.575011 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 6f2a8462edb54df2aa0343ecea6dd761 (table default.Table_e308f230944e4e96a5ec1a35eb5b21aa [id=1c8c18675ec84713a63c669793132a19], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6f2a8462edb54df2aa0343ecea6dd761 consensus state has no leader
I20260619 19:54:05.582751 1200 raft_consensus.cc:359] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.583247 1200 raft_consensus.cc:385] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.583415 1200 raft_consensus.cc:740] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.583863 1200 consensus_queue.cc:260] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.584986 1200 ts_tablet_manager.cc:1434] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260619 19:54:05.585620 1200 tablet_bootstrap.cc:492] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:05.587585 1208 tablet_bootstrap.cc:492] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:05.592595 1038 tablet_service.cc:1511] Processing CreateTablet for tablet c322c38aae114a428f64a476a2ae9b5f (DEFAULT_TABLE table=default.Table_b1a301cf915e4323bf1cd7290e158617 [id=8aba6649d11f417a8bfdf95a74e12f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.593360 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c322c38aae114a428f64a476a2ae9b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.594554 2358 tablet.cc:1724] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:05.596365 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1ded605c2edc4c2fb138d07dea4a14b4 (DEFAULT_TABLE table=default.Table_76a61e7b4ba448518ff8dc334fbffdbb [id=ce62d08f8f724adca51e441d46dc5de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.597018 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ded605c2edc4c2fb138d07dea4a14b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.493201 1201 tablet_bootstrap.cc:492] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:05.599432 2026 log.cc:1199] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/2d64ccbb2f2840f4ac51cf8556da4a2c
I20260619 19:54:05.599548 1201 ts_tablet_manager.cc:1403] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.254s user 0.001s sys 0.005s
I20260619 19:54:05.599833 2026 ts_tablet_manager.cc:1950] T 2d64ccbb2f2840f4ac51cf8556da4a2c P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:05.600154 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 99) took 4485 ms. Trace:
I20260619 19:54:05.600229 2026 rpcz_store.cc:276] 0619 19:54:01.114752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.114809 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:05.309665 (+4194856us) ts_tablet_manager.cc:1151] Deleting tablet 2d64ccbb2f2840f4ac51cf8556da4a2c
0619 19:54:05.309678 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.399990 (+ 90312us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.486903 (+ 86913us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.600136 (+113233us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4158780}
I20260619 19:54:05.600699 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 2d64ccbb2f2840f4ac51cf8556da4a2c (table default.Table_e4f08490c62f47249298bc6684dd80bb [id=7018bca0519c45289b5131c3e4484774]) successfully deleted
I20260619 19:54:05.600629 1201 raft_consensus.cc:359] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.600883 1201 raft_consensus.cc:385] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.600948 1201 raft_consensus.cc:740] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.601186 1201 consensus_queue.cc:260] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.601816 1201 ts_tablet_manager.cc:1434] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:05.602114 1201 tablet_bootstrap.cc:492] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:05.536962 2272 raft_consensus.cc:493] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:05.603245 2272 raft_consensus.cc:515] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:05.604117 2272 leader_election.cc:290] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.544884 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.604506 900 tablet_service.cc:1511] Processing CreateTablet for tablet a7100b0bfa6d4e3baf4e7f90217f1fff (DEFAULT_TABLE table=default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.550791 2273 raft_consensus.cc:493] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:05.604873 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7100b0bfa6d4e3baf4e7f90217f1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.604823 2273 raft_consensus.cc:515] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:05.566279 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:05.507656 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 774938222588473e90c513232c82aece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.590875 884 tablet_service.cc:1511] Processing CreateTablet for tablet 1ded605c2edc4c2fb138d07dea4a14b4 (DEFAULT_TABLE table=default.Table_76a61e7b4ba448518ff8dc334fbffdbb [id=ce62d08f8f724adca51e441d46dc5de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.605916 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ded605c2edc4c2fb138d07dea4a14b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.608050 2358 tablet.cc:1719] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Skipping requested alter to schema version 3, tablet already version 3
I20260619 19:54:05.608228 1994 ts_tablet_manager.cc:1929] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:05.608369 1994 log.cc:1199] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fe14a1f35cf14ca480221ee412c087da
I20260619 19:54:05.608551 1208 ts_tablet_manager.cc:1403] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.000s
I20260619 19:54:05.608980 1994 ts_tablet_manager.cc:1950] T fe14a1f35cf14ca480221ee412c087da P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:05.609479 1994 tablet_replica.cc:333] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:05.609513 996 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.609694 1994 raft_consensus.cc:2243] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:05.610244 996 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.610402 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3a48eabb574be3bc6883cf555b657f (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.610806 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3a48eabb574be3bc6883cf555b657f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.610842 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3a48eabb574be3bc6883cf555b657f (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.610958 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 28a09107b11d480dba8c456fc8753ad1 (DEFAULT_TABLE table=default.Table_945d82ba234a4bb78a5202e011447107 [id=c7f3ea7cec0d46f8aa1d085f11fcf066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.611238 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3a48eabb574be3bc6883cf555b657f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.611255 1026 tablet_service.cc:1511] Processing CreateTablet for tablet a7100b0bfa6d4e3baf4e7f90217f1fff (DEFAULT_TABLE table=default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.611366 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]) successfully deleted
I20260619 19:54:05.611627 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a09107b11d480dba8c456fc8753ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.611780 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7100b0bfa6d4e3baf4e7f90217f1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.616559 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:05.617187 527 catalog_manager.cc:6784] ReplaceTablet: tablet 79f8635b919a44a8a1e5fe48420ca4b7 deleted and replaced by tablet 736aa49b4d984295a9aefb135b005e07
I20260619 19:54:05.617494 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 495bafb07abe45da9f62138453dd6636 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:05.617995 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 788550efad2f4dbc917131cff1e76f09 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:05.619472 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7ed722632f664c4f83d095f3acee831b" } new_table_name: "default.Table_2ab8893f3373415f8d95cd7478479821" modify_external_catalogs: true
I20260619 19:54:05.620301 896 tablet_service.cc:1511] Processing CreateTablet for tablet 28a09107b11d480dba8c456fc8753ad1 (DEFAULT_TABLE table=default.Table_945d82ba234a4bb78a5202e011447107 [id=c7f3ea7cec0d46f8aa1d085f11fcf066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.620424 1994 raft_consensus.cc:2272] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.620775 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fcaeebaaa93c479bafff14d312d526ec
I20260619 19:54:05.621682 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8349f974cb2246779c7c71dada5fcd52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:05.622404 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8349f974cb2246779c7c71dada5fcd52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.623823 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_20aa0629677a402ebdd6d659c87697d3" } new_table_name: "default.Table_02266d7ef8ad403885398af0c9f825a7" modify_external_catalogs: true
I20260619 19:54:05.628208 886 tablet_service.cc:1511] Processing CreateTablet for tablet c322c38aae114a428f64a476a2ae9b5f (DEFAULT_TABLE table=default.Table_b1a301cf915e4323bf1cd7290e158617 [id=8aba6649d11f417a8bfdf95a74e12f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.628702 2273 leader_election.cc:290] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.629179 1201 tablet_bootstrap.cc:654] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.629767 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f8635b919a44a8a1e5fe48420ca4b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 736aa49b4d984295a9aefb135b005e07) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.630865 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8b584703372a4447845a8fcfeabeaf0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:05.631491 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b584703372a4447845a8fcfeabeaf0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.632813 892 tablet_service.cc:1511] Processing CreateTablet for tablet e055ee491a784c58a95c7780ed1dee6c (DEFAULT_TABLE table=default.Table_2d03b1734ab843dc98881985c497b171 [id=2fc9c41f9d454e419212d58b3429139f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.633160 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e055ee491a784c58a95c7780ed1dee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.633915 889 tablet_service.cc:1511] Processing CreateTablet for tablet cad702900111463fa298c76098746bfb (DEFAULT_TABLE table=default.Table_1297e60fa2f449378cd87ab38fa206b1 [id=caf4a3406c1a4aadab2f560438721acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.634208 1973 ts_tablet_manager.cc:1929] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:05.634265 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad702900111463fa298c76098746bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.634217 901 tablet_service.cc:1511] Processing CreateTablet for tablet ef509392f1b3472db598c8b414258932 (DEFAULT_TABLE table=default.Table_97b6432d47dd4450a21a82a3e15390ad [id=ba3dae6ed3424cbe9331e376a3760812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.634308 1973 log.cc:1199] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:05.634513 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef509392f1b3472db598c8b414258932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.634634 1973 ts_tablet_manager.cc:1950] T 56ba47943b9d4123985ea6ca1478cd93 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:05.634976 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 114) took 4616 ms. Trace:
I20260619 19:54:05.635046 1973 rpcz_store.cc:276] 0619 19:54:01.018025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.018210 (+ 185us) service_pool.cc:224] Handling call
0619 19:54:05.536348 (+4518138us) ts_tablet_manager.cc:1151] Deleting tablet 56ba47943b9d4123985ea6ca1478cd93
0619 19:54:05.536357 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.565725 (+ 29368us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.627973 (+ 62248us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.634959 (+ 6986us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4517828}
I20260619 19:54:05.635600 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 115) took 4617 ms. Trace:
I20260619 19:54:05.635705 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a09107b11d480dba8c456fc8753ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.635670 1973 rpcz_store.cc:276] 0619 19:54:01.018163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.025105 (+ 6942us) service_pool.cc:224] Handling call
0619 19:54:05.635488 (+4610383us) ts_tablet_manager.cc:1151] Deleting tablet 05c9a91f95bb4bcdafe493bab8c393b4
0619 19:54:05.635496 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.635586 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4610155}
I20260619 19:54:05.635979 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 119) took 4605 ms. Trace:
I20260619 19:54:05.636044 1973 rpcz_store.cc:276] 0619 19:54:01.030873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.031195 (+ 322us) service_pool.cc:224] Handling call
0619 19:54:05.635885 (+4604690us) ts_tablet_manager.cc:1151] Deleting tablet b2902c7f67a1402987315ee426ddf1d2
0619 19:54:05.635893 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.635962 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4601380}
I20260619 19:54:05.636274 1973 tablet_replica.cc:333] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:05.636356 897 tablet_service.cc:1558] Processing DeleteTablet for tablet fcaeebaaa93c479bafff14d312d526ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.636451 1973 raft_consensus.cc:2243] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:05.637789 899 tablet_service.cc:1511] Processing CreateTablet for tablet bb514fda80e64ac9abc147d9a6adce76 (DEFAULT_TABLE table=default.Table_13defec349014a83b249f7db46924c0e [id=4a0bee70b1e843b086d0ccc5b4cf13ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.638108 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb514fda80e64ac9abc147d9a6adce76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.640118 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f8635b919a44a8a1e5fe48420ca4b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 736aa49b4d984295a9aefb135b005e07) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.640296 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet fcaeebaaa93c479bafff14d312d526ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.640615 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d84c4053cd194a27b86d9a924137dc15 (DEFAULT_TABLE table=default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.640959 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84c4053cd194a27b86d9a924137dc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.640966 893 tablet_service.cc:1511] Processing CreateTablet for tablet d84c4053cd194a27b86d9a924137dc15 (DEFAULT_TABLE table=default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.641288 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84c4053cd194a27b86d9a924137dc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.600785 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 100) took 4482 ms. Trace:
I20260619 19:54:05.641814 2026 rpcz_store.cc:276] 0619 19:54:01.118062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.118119 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:05.600661 (+4482542us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:54:05.600672 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.600771 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4449739}
I20260619 19:54:05.642336 1023 tablet_service.cc:1511] Processing CreateTablet for tablet ef509392f1b3472db598c8b414258932 (DEFAULT_TABLE table=default.Table_97b6432d47dd4450a21a82a3e15390ad [id=ba3dae6ed3424cbe9331e376a3760812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.642335 1035 tablet_service.cc:1511] Processing CreateTablet for tablet e055ee491a784c58a95c7780ed1dee6c (DEFAULT_TABLE table=default.Table_2d03b1734ab843dc98881985c497b171 [id=2fc9c41f9d454e419212d58b3429139f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.642683 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef509392f1b3472db598c8b414258932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.642874 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e055ee491a784c58a95c7780ed1dee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.643124 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2e40a7328d42dd864703db24c1fa3c (DEFAULT_TABLE table=default.Table_7bf9ce3ed31647a9a20aaf013540e19f [id=36a8aa6b8312462fb8af9c3168de7db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.643306 2026 tablet_replica.cc:333] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:05.643460 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2e40a7328d42dd864703db24c1fa3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.643502 2026 raft_consensus.cc:2243] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.643652 2026 raft_consensus.cc:2272] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:05.644011 859 leader_election.cc:343] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:54:05.644032 1029 tablet_service.cc:1511] Processing CreateTablet for tablet bb514fda80e64ac9abc147d9a6adce76 (DEFAULT_TABLE table=default.Table_13defec349014a83b249f7db46924c0e [id=4a0bee70b1e843b086d0ccc5b4cf13ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.644199 2026 ts_tablet_manager.cc:1916] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.644304 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb514fda80e64ac9abc147d9a6adce76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.644716 2358 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260619 19:54:05.645062 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d651c8fb8ff244a5a09dd9ea593ecb14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d651c8fb8ff244a5a09dd9ea593ecb14 already in progress: creating tablet
I20260619 19:54:05.646701 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2e40a7328d42dd864703db24c1fa3c (DEFAULT_TABLE table=default.Table_7bf9ce3ed31647a9a20aaf013540e19f [id=36a8aa6b8312462fb8af9c3168de7db7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:05.646926 859 leader_election.cc:343] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 5bae5be1340f4158a0b243415e232ae5
I20260619 19:54:05.647042 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2e40a7328d42dd864703db24c1fa3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.648133 887 tablet_service.cc:1511] Processing CreateTablet for tablet f39a95a0ac714de388ed04a8a14e4f6d (DEFAULT_TABLE table=default.Table_8e9360a87f5a4f8b990df38ad739a3c5 [id=050ce6b1eee349318da902df45aa205e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.648423 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39a95a0ac714de388ed04a8a14e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.649257 1022 tablet_service.cc:1511] Processing CreateTablet for tablet cad702900111463fa298c76098746bfb (DEFAULT_TABLE table=default.Table_1297e60fa2f449378cd87ab38fa206b1 [id=caf4a3406c1a4aadab2f560438721acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.649976 2273 raft_consensus.cc:493] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:05.650117 2273 raft_consensus.cc:515] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:05.651180 2273 leader_election.cc:290] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.654886 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d1d23b9d751c48ad858a35771b0ded61 (DEFAULT_TABLE table=default.Table_7c2adacdb99143a0a08280f26b2502ec [id=46cd2d6b7e0941618273a466d5387411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.655296 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d23b9d751c48ad858a35771b0ded61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.656158 902 tablet_service.cc:1511] Processing CreateTablet for tablet 7e90afc275a147c99616529dccc866cd (DEFAULT_TABLE table=default.Table_1d03edf897d2401c8e37c1351616b21c [id=9ed21405f8364c3ca3edc992fa68d588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.656494 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90afc275a147c99616529dccc866cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.657603 2434 log.cc:826] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Log is configured to *not* fsync() on all Append() calls
I20260619 19:54:05.659912 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0e601c022049fcb050f7b90b9f3a98 (DEFAULT_TABLE table=default.Table_5e763c81e6e04a5c84aa92c7ad787054 [id=260a1589b47541418e8d23219ff3c400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.660277 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0e601c022049fcb050f7b90b9f3a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.662523 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0e601c022049fcb050f7b90b9f3a98 (DEFAULT_TABLE table=default.Table_5e763c81e6e04a5c84aa92c7ad787054 [id=260a1589b47541418e8d23219ff3c400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.663410 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0e601c022049fcb050f7b90b9f3a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.634101 779 raft_consensus.cc:3060] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.671531 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad702900111463fa298c76098746bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.672145 781 raft_consensus.cc:3060] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:05.674381 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7e90afc275a147c99616529dccc866cd (DEFAULT_TABLE table=default.Table_1d03edf897d2401c8e37c1351616b21c [id=9ed21405f8364c3ca3edc992fa68d588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.674866 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f39a95a0ac714de388ed04a8a14e4f6d (DEFAULT_TABLE table=default.Table_8e9360a87f5a4f8b990df38ad739a3c5 [id=050ce6b1eee349318da902df45aa205e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.680075 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39a95a0ac714de388ed04a8a14e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.680312 1208 raft_consensus.cc:359] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.680568 1208 raft_consensus.cc:385] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.680636 1208 raft_consensus.cc:740] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.680837 1208 consensus_queue.cc:260] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.683481 1973 raft_consensus.cc:2272] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.684108 1973 ts_tablet_manager.cc:1916] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:05.688884 859 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:54:05.690961 1208 ts_tablet_manager.cc:1434] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.082s user 0.002s sys 0.000s
I20260619 19:54:05.692165 1208 tablet_bootstrap.cc:492] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:05.694046 1208 tablet_bootstrap.cc:654] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.696435 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c322c38aae114a428f64a476a2ae9b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.699954 1973 ts_tablet_manager.cc:1929] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:05.700672 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90afc275a147c99616529dccc866cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.701643 1973 log.cc:1199] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/0dd210e843db4f58a976af5c28dabc9c
I20260619 19:54:05.702528 896 tablet_service.cc:1511] Processing CreateTablet for tablet d1d23b9d751c48ad858a35771b0ded61 (DEFAULT_TABLE table=default.Table_7c2adacdb99143a0a08280f26b2502ec [id=46cd2d6b7e0941618273a466d5387411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.704205 1200 tablet_bootstrap.cc:654] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.703423 1973 ts_tablet_manager.cc:1950] T 0dd210e843db4f58a976af5c28dabc9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:05.705662 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 126) took 4653 ms. Trace:
I20260619 19:54:05.705745 1973 rpcz_store.cc:276] 0619 19:54:01.052276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.052337 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:05.636234 (+4583897us) ts_tablet_manager.cc:1151] Deleting tablet 0dd210e843db4f58a976af5c28dabc9c
0619 19:54:05.636244 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.687407 (+ 51163us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.699882 (+ 12475us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.705645 (+ 5763us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4583642}
I20260619 19:54:05.706178 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 127) took 4653 ms. Trace:
I20260619 19:54:05.706246 1973 rpcz_store.cc:276] 0619 19:54:01.052923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.052978 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:05.706057 (+4653079us) ts_tablet_manager.cc:1151] Deleting tablet 0b55debc1b064192a56d2453364ba260
0619 19:54:05.706065 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.706161 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4652849}
W20260619 19:54:05.706380 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 212726us
I20260619 19:54:05.706525 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 129) took 4652 ms. Trace:
I20260619 19:54:05.706583 1973 rpcz_store.cc:276] 0619 19:54:01.067080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.067163 (+ 83us) service_pool.cc:224] Handling call
0619 19:54:05.706440 (+4639277us) ts_tablet_manager.cc:1151] Deleting tablet 10f6e202e8fd4a7292774d5eb4c7266b
0619 19:54:05.706447 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.706513 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4639000}
I20260619 19:54:05.706770 1973 tablet_replica.cc:333] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:05.706940 1973 raft_consensus.cc:2243] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:05.709012 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:05.709282 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:05.709522 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:05.709985 531 catalog_manager.cc:5696] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:05.710657 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]). Expected version 2 got 0
I20260619 19:54:05.711299 531 catalog_manager.cc:5696] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:05.711871 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:05.712831 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_028e9140ed9c4ee1b7074363c4764cd9 [id=8eedaa1e27904cadb0b52ab19f4c43ff] alter complete (version 2)
I20260619 19:54:05.716868 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d23b9d751c48ad858a35771b0ded61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.723291 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.727394 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.728394 1994 ts_tablet_manager.cc:1916] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.732215 1208 tablet_bootstrap.cc:492] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:05.732685 1208 ts_tablet_manager.cc:1403] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260619 19:54:05.734153 1208 raft_consensus.cc:359] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.734319 1208 raft_consensus.cc:385] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.734366 1208 raft_consensus.cc:740] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.734560 1208 consensus_queue.cc:260] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.735318 1208 ts_tablet_manager.cc:1434] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:05.735620 1208 tablet_bootstrap.cc:492] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:05.737818 1208 tablet_bootstrap.cc:654] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.742954 2453 tablet.cc:1724] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:05.747990 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 33cfbae501de432cbcb34d2a6365f806 (table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]) successfully deleted
I20260619 19:54:05.748931 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59123a56731645e1bbfcc94b2a46b1d6" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.750072 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]) successfully deleted
W20260619 19:54:05.750697 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 05c9a91f95bb4bcdafe493bab8c393b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05c9a91f95bb4bcdafe493bab8c393b4 already in progress: creating tablet
W20260619 19:54:05.751454 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b2902c7f67a1402987315ee426ddf1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2902c7f67a1402987315ee426ddf1d2 already in progress: creating tablet
I20260619 19:54:05.751890 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 0dd210e843db4f58a976af5c28dabc9c (table default.Table_4957c483382c45d7a305c7b4fd2ea6c8 [id=2daa177012434787b804b7721c3f91d2]) successfully deleted
W20260619 19:54:05.752259 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0b55debc1b064192a56d2453364ba260 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b55debc1b064192a56d2453364ba260 already in progress: creating tablet
I20260619 19:54:05.753834 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 774938222588473e90c513232c82aece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.754372 760 tablet_service.cc:1511] Processing CreateTablet for tablet 28a09107b11d480dba8c456fc8753ad1 (DEFAULT_TABLE table=default.Table_945d82ba234a4bb78a5202e011447107 [id=c7f3ea7cec0d46f8aa1d085f11fcf066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.754891 1973 raft_consensus.cc:2272] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.755090 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a09107b11d480dba8c456fc8753ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.755616 1973 ts_tablet_manager.cc:1916] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.756003 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1ded605c2edc4c2fb138d07dea4a14b4 (DEFAULT_TABLE table=default.Table_76a61e7b4ba448518ff8dc334fbffdbb [id=ce62d08f8f724adca51e441d46dc5de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.756287 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ded605c2edc4c2fb138d07dea4a14b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.757552 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f45ecb22649c41cf875aa7f1b1e017b0" } modify_external_catalogs: true
I20260619 19:54:05.757725 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f45ecb22649c41cf875aa7f1b1e017b0" } modify_external_catalogs: true
I20260619 19:54:05.759408 746 tablet_service.cc:1511] Processing CreateTablet for tablet c322c38aae114a428f64a476a2ae9b5f (DEFAULT_TABLE table=default.Table_b1a301cf915e4323bf1cd7290e158617 [id=8aba6649d11f417a8bfdf95a74e12f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.759718 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c322c38aae114a428f64a476a2ae9b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.762133 751 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3a48eabb574be3bc6883cf555b657f (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.762463 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3a48eabb574be3bc6883cf555b657f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.762642 1973 ts_tablet_manager.cc:1929] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:05.762723 1973 log.cc:1199] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/2448429656934063887b63d9a6e79894
I20260619 19:54:05.763238 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f8635b919a44a8a1e5fe48420ca4b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 736aa49b4d984295a9aefb135b005e07) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.763811 747 tablet_service.cc:1511] Processing CreateTablet for tablet a7100b0bfa6d4e3baf4e7f90217f1fff (DEFAULT_TABLE table=default.Table_cce54de4f5f84cd982118d476870dea9 [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.764111 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7100b0bfa6d4e3baf4e7f90217f1fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.765287 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.770694 1973 ts_tablet_manager.cc:1950] T 2448429656934063887b63d9a6e79894 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:05.771261 2453 tablet.cc:1719] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89: Skipping requested alter to schema version 2, tablet already version 2
I20260619 19:54:05.771731 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 130) took 4704 ms. Trace:
I20260619 19:54:05.771864 1973 rpcz_store.cc:276] 0619 19:54:01.067661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.067710 (+ 49us) service_pool.cc:224] Handling call
0619 19:54:05.706735 (+4639025us) ts_tablet_manager.cc:1151] Deleting tablet 2448429656934063887b63d9a6e79894
0619 19:54:05.706741 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.760151 (+ 53410us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.762603 (+ 2452us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.771715 (+ 9112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4638796}
I20260619 19:54:05.772241 1973 tablet_replica.cc:333] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:05.772931 1973 raft_consensus.cc:2243] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.773136 1973 raft_consensus.cc:2272] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.773778 1973 ts_tablet_manager.cc:1916] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.773795 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet cbec819571854db8a46daae15b9127bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.751336 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.749411 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.776656 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:05.778558 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550297c4d14f4d679d11fded97b671ae" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.778735 918 raft_consensus.cc:2468] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:05.782502 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dcf2293e2d461ca1be171069867d1f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.787328 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0bbd4672f505430eaf0de7479560b0ee" } modify_external_catalogs: true
I20260619 19:54:05.787563 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0bbd4672f505430eaf0de7479560b0ee" } modify_external_catalogs: true
I20260619 19:54:05.791241 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e73d38af8241b29b8d47a5f9db1834" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.798748 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 788550efad2f4dbc917131cff1e76f09
I20260619 19:54:05.799441 527 catalog_manager.cc:6784] ReplaceTablet: tablet 788550efad2f4dbc917131cff1e76f09 deleted and replaced by tablet 5e5c1ffd83c944ada87d59439b6a9cb3
I20260619 19:54:05.799955 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_94d5b0a1504044b7a1934b5c726b29d4" } modify_external_catalogs: true
I20260619 19:54:05.800194 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_94d5b0a1504044b7a1934b5c726b29d4" } modify_external_catalogs: true
I20260619 19:54:05.804188 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a54231986cca44258942dbc3373870b2
I20260619 19:54:05.804723 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 788550efad2f4dbc917131cff1e76f09 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e5c1ffd83c944ada87d59439b6a9cb3) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.804802 526 catalog_manager.cc:6784] ReplaceTablet: tablet a54231986cca44258942dbc3373870b2 deleted and replaced by tablet d6bc861cb7d941f380671105fd338538
I20260619 19:54:05.805335 2273 raft_consensus.cc:493] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:05.805470 2273 raft_consensus.cc:515] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.806249 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cdaa064b7d3c46a9842fd5a4ac38f619" } new_table_name: "default.Table_9fa831d3fbc74033a57818cdf0c65c72" modify_external_catalogs: true
I20260619 19:54:05.809322 751 tablet_service.cc:1511] Processing CreateTablet for tablet ef509392f1b3472db598c8b414258932 (DEFAULT_TABLE table=default.Table_97b6432d47dd4450a21a82a3e15390ad [id=ba3dae6ed3424cbe9331e376a3760812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.809715 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef509392f1b3472db598c8b414258932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.810086 758 tablet_service.cc:1511] Processing CreateTablet for tablet e055ee491a784c58a95c7780ed1dee6c (DEFAULT_TABLE table=default.Table_2d03b1734ab843dc98881985c497b171 [id=2fc9c41f9d454e419212d58b3429139f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.810364 747 tablet_service.cc:1558] Processing DeleteTablet for tablet fcaeebaaa93c479bafff14d312d526ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.810993 749 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2e40a7328d42dd864703db24c1fa3c (DEFAULT_TABLE table=default.Table_7bf9ce3ed31647a9a20aaf013540e19f [id=36a8aa6b8312462fb8af9c3168de7db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.811303 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2e40a7328d42dd864703db24c1fa3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.812332 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e055ee491a784c58a95c7780ed1dee6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.814002 1994 ts_tablet_manager.cc:1929] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:05.814193 1994 log.cc:1199] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:05.815496 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 788550efad2f4dbc917131cff1e76f09 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e5c1ffd83c944ada87d59439b6a9cb3) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.815693 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet a54231986cca44258942dbc3373870b2 with delete_type TABLET_DATA_DELETED (replaced by tablet d6bc861cb7d941f380671105fd338538) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.818107 2026 ts_tablet_manager.cc:1929] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:05.818224 2026 log.cc:1199] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/12258d3bcc714f34857d7362c49ee787
I20260619 19:54:05.818553 2026 ts_tablet_manager.cc:1950] T 12258d3bcc714f34857d7362c49ee787 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:05.820940 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2f9e5a4dedd4c81901cb99fecff0919 consensus state has no leader
I20260619 19:54:05.821787 2273 leader_election.cc:290] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.823766 2367 raft_consensus.cc:493] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.823906 2367 raft_consensus.cc:515] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.825131 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7bf9ce3ed31647a9a20aaf013540e19f" } new_table_name: "default.Table_919c11e15e44489aa549a3f8f596b11a" modify_external_catalogs: true
I20260619 19:54:05.826428 1994 ts_tablet_manager.cc:1950] T 365c0bb1e9ac480e96e7f4d604048663 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:05.828383 746 tablet_service.cc:1511] Processing CreateTablet for tablet cad702900111463fa298c76098746bfb (DEFAULT_TABLE table=default.Table_1297e60fa2f449378cd87ab38fa206b1 [id=caf4a3406c1a4aadab2f560438721acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.833820 2367 leader_election.cc:290] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:05.834851 859 leader_election.cc:343] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d4771739543f4b4189b7d603f76325f0
W20260619 19:54:05.835189 996 leader_election.cc:343] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: cbec819571854db8a46daae15b9127bd
I20260619 19:54:05.835556 1994 tablet_replica.cc:333] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:05.835804 1994 raft_consensus.cc:2243] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.835886 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]) successfully deleted
I20260619 19:54:05.836045 1994 raft_consensus.cc:2272] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.836711 1994 ts_tablet_manager.cc:1916] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.837268 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 101) took 4718 ms. Trace:
I20260619 19:54:05.837397 2026 rpcz_store.cc:276] 0619 19:54:01.118935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.118990 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:05.643263 (+4524273us) ts_tablet_manager.cc:1151] Deleting tablet 12258d3bcc714f34857d7362c49ee787
0619 19:54:05.643272 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.782626 (+139354us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.818050 (+ 35424us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.837246 (+ 19196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4492297}
I20260619 19:54:05.838596 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 12258d3bcc714f34857d7362c49ee787 (table default.Table_9a70fe99a1294387a1ac81cbd29c2647 [id=1bb7a7cd9bca4a98b3138955924f8eac]) successfully deleted
I20260619 19:54:05.838717 2026 tablet_replica.cc:333] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:05.839455 2026 raft_consensus.cc:2243] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:05.840473 890 tablet_service.cc:1558] Processing DeleteTablet for tablet a54231986cca44258942dbc3373870b2 with delete_type TABLET_DATA_DELETED (replaced by tablet d6bc861cb7d941f380671105fd338538) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.840695 2026 raft_consensus.cc:2272] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:05.842010 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aab35d0e315149c5a496fe41a7e68072 has no consensus state
I20260619 19:54:05.843060 2026 ts_tablet_manager.cc:1916] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.843848 2328 consensus_queue.cc:1048] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:05.855439 1994 ts_tablet_manager.cc:1929] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:05.856083 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_33b700c4c2304a889cab79d44fa29192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:05.856585 1994 log.cc:1199] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/997cd0b5a8d24b56a2d5b95ab877d95f
W20260619 19:54:05.856789 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33b700c4c2304a889cab79d44fa29192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.856913 1994 ts_tablet_manager.cc:1950] T 997cd0b5a8d24b56a2d5b95ab877d95f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:05.856487 1200 tablet_bootstrap.cc:492] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:05.857813 1200 ts_tablet_manager.cc:1403] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.272s user 0.007s sys 0.011s
I20260619 19:54:05.858566 1200 raft_consensus.cc:359] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.858700 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 997cd0b5a8d24b56a2d5b95ab877d95f (table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]) successfully deleted
I20260619 19:54:05.858820 1200 raft_consensus.cc:385] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.858875 1200 raft_consensus.cc:740] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:05.858924 996 leader_election.cc:343] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: cbec819571854db8a46daae15b9127bd
I20260619 19:54:05.859040 996 leader_election.cc:304] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.859078 1200 consensus_queue.cc:260] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.859452 2367 raft_consensus.cc:2749] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.859998 1200 ts_tablet_manager.cc:1434] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:05.860623 1200 tablet_bootstrap.cc:492] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:05.862898 2114 raft_consensus.cc:493] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.863190 2114 raft_consensus.cc:515] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.864563 2114 leader_election.cc:290] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.865046 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54b2e4f657245c2aa23d138968b3b0d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:05.865815 996 leader_election.cc:343] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.866055 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad702900111463fa298c76098746bfb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:05.872548 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 774938222588473e90c513232c82aece because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774938222588473e90c513232c82aece already in progress: creating tablet
I20260619 19:54:05.873353 1994 tablet_replica.cc:333] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:05.873683 1994 raft_consensus.cc:2243] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:05.873931 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_41a860a9f0aa442fa44bb1a677587282"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:05.874010 1200 tablet_bootstrap.cc:654] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:05.874799 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41a860a9f0aa442fa44bb1a677587282 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:05.875525 1994 raft_consensus.cc:2272] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.875939 1201 tablet_bootstrap.cc:492] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:05.876163 1994 ts_tablet_manager.cc:1916] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.876197 1201 ts_tablet_manager.cc:1403] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.274s user 0.010s sys 0.020s
I20260619 19:54:05.877854 1201 raft_consensus.cc:359] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.878322 1201 raft_consensus.cc:385] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.878531 1201 raft_consensus.cc:740] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.888563 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54b2e4f657245c2aa23d138968b3b0d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:05.889213 996 leader_election.cc:343] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.889345 996 leader_election.cc:304] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:05.889602 2114 raft_consensus.cc:2749] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:05.897706 1973 ts_tablet_manager.cc:1929] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:05.897933 1973 log.cc:1199] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:05.898290 1973 ts_tablet_manager.cc:1950] T d895be304fcf445e9a4d2d8242becdd5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:05.898624 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 131) took 4830 ms. Trace:
I20260619 19:54:05.898939 1973 rpcz_store.cc:276] 0619 19:54:01.068082 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.068126 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:05.772202 (+4704076us) ts_tablet_manager.cc:1151] Deleting tablet d895be304fcf445e9a4d2d8242becdd5
0619 19:54:05.772210 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.815506 (+ 43296us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.897652 (+ 82146us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.898610 (+ 958us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4703872}
I20260619 19:54:05.899533 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 132) took 4831 ms. Trace:
I20260619 19:54:05.899669 1973 rpcz_store.cc:276] 0619 19:54:01.068497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.068543 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:05.899371 (+4830828us) ts_tablet_manager.cc:1151] Deleting tablet 9f6ec149e1ac475f8038b328dae4af2a
0619 19:54:05.899381 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.899517 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4830630}
I20260619 19:54:05.900089 1973 tablet_replica.cc:333] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:05.900331 1973 raft_consensus.cc:2243] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.900544 1973 raft_consensus.cc:2272] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.901242 1973 ts_tablet_manager.cc:1916] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.906196 1994 ts_tablet_manager.cc:1929] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:05.906188 2269 raft_consensus.cc:493] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.906337 2269 raft_consensus.cc:515] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.907222 2269 leader_election.cc:290] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.916625 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b5b750f7d094451590e28703c841b6c5" } new_table_name: "default.Table_cce3f00760d0463f87c8fea78a0e425c" modify_external_catalogs: true
I20260619 19:54:05.935573 751 tablet_service.cc:1511] Processing CreateTablet for tablet bb514fda80e64ac9abc147d9a6adce76 (DEFAULT_TABLE table=default.Table_13defec349014a83b249f7db46924c0e [id=4a0bee70b1e843b086d0ccc5b4cf13ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.936192 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb514fda80e64ac9abc147d9a6adce76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.937328 746 tablet_service.cc:1511] Processing CreateTablet for tablet d84c4053cd194a27b86d9a924137dc15 (DEFAULT_TABLE table=default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.937789 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84c4053cd194a27b86d9a924137dc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.938277 749 tablet_service.cc:1511] Processing CreateTablet for tablet f39a95a0ac714de388ed04a8a14e4f6d (DEFAULT_TABLE table=default.Table_8e9360a87f5a4f8b990df38ad739a3c5 [id=050ce6b1eee349318da902df45aa205e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.938688 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39a95a0ac714de388ed04a8a14e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.941892 761 tablet_service.cc:1511] Processing CreateTablet for tablet 7e90afc275a147c99616529dccc866cd (DEFAULT_TABLE table=default.Table_1d03edf897d2401c8e37c1351616b21c [id=9ed21405f8364c3ca3edc992fa68d588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.942342 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90afc275a147c99616529dccc866cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.943737 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:05.944144 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]). Expected version 2 got 0
I20260619 19:54:05.944386 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:05.944658 525 catalog_manager.cc:5696] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:05.945164 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:05.945613 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:05.945792 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:05.945981 758 tablet_service.cc:1511] Processing CreateTablet for tablet d1d23b9d751c48ad858a35771b0ded61 (DEFAULT_TABLE table=default.Table_7c2adacdb99143a0a08280f26b2502ec [id=46cd2d6b7e0941618273a466d5387411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.946451 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d23b9d751c48ad858a35771b0ded61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:05.910892 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991c877feeae43c580d9471c25c4424c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:05.948046 1057 raft_consensus.cc:2393] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:05.948316 1994 log.cc:1199] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:05.948863 1994 ts_tablet_manager.cc:1950] T 79f8635b919a44a8a1e5fe48420ca4b7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:05.931738 2114 raft_consensus.cc:493] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.946858 1200 tablet_bootstrap.cc:492] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:05.950340 1200 ts_tablet_manager.cc:1403] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.002s
I20260619 19:54:05.950254 2114 raft_consensus.cc:515] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.951684 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 788550efad2f4dbc917131cff1e76f09 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e5c1ffd83c944ada87d59439b6a9cb3) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.951416 1200 raft_consensus.cc:359] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:05.951972 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 10f6e202e8fd4a7292774d5eb4c7266b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10f6e202e8fd4a7292774d5eb4c7266b already in progress: creating tablet
I20260619 19:54:05.952040 1200 raft_consensus.cc:385] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.952107 1200 raft_consensus.cc:740] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.952319 1200 consensus_queue.cc:260] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.952917 2114 leader_election.cc:290] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:05.953150 1200 ts_tablet_manager.cc:1434] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:05.953441 1200 tablet_bootstrap.cc:492] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:05.954010 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d651c8fb8ff244a5a09dd9ea593ecb14" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:05.954609 923 raft_consensus.cc:3060] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:05.954672 996 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.955195 1200 tablet_bootstrap.cc:654] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:05.879031 1201 consensus_queue.cc:260] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.956223 1994 tablet_replica.cc:333] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:05.956638 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]) successfully deleted
I20260619 19:54:05.958392 1994 raft_consensus.cc:2243] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:05.959209 1994 raft_consensus.cc:2272] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:05.960219 1994 ts_tablet_manager.cc:1916] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:05.964148 1057 raft_consensus.cc:1275] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:54:05.964768 2272 consensus_queue.cc:1048] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:05.972126 1200 tablet_bootstrap.cc:492] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:05.972304 1200 ts_tablet_manager.cc:1403] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.002s
I20260619 19:54:05.973623 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 7a0c189a1a614e0cbd0862291eb0962a
I20260619 19:54:05.973603 1200 raft_consensus.cc:359] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.973805 1200 raft_consensus.cc:385] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:05.973855 1200 raft_consensus.cc:740] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:05.974051 1200 consensus_queue.cc:260] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.974893 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a0c189a1a614e0cbd0862291eb0962a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:05.974565 1200 ts_tablet_manager.cc:1434] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:05.975301 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a0c189a1a614e0cbd0862291eb0962a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:05.975406 1200 tablet_bootstrap.cc:492] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:05.977051 1200 tablet_bootstrap.cc:654] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:05.977589 858 leader_election.cc:343] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 5bae5be1340f4158a0b243415e232ae5
I20260619 19:54:05.977730 858 leader_election.cc:304] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.978299 2272 raft_consensus.cc:2749] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.980073 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0e601c022049fcb050f7b90b9f3a98 (DEFAULT_TABLE table=default.Table_5e763c81e6e04a5c84aa92c7ad787054 [id=260a1589b47541418e8d23219ff3c400]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:05.980635 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0e601c022049fcb050f7b90b9f3a98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:05.984333 858 leader_election.cc:343] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:54:05.984498 858 leader_election.cc:304] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.985114 2272 raft_consensus.cc:2749] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.985584 2479 tablet.cc:1724] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:05.986573 1201 ts_tablet_manager.cc:1434] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.110s user 0.002s sys 0.001s
W20260619 19:54:05.988201 858 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:54:05.989118 858 leader_election.cc:304] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:05.989952 2272 raft_consensus.cc:2749] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:05.990439 2314 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:05.990612 2314 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:05.991482 2314 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:05.992262 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:05.992889 720 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:05.996335 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a54231986cca44258942dbc3373870b2 with delete_type TABLET_DATA_DELETED (replaced by tablet d6bc861cb7d941f380671105fd338538) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:05.996894 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d651c8fb8ff244a5a09dd9ea593ecb14" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:05.998684 1973 ts_tablet_manager.cc:1929] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.000568 1201 tablet_bootstrap.cc:492] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:06.001917 996 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.002000 2272 consensus_queue.cc:1048] T 369cb2f2b599469680eed94a221c2f27 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:06.002087 996 leader_election.cc:304] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:06.002478 1201 tablet_bootstrap.cc:654] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.004119 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8ced5f8d284a4065bf67d55d8b216f0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.004791 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ced5f8d284a4065bf67d55d8b216f0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.006091 2114 raft_consensus.cc:2749] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.007166 1973 log.cc:1199] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/550297c4d14f4d679d11fded97b671ae
I20260619 19:54:06.006093 1200 tablet_bootstrap.cc:492] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:06.007519 1200 ts_tablet_manager.cc:1403] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260619 19:54:06.008168 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 2448429656934063887b63d9a6e79894 (table default.Table_8e52c915643548ad8181928b723f114a [id=3cd29e4892f64fc58f58ea3233fc2f3a]) successfully deleted
I20260619 19:54:06.009184 1200 raft_consensus.cc:359] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.009395 1200 raft_consensus.cc:385] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.009466 1200 raft_consensus.cc:740] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.009799 1200 consensus_queue.cc:260] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.010409 1200 ts_tablet_manager.cc:1434] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:06.014178 1200 tablet_bootstrap.cc:492] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:06.010407 1994 ts_tablet_manager.cc:1929] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:06.016151 1994 log.cc:1199] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fcaeebaaa93c479bafff14d312d526ec
I20260619 19:54:06.017284 1973 ts_tablet_manager.cc:1950] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:06.017968 1994 ts_tablet_manager.cc:1950] T fcaeebaaa93c479bafff14d312d526ec P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.019073 1994 tablet_replica.cc:333] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.020968 2026 ts_tablet_manager.cc:1929] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.021420 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]) successfully deleted
I20260619 19:54:06.021773 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d895be304fcf445e9a4d2d8242becdd5 (table default.Table_cdaa064b7d3c46a9842fd5a4ac38f619 [id=f097182abb8d4815befec43f3b218b90]) successfully deleted
I20260619 19:54:06.023377 1994 raft_consensus.cc:2243] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.023677 1994 raft_consensus.cc:2272] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.017613 1200 tablet_bootstrap.cc:654] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:06.025143 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9f6ec149e1ac475f8038b328dae4af2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f6ec149e1ac475f8038b328dae4af2a already in progress: creating tablet
I20260619 19:54:06.024979 2026 log.cc:1199] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/6ef20e35c612400bbbf1c707a36ced8c
I20260619 19:54:06.025635 1994 ts_tablet_manager.cc:1916] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.022852 719 leader_election.cc:304] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.028951 2026 ts_tablet_manager.cc:1950] T 6ef20e35c612400bbbf1c707a36ced8c P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.029343 2324 raft_consensus.cc:2749] T 59123a56731645e1bbfcc94b2a46b1d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.032932 1201 tablet_bootstrap.cc:492] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:06.032002 719 leader_election.cc:343] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.033152 1201 ts_tablet_manager.cc:1403] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.001s
I20260619 19:54:06.034076 1201 raft_consensus.cc:359] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.034329 1201 raft_consensus.cc:385] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.034442 1201 raft_consensus.cc:740] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.034708 1201 consensus_queue.cc:260] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.035301 1201 ts_tablet_manager.cc:1434] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:06.035606 1201 tablet_bootstrap.cc:492] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:06.033964 719 leader_election.cc:304] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.035981 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 221cc85629ca41e9ad71adfe0beb392a
I20260619 19:54:06.034451 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 102) took 4913 ms. Trace:
I20260619 19:54:06.036911 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ee493ced7f6f407db5eda645752fb00a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.037478 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee493ced7f6f407db5eda645752fb00a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.037607 1201 tablet_bootstrap.cc:654] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.036201 2026 rpcz_store.cc:276] 0619 19:54:01.121283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.121339 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:05.838575 (+4717236us) ts_tablet_manager.cc:1151] Deleting tablet 6ef20e35c612400bbbf1c707a36ced8c
0619 19:54:05.838583 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.860572 (+ 21989us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.020907 (+160335us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.034429 (+ 13522us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4687475}
I20260619 19:54:06.038889 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 19d6333b0c8940b2802307d0da8a57ac from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:06.039521 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2d03b1734ab843dc98881985c497b171" } modify_external_catalogs: true
I20260619 19:54:06.039680 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2d03b1734ab843dc98881985c497b171" } modify_external_catalogs: true
W20260619 19:54:06.041381 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10c73b679e394f31b9e5d51681e06976 consensus state has no leader
I20260619 19:54:06.041823 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1670ddb8874a46b288033b04c6975a24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.042358 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1670ddb8874a46b288033b04c6975a24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.043342 2026 tablet_replica.cc:333] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.043634 2026 raft_consensus.cc:2243] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.045572 1994 ts_tablet_manager.cc:1929] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:06.046759 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b2e40a7328d42dd864703db24c1fa3c consensus state has no leader
I20260619 19:54:06.047278 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_adb64c17de7440e7b466da4499897ca7" } modify_external_catalogs: true
I20260619 19:54:06.047501 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_adb64c17de7440e7b466da4499897ca7" } modify_external_catalogs: true
I20260619 19:54:06.049886 1201 tablet_bootstrap.cc:492] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:06.050226 1201 ts_tablet_manager.cc:1403] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260619 19:54:06.051108 2272 raft_consensus.cc:493] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.051290 2272 raft_consensus.cc:515] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.052100 2272 leader_election.cc:290] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.053081 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 6ef20e35c612400bbbf1c707a36ced8c (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]) successfully deleted
I20260619 19:54:06.053257 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 221cc85629ca41e9ad71adfe0beb392a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.059686 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 991c877feeae43c580d9471c25c4424c
I20260619 19:54:06.050549 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 221cc85629ca41e9ad71adfe0beb392a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.051807 1200 tablet_bootstrap.cc:492] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:06.049485 2026 raft_consensus.cc:2272] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.061340 1200 ts_tablet_manager.cc:1403] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.004s
I20260619 19:54:06.060818 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 991c877feeae43c580d9471c25c4424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.061934 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 991c877feeae43c580d9471c25c4424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.061990 2026 ts_tablet_manager.cc:1916] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.062306 1200 raft_consensus.cc:359] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.062493 1200 raft_consensus.cc:385] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.062553 1200 raft_consensus.cc:740] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.062779 1200 consensus_queue.cc:260] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:06.062865 859 leader_election.cc:343] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:06.063920 1200 ts_tablet_manager.cc:1434] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:54:06.064203 1200 tablet_bootstrap.cc:492] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:06.066833 1200 tablet_bootstrap.cc:654] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.072455 2026 ts_tablet_manager.cc:1929] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.074167 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2d8e5fe907c946cab36fcb67654f064b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.074962 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d8e5fe907c946cab36fcb67654f064b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:06.078418 720 consensus_peers.cc:597] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 950b8e74d12f46a68ba5eae3186c87a9. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:06.061162 1994 log.cc:1199] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/0f32e1c7a27941ca9377901b19b32af3
I20260619 19:54:06.079049 1994 ts_tablet_manager.cc:1950] T 0f32e1c7a27941ca9377901b19b32af3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.080035 1994 tablet_replica.cc:333] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.081809 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 0f32e1c7a27941ca9377901b19b32af3 (table default.Table_baef1a6b19f94884934f0c54a4dda5d0 [id=d69648d0cdb042a3a4e487ef0cf0088b]) successfully deleted
I20260619 19:54:06.083263 1994 raft_consensus.cc:2243] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.083446 1994 raft_consensus.cc:2272] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.083470 2026 log.cc:1199] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/2a3fa43017fa4c278111c29d0d22f7da
I20260619 19:54:06.083839 2026 ts_tablet_manager.cc:1950] T 2a3fa43017fa4c278111c29d0d22f7da P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.083992 1994 ts_tablet_manager.cc:1916] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.084136 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 103) took 4962 ms. Trace:
I20260619 19:54:06.084211 2026 rpcz_store.cc:276] 0619 19:54:01.121903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.121955 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:06.043283 (+4921328us) ts_tablet_manager.cc:1151] Deleting tablet 2a3fa43017fa4c278111c29d0d22f7da
0619 19:54:06.043295 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.068782 (+ 25487us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.072370 (+ 3588us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.084116 (+ 11746us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4892204}
I20260619 19:54:06.072933 1201 raft_consensus.cc:359] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.084627 1201 raft_consensus.cc:385] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.084692 1201 raft_consensus.cc:740] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.084795 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 2a3fa43017fa4c278111c29d0d22f7da (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]) successfully deleted
I20260619 19:54:06.084926 1201 consensus_queue.cc:260] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.085268 2026 tablet_replica.cc:333] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.085464 2026 raft_consensus.cc:2243] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.085951 1201 ts_tablet_manager.cc:1434] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260619 19:54:06.086105 2494 tablet.cc:1724] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:06.086239 1201 tablet_bootstrap.cc:492] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:06.088019 1201 tablet_bootstrap.cc:654] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.088193 2026 raft_consensus.cc:2272] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.089212 2026 ts_tablet_manager.cc:1916] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.093428 1200 tablet_bootstrap.cc:492] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:06.093644 1200 ts_tablet_manager.cc:1403] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.003s
I20260619 19:54:06.093770 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 134) took 4890 ms. Trace:
I20260619 19:54:06.093892 1973 rpcz_store.cc:276] 0619 19:54:01.203321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.203916 (+ 595us) service_pool.cc:224] Handling call
0619 19:54:05.900046 (+4696130us) ts_tablet_manager.cc:1151] Deleting tablet 550297c4d14f4d679d11fded97b671ae
0619 19:54:05.900055 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:05.921462 (+ 21407us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:05.998622 (+ 77160us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.093754 (+ 95132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4694331}
I20260619 19:54:06.094631 1973 tablet_replica.cc:333] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:06.094717 1200 raft_consensus.cc:359] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.094893 1200 raft_consensus.cc:385] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.094945 1200 raft_consensus.cc:740] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.095247 1200 consensus_queue.cc:260] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.095114 1973 raft_consensus.cc:2243] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.096174 1973 pending_rounds.cc:70] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:06.096342 1973 pending_rounds.cc:77] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657656990703616 op_type: NO_OP noop_request { }
I20260619 19:54:06.096515 1973 raft_consensus.cc:2889] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:06.096612 1200 ts_tablet_manager.cc:1434] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:06.096751 1973 raft_consensus.cc:2272] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.096971 1200 tablet_bootstrap.cc:492] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:06.098201 2314 raft_consensus.cc:2749] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:06.098613 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 66868us
W20260619 19:54:06.098954 719 leader_election.cc:343] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:06.099802 719 leader_election.cc:343] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.100207 719 leader_election.cc:304] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.100368 1200 tablet_bootstrap.cc:654] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:06.100699 719 raft_consensus.cc:2686] T 550297c4d14f4d679d11fded97b671ae P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:54:06.101044 719 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.101238 719 leader_election.cc:304] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.101570 2324 raft_consensus.cc:2749] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:06.102043 719 leader_election.cc:343] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.102218 719 leader_election.cc:304] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.102512 2324 raft_consensus.cc:2749] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.105171 1973 ts_tablet_manager.cc:1916] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.107019 2314 consensus_queue.cc:1048] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:06.107604 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:06.118278 2026 ts_tablet_manager.cc:1929] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.122318 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f9c88e691c944cbb8c6e440fb6e88f4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.122999 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9c88e691c944cbb8c6e440fb6e88f4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:06.123025 720 consensus_peers.cc:597] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 365c0bb1e9ac480e96e7f4d604048663. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:06.123208 2026 log.cc:1199] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/620f3a56e57e49b7b520012857e71187
I20260619 19:54:06.123639 2026 ts_tablet_manager.cc:1950] T 620f3a56e57e49b7b520012857e71187 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.124024 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 104) took 5000 ms. Trace:
I20260619 19:54:06.124102 2026 rpcz_store.cc:276] 0619 19:54:01.123672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.126320 (+ 2648us) service_pool.cc:224] Handling call
0619 19:54:06.085220 (+4958900us) ts_tablet_manager.cc:1151] Deleting tablet 620f3a56e57e49b7b520012857e71187
0619 19:54:06.085230 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.108182 (+ 22952us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.118212 (+ 10030us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.124006 (+ 5794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2563,"tablet-delete.queue_time_us":4934096}
I20260619 19:54:06.124281 1994 ts_tablet_manager.cc:1929] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:06.124470 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61adf222e10c490c9c8dd6f83edc1643 consensus state has no leader
I20260619 19:54:06.124392 1994 log.cc:1199] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/0b55debc1b064192a56d2453364ba260
I20260619 19:54:06.124807 1994 ts_tablet_manager.cc:1950] T 0b55debc1b064192a56d2453364ba260 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.124887 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c7f823584528450b8a8b973c9d7617c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.125413 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7f823584528450b8a8b973c9d7617c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.129426 1994 tablet_replica.cc:333] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.129930 1994 raft_consensus.cc:2243] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.129913 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 0b55debc1b064192a56d2453364ba260 (table default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]) successfully deleted
I20260619 19:54:06.130250 2026 tablet_replica.cc:333] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.131029 2026 raft_consensus.cc:2243] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.131892 2026 pending_rounds.cc:70] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:06.132391 2026 pending_rounds.cc:77] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657639744290816 op_type: NO_OP noop_request { }
I20260619 19:54:06.132809 2026 raft_consensus.cc:2889] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:06.133195 2026 raft_consensus.cc:2272] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.134064 2026 ts_tablet_manager.cc:1916] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.134186 1208 tablet_bootstrap.cc:492] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:06.134353 1208 ts_tablet_manager.cc:1403] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.399s user 0.004s sys 0.005s
I20260619 19:54:06.134377 1994 raft_consensus.cc:2272] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.134513 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 620f3a56e57e49b7b520012857e71187 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]) successfully deleted
I20260619 19:54:06.134922 1994 ts_tablet_manager.cc:1916] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.135179 1208 raft_consensus.cc:359] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.135390 1208 raft_consensus.cc:385] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.135459 1208 raft_consensus.cc:740] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.135656 1208 consensus_queue.cc:260] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.136133 1208 ts_tablet_manager.cc:1434] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:06.136404 1208 tablet_bootstrap.cc:492] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:06.137604 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f499d3b7eac649a7b6f05c64db213152" } new_table_name: "default.Table_a8589907aabb4c318987d6a86efc9a07" modify_external_catalogs: true
I20260619 19:54:06.137895 1208 tablet_bootstrap.cc:654] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.141772 1994 ts_tablet_manager.cc:1929] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.149205 1994 log.cc:1199] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:06.150151 1994 ts_tablet_manager.cc:1950] T c54b2e4f657245c2aa23d138968b3b0d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.151299 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]) successfully deleted
I20260619 19:54:06.154047 1994 tablet_replica.cc:333] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.154316 1994 raft_consensus.cc:2243] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.154560 1994 raft_consensus.cc:2272] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.156541 1994 ts_tablet_manager.cc:1916] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.158555 2026 ts_tablet_manager.cc:1929] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.161736 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cce54de4f5f84cd982118d476870dea9" } new_table_name: "default.Table_7c2004721849415b9906895ce0b16400" modify_external_catalogs: true
I20260619 19:54:06.163163 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e055ee491a784c58a95c7780ed1dee6c
I20260619 19:54:06.163920 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_93b0810be0b54d468ad337442bb61eb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.164448 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93b0810be0b54d468ad337442bb61eb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.166345 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_153389b9465647c6b228f0ade84d6853"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.166834 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_153389b9465647c6b228f0ade84d6853 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.167994 528 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 5035c4796f6b4d71b8ab7cf12def5c10
I20260619 19:54:06.168288 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_064db418935f4a01a304fc26453b254e [id=3c9da136fa6d4578a5ad210801a2ccea] alter complete (version 5)
I20260619 19:54:06.170297 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "991c877feeae43c580d9471c25c4424c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.170845 2026 log.cc:1199] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/376dfca0b54d4c689c96242566869717
I20260619 19:54:06.171020 1994 ts_tablet_manager.cc:1929] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.171147 1994 log.cc:1199] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/cbec819571854db8a46daae15b9127bd
I20260619 19:54:06.171339 2026 ts_tablet_manager.cc:1950] T 376dfca0b54d4c689c96242566869717 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.171427 1994 ts_tablet_manager.cc:1950] T cbec819571854db8a46daae15b9127bd P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.171733 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 95) took 5066 ms. Trace:
I20260619 19:54:06.173382 1994 tablet_replica.cc:333] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.173640 1994 raft_consensus.cc:2243] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.173947 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet cbec819571854db8a46daae15b9127bd (table default.Table_287609e30d09421a9d7a5126eef7ad2f [id=2576a9b49a8d4d3c9a0f81f0b865b174]) successfully deleted
I20260619 19:54:06.174088 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet e055ee491a784c58a95c7780ed1dee6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:06.174220 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 788550efad2f4dbc917131cff1e76f09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 788550efad2f4dbc917131cff1e76f09 already in progress: creating tablet
I20260619 19:54:06.174384 1994 raft_consensus.cc:2272] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:06.174428 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a54231986cca44258942dbc3373870b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a54231986cca44258942dbc3373870b2 already in progress: creating tablet
W20260619 19:54:06.174603 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7a0c189a1a614e0cbd0862291eb0962a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a0c189a1a614e0cbd0862291eb0962a already in progress: creating tablet
I20260619 19:54:06.174419 2026 rpcz_store.cc:276] 0619 19:54:01.105536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.105593 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:06.130189 (+5024596us) ts_tablet_manager.cc:1151] Deleting tablet 376dfca0b54d4c689c96242566869717
0619 19:54:06.130203 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.138567 (+ 8364us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.158486 (+ 19919us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.171714 (+ 13228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4978634}
I20260619 19:54:06.174934 1994 ts_tablet_manager.cc:1916] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.175836 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 106) took 5035 ms. Trace:
I20260619 19:54:06.176617 2026 rpcz_store.cc:276] 0619 19:54:01.140214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.140265 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:06.175703 (+5035438us) ts_tablet_manager.cc:1151] Deleting tablet d8c889f13fbe49c3aab1e7f0d0d08e98
0619 19:54:06.175716 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.175805 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5023339}
I20260619 19:54:06.177444 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b41b3cd479c44f1781a0022aef0bd30f" } modify_external_catalogs: true
I20260619 19:54:06.177649 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b41b3cd479c44f1781a0022aef0bd30f" } modify_external_catalogs: true
I20260619 19:54:06.178210 2026 tablet_replica.cc:333] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.178450 2026 raft_consensus.cc:2243] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.178870 2026 raft_consensus.cc:2272] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.181299 2026 ts_tablet_manager.cc:1916] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.183871 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 376dfca0b54d4c689c96242566869717 (table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]) successfully deleted
I20260619 19:54:06.184036 777 raft_consensus.cc:1275] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:54:06.184151 893 tablet_service.cc:1558] Processing DeleteTablet for tablet e055ee491a784c58a95c7780ed1dee6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:06.184165 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 because the tablet was not found. No further retry: Not found: Tablet not found: d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:54:06.184347 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ef20e35c612400bbbf1c707a36ced8c with delete_type TABLET_DATA_DELETED (replaced by tablet 5fb6712fc0994154aa5022ec16cec1ae) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.186024 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3fa43017fa4c278111c29d0d22f7da with delete_type TABLET_DATA_DELETED (replaced by tablet bb547965fc7e4aa29d427b1acc7d6e51) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.190255 1994 ts_tablet_manager.cc:1929] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:06.199232 1994 log.cc:1199] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/221cc85629ca41e9ad71adfe0beb392a
I20260619 19:54:06.199733 1994 ts_tablet_manager.cc:1950] T 221cc85629ca41e9ad71adfe0beb392a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.200953 1994 tablet_replica.cc:333] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.201016 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_94d5b0a1504044b7a1934b5c726b29d4 [id=96dda797fa474e119e765b5d9946bfb7]) successfully deleted
I20260619 19:54:06.201195 1994 raft_consensus.cc:2243] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.201387 1994 raft_consensus.cc:2272] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.201941 1994 ts_tablet_manager.cc:1916] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.204983 2026 ts_tablet_manager.cc:1929] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.207921 1994 ts_tablet_manager.cc:1929] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.209313 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4c335fc5ca4885b5482c6b749f76f9" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.209635 1994 log.cc:1199] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/991c877feeae43c580d9471c25c4424c
I20260619 19:54:06.210005 1994 ts_tablet_manager.cc:1950] T 991c877feeae43c580d9471c25c4424c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.212077 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]) successfully deleted
I20260619 19:54:06.212571 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 550297c4d14f4d679d11fded97b671ae (table default.Table_38a961b0cc2946c7b79e57cd66fbe323 [id=99ef9345e27d4380b7312b1cc8dc8b8e]) successfully deleted
W20260619 19:54:06.213178 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e055ee491a784c58a95c7780ed1dee6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e055ee491a784c58a95c7780ed1dee6c already in progress: creating tablet
W20260619 19:54:06.214764 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 268c752e60624f96b37b0afab2d994e3 consensus state has no leader
W20260619 19:54:06.227874 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7100b0bfa6d4e3baf4e7f90217f1fff consensus state has no leader
I20260619 19:54:06.212210 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:06.214345 858 leader_election.cc:343] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d4771739543f4b4189b7d603f76325f0
I20260619 19:54:06.228140 858 leader_election.cc:304] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.228365 2269 raft_consensus.cc:2749] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:06.228585 2026 log.cc:1199] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/906212dd25ef46f2b381ce6a99c39343
I20260619 19:54:06.228859 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 5d772e0bd2d4420f836fa14ca2dadb24
I20260619 19:54:06.228865 858 leader_election.cc:304] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.229005 2026 ts_tablet_manager.cc:1950] T 906212dd25ef46f2b381ce6a99c39343 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.229290 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 107) took 5088 ms. Trace:
I20260619 19:54:06.229359 2026 rpcz_store.cc:276] 0619 19:54:01.140881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.140929 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:06.178148 (+5037219us) ts_tablet_manager.cc:1151] Deleting tablet 906212dd25ef46f2b381ce6a99c39343
0619 19:54:06.178162 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.190215 (+ 12053us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.204925 (+ 14710us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.229275 (+ 24350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5025727}
I20260619 19:54:06.229691 2026 tablet_replica.cc:333] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.229871 2026 raft_consensus.cc:2243] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.230594 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d772e0bd2d4420f836fa14ca2dadb24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.231693 2367 raft_consensus.cc:493] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.231810 2367 raft_consensus.cc:515] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.232429 2367 leader_election.cc:290] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:06.232671 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5d772e0bd2d4420f836fa14ca2dadb24 because the tablet was not found. No further retry: Not found: Tablet not found: 5d772e0bd2d4420f836fa14ca2dadb24
I20260619 19:54:06.229696 2272 raft_consensus.cc:2749] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.233060 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e73d38af8241b29b8d47a5f9db1834" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:06.229702 2269 consensus_queue.cc:1048] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260619 19:54:06.233283 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e73d38af8241b29b8d47a5f9db1834" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.233505 783 raft_consensus.cc:2468] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
W20260619 19:54:06.233539 996 leader_election.cc:343] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.233970 996 leader_election.cc:304] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:06.234292 2026 raft_consensus.cc:2272] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.234318 2367 raft_consensus.cc:2804] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:06.234402 2367 raft_consensus.cc:493] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:06.234465 2367 raft_consensus.cc:3060] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.234943 2026 ts_tablet_manager.cc:1916] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.235913 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 906212dd25ef46f2b381ce6a99c39343 (table default.Table_17ad83fba0994578904672a32ee809a4 [id=64c1bcf3dc5048099e5aef869c6133f1]) successfully deleted
I20260619 19:54:06.236022 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d772e0bd2d4420f836fa14ca2dadb24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.237581 2367 raft_consensus.cc:515] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.238723 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e73d38af8241b29b8d47a5f9db1834" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:06.239326 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e73d38af8241b29b8d47a5f9db1834" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:06.239423 996 leader_election.cc:343] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.239581 783 raft_consensus.cc:3060] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.239710 2367 leader_election.cc:290] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:06.243014 783 raft_consensus.cc:2468] T 29e73d38af8241b29b8d47a5f9db1834 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:06.243753 996 leader_election.cc:304] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:06.244180 2367 raft_consensus.cc:2804] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:06.244305 2367 raft_consensus.cc:697] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:06.244540 2367 consensus_queue.cc:237] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.244593 858 leader_election.cc:304] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.245224 2273 raft_consensus.cc:2749] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.246631 2273 raft_consensus.cc:493] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.246750 2273 raft_consensus.cc:515] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.247383 2273 leader_election.cc:290] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:06.248678 859 leader_election.cc:343] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 997cd0b5a8d24b56a2d5b95ab877d95f
I20260619 19:54:06.252065 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0bc540dd0cf9434fb277800208ee0d23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.252719 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bc540dd0cf9434fb277800208ee0d23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.255434 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d2fb548e74874865afb85ec54f4c2999" } new_table_name: "default.Table_766549702f124d0286617da3d1fa585c" modify_external_catalogs: true
I20260619 19:54:06.257145 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_33b700c4c2304a889cab79d44fa29192" } new_table_name: "default.Table_58ba2f65bfe84e9fab3cad13a6a43fc4" modify_external_catalogs: true
I20260619 19:54:06.258646 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97b6432d47dd4450a21a82a3e15390ad" } modify_external_catalogs: true
I20260619 19:54:06.258853 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97b6432d47dd4450a21a82a3e15390ad" } modify_external_catalogs: true
I20260619 19:54:06.266805 2026 ts_tablet_manager.cc:1929] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.266932 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a427aad23ffe4518bea23a19e106d9da" } modify_external_catalogs: true
I20260619 19:54:06.267218 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a427aad23ffe4518bea23a19e106d9da" } modify_external_catalogs: true
I20260619 19:54:06.267426 1973 ts_tablet_manager.cc:1929] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.267580 1973 log.cc:1199] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/e151dc97ad13456ba35708d50c9d7b26
I20260619 19:54:06.268044 1973 ts_tablet_manager.cc:1950] T e151dc97ad13456ba35708d50c9d7b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:06.268350 2026 log.cc:1199] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/aafe2a956b844c9998c84bbe52070e5d
I20260619 19:54:06.268417 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 135) took 5063 ms. Trace:
I20260619 19:54:06.268528 1973 rpcz_store.cc:276] 0619 19:54:01.205097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.205135 (+ 38us) service_pool.cc:224] Handling call
0619 19:54:06.094575 (+4889440us) ts_tablet_manager.cc:1151] Deleting tablet e151dc97ad13456ba35708d50c9d7b26
0619 19:54:06.094585 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.160549 (+ 65964us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.267356 (+106807us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.268386 (+ 1030us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4888802}
I20260619 19:54:06.268785 2026 ts_tablet_manager.cc:1950] T aafe2a956b844c9998c84bbe52070e5d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.269014 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 136) took 5063 ms. Trace:
I20260619 19:54:06.269119 1973 rpcz_store.cc:276] 0619 19:54:01.205255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.206700 (+ 1445us) service_pool.cc:224] Handling call
0619 19:54:06.268920 (+5062220us) ts_tablet_manager.cc:1151] Deleting tablet 1d0fe0c67fe84e5b866fd2553ea26d91
0619 19:54:06.268929 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.269000 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5057366}
I20260619 19:54:06.269448 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 137) took 5062 ms. Trace:
I20260619 19:54:06.269675 1973 rpcz_store.cc:276] 0619 19:54:01.207011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.207641 (+ 630us) service_pool.cc:224] Handling call
0619 19:54:06.269374 (+5061733us) ts_tablet_manager.cc:1151] Deleting tablet a75baa585102481fa0ea01e87e394e32
0619 19:54:06.269381 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.269437 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5057761}
I20260619 19:54:06.270105 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 138) took 5062 ms. Trace:
I20260619 19:54:06.270223 1973 rpcz_store.cc:276] 0619 19:54:01.208109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.210937 (+ 2828us) service_pool.cc:224] Handling call
0619 19:54:06.270030 (+5059093us) ts_tablet_manager.cc:1151] Deleting tablet d8c889f13fbe49c3aab1e7f0d0d08e98
0619 19:54:06.270038 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.270089 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5058374}
I20260619 19:54:06.270704 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 139) took 5009 ms. Trace:
I20260619 19:54:06.267735 1201 tablet_bootstrap.cc:492] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:06.271843 1200 tablet_bootstrap.cc:492] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:06.272156 1201 ts_tablet_manager.cc:1403] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.186s user 0.007s sys 0.028s
I20260619 19:54:06.272403 1200 ts_tablet_manager.cc:1403] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.176s user 0.004s sys 0.030s
I20260619 19:54:06.273383 1201 raft_consensus.cc:359] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.274748 1200 raft_consensus.cc:359] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.275019 1200 raft_consensus.cc:385] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.275306 1200 raft_consensus.cc:740] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.275491 1201 raft_consensus.cc:385] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.275750 1201 raft_consensus.cc:740] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.275974 1200 consensus_queue.cc:260] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.276367 1201 consensus_queue.cc:260] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.276978 1200 ts_tablet_manager.cc:1434] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:06.277495 1201 ts_tablet_manager.cc:1434] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:54:06.277695 2511 tablet.cc:1724] T a33cb04fdb8944e8817d51bd56806665 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:06.277844 1200 tablet_bootstrap.cc:492] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:06.279985 1200 tablet_bootstrap.cc:654] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.281016 1201 tablet_bootstrap.cc:492] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:06.282706 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 110) took 5096 ms. Trace:
W20260619 19:54:06.283495 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2939b8aa0d44ad2a05a933db4ea64be consensus state has no leader
I20260619 19:54:06.283694 2026 rpcz_store.cc:276] 0619 19:54:01.186576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.186638 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:06.229646 (+5043008us) ts_tablet_manager.cc:1151] Deleting tablet aafe2a956b844c9998c84bbe52070e5d
0619 19:54:06.229656 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.245097 (+ 15441us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.266743 (+ 21646us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.282687 (+ 15944us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5042697}
I20260619 19:54:06.284240 2026 tablet_replica.cc:333] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.284514 2026 raft_consensus.cc:2243] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:06.284766 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c6cc12c429f4857a67d77c697e6dc67 has no consensus state
I20260619 19:54:06.285015 2026 raft_consensus.cc:2272] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.284997 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet aafe2a956b844c9998c84bbe52070e5d (table default.Table_06fee996690b44c3ad920d2090ceffa6 [id=129e814ff97d42f188d80f6418013bab]) successfully deleted
I20260619 19:54:06.285630 2026 ts_tablet_manager.cc:1916] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.284765 1201 tablet_bootstrap.cc:654] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.303617 2114 raft_consensus.cc:493] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.303794 2114 raft_consensus.cc:515] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.304476 2114 leader_election.cc:290] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:06.305140 859 consensus_peers.cc:597] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b55debc1b064192a56d2453364ba260. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:06.306391 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5235127fb54d3dba90c9f9f8c134b4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:06.307056 996 leader_election.cc:343] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.317667 2026 ts_tablet_manager.cc:1929] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.323114 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 991c877feeae43c580d9471c25c4424c from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:06.325227 2026 log.cc:1199] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/5ea9f17d5e75499a8433fc9a3043a88e
I20260619 19:54:06.326380 2026 ts_tablet_manager.cc:1950] T 5ea9f17d5e75499a8433fc9a3043a88e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.328436 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 111) took 5139 ms. Trace:
I20260619 19:54:06.331123 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fd9dcd6a21e24888866aa67ba27aa6dc" } new_table_name: "default.Table_683e56047bab4803ac1a7aacc234fe1d" modify_external_catalogs: true
I20260619 19:54:06.331188 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e8aecb4ea70048aea4fe2ec891d5e724"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.331881 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8aecb4ea70048aea4fe2ec891d5e724 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.332769 2026 rpcz_store.cc:276] 0619 19:54:01.188465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.188560 (+ 95us) service_pool.cc:224] Handling call
0619 19:54:06.284175 (+5095615us) ts_tablet_manager.cc:1151] Deleting tablet 5ea9f17d5e75499a8433fc9a3043a88e
0619 19:54:06.284186 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.294254 (+ 10068us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.317581 (+ 23327us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.328385 (+ 10804us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5095403}
I20260619 19:54:06.334064 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 5ea9f17d5e75499a8433fc9a3043a88e (table default.Table_cce57077140d46f9a0edd649b40aee9b [id=3d33268b0c5646a3b30ede644069504f]) successfully deleted
I20260619 19:54:06.334421 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5235127fb54d3dba90c9f9f8c134b4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:06.335294 996 leader_election.cc:343] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.335428 996 leader_election.cc:304] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:06.335682 2026 tablet_replica.cc:333] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.336067 2026 raft_consensus.cc:2243] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.336176 2114 raft_consensus.cc:2749] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.336843 2026 raft_consensus.cc:2272] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.338586 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b53b86c349a64aa58319ee1134c1b1de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.339206 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b53b86c349a64aa58319ee1134c1b1de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.339500 2272 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.339653 2272 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.340024 2026 ts_tablet_manager.cc:1916] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.340281 2272 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.341041 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:06.343214 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 148cf851ef5f4ed18ce82ee94d567d55 consensus state has no leader
W20260619 19:54:06.347005 859 consensus_peers.cc:597] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f32e1c7a27941ca9377901b19b32af3. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:06.351866 720 consensus_peers.cc:597] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 991c877feeae43c580d9471c25c4424c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:06.352294 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 221cc85629ca41e9ad71adfe0beb392a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.352648 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 991c877feeae43c580d9471c25c4424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.352939 747 tablet_service.cc:1558] Processing DeleteTablet for tablet e055ee491a784c58a95c7780ed1dee6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.353210 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d772e0bd2d4420f836fa14ca2dadb24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.353657 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet e151dc97ad13456ba35708d50c9d7b26 (table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]) successfully deleted
W20260619 19:54:06.354126 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1d0fe0c67fe84e5b866fd2553ea26d91 because the tablet was not found. No further retry: Not found: Tablet not found: 1d0fe0c67fe84e5b866fd2553ea26d91
W20260619 19:54:06.354378 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a75baa585102481fa0ea01e87e394e32 because the tablet was not found. No further retry: Not found: Tablet not found: a75baa585102481fa0ea01e87e394e32
W20260619 19:54:06.354595 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d8c889f13fbe49c3aab1e7f0d0d08e98 because the tablet was not found. No further retry: Not found: Tablet not found: d8c889f13fbe49c3aab1e7f0d0d08e98
I20260619 19:54:06.354893 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:06.354992 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a0c189a1a614e0cbd0862291eb0962a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.355167 923 raft_consensus.cc:3060] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.355173 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:06.355629 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:06.355981 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]). Expected version 1 got 0
I20260619 19:54:06.356268 525 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_f79091265bad4f8dbe6a97b1a36a81d2 [id=394d8c70bca54b0eb32990278e06cd91] alter complete (version 4)
I20260619 19:54:06.356545 2511 tablet.cc:1724] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:06.361419 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 365c0bb1e9ac480e96e7f4d604048663 with delete_type TABLET_DATA_DELETED (replaced by tablet 85564712c0584e3f9c9a399a36709e5a) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:06.362672 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 365c0bb1e9ac480e96e7f4d604048663 because the tablet was not found. No further retry: Not found: Tablet not found: 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:06.364784 2479 tablet.cc:1724] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:06.368849 1208 tablet_bootstrap.cc:492] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:06.369059 1208 ts_tablet_manager.cc:1403] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.233s user 0.003s sys 0.006s
I20260619 19:54:06.369247 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b289d3068d184d47b671617213aa512a
I20260619 19:54:06.369998 1208 raft_consensus.cc:359] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.370256 1208 raft_consensus.cc:385] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.370355 1208 raft_consensus.cc:740] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.370617 1208 consensus_queue.cc:260] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.370733 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b289d3068d184d47b671617213aa512a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.374166 2026 ts_tablet_manager.cc:1929] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.374589 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet b289d3068d184d47b671617213aa512a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:06.375393 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b289d3068d184d47b671617213aa512a because the tablet was not found. No further retry: Not found: Tablet not found: b289d3068d184d47b671617213aa512a
I20260619 19:54:06.376063 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4c7cb900600a4a3187137ce27bd3a8cb" } modify_external_catalogs: true
I20260619 19:54:06.376225 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4c7cb900600a4a3187137ce27bd3a8cb" } modify_external_catalogs: true
I20260619 19:54:06.377589 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1c6a727020ed49ac83911dca4c46a392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.378144 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c6a727020ed49ac83911dca4c46a392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.379526 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ece67ba490164fbda8ded59ca42a5b12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.380067 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ece67ba490164fbda8ded59ca42a5b12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.381560 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d5de5ed4c25e4cacadac49134c646e84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.382185 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5de5ed4c25e4cacadac49134c646e84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.383975 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_442f268fdee346aca6c6696de3acecc9" } modify_external_catalogs: true
I20260619 19:54:06.384225 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_442f268fdee346aca6c6696de3acecc9" } modify_external_catalogs: true
I20260619 19:54:06.389962 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 910cf00e57404f1097800e84a2070b26 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:06.371027 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997cd0b5a8d24b56a2d5b95ab877d95f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.393978 783 raft_consensus.cc:2468] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:06.372057 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.373636 2314 consensus_queue.cc:1048] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:06.394796 781 raft_consensus.cc:2393] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:06.395009 2026 log.cc:1199] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/2d1b7b743e594e2aaeaeedd8613d9789
I20260619 19:54:06.395500 2026 ts_tablet_manager.cc:1950] T 2d1b7b743e594e2aaeaeedd8613d9789 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.271322 1973 rpcz_store.cc:276] 0619 19:54:01.261007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.261429 (+ 422us) service_pool.cc:224] Handling call
0619 19:54:06.270561 (+5009132us) ts_tablet_manager.cc:1151] Deleting tablet f6c6ad82f0c94e27b2eb4dbf185fab66
0619 19:54:06.270569 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.270690 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5008360}
I20260619 19:54:06.395931 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 140) took 5130 ms. Trace:
I20260619 19:54:06.396091 1973 rpcz_store.cc:276] 0619 19:54:01.265685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.265736 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:06.395784 (+5130048us) ts_tablet_manager.cc:1151] Deleting tablet b8e3354ae6dd46bd9c5414d4c4a720a1
0619 19:54:06.395795 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.395910 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5128542}
I20260619 19:54:06.396544 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 141) took 5110 ms. Trace:
I20260619 19:54:06.397595 1973 rpcz_store.cc:276] 0619 19:54:01.286142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.287022 (+ 880us) service_pool.cc:224] Handling call
0619 19:54:06.396446 (+5109424us) ts_tablet_manager.cc:1151] Deleting tablet 40e1b92467a44737bfabb6ec1c924ea1
0619 19:54:06.396458 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.396527 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5109143}
I20260619 19:54:06.398059 1973 tablet_replica.cc:333] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:06.398402 1973 raft_consensus.cc:2243] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.398629 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 113) took 5199 ms. Trace:
I20260619 19:54:06.398793 1973 raft_consensus.cc:2272] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:06.393266 719 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.399190 719 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.399499 2314 raft_consensus.cc:2749] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.400309 2272 consensus_queue.cc:1048] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:06.400309 2026 rpcz_store.cc:276] 0619 19:54:01.199039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.199114 (+ 75us) service_pool.cc:224] Handling call
0619 19:54:06.334490 (+5135376us) ts_tablet_manager.cc:1151] Deleting tablet 2d1b7b743e594e2aaeaeedd8613d9789
0619 19:54:06.334502 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.371034 (+ 36532us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.374094 (+ 3060us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.398577 (+ 24483us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5135042}
I20260619 19:54:06.400825 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 2d1b7b743e594e2aaeaeedd8613d9789 (table default.Table_e628fda622264f3eb2fdbfbffbf213cc [id=6db61c680af2412f8943d8fb98e9e7fd]) successfully deleted
I20260619 19:54:06.402947 858 leader_election.cc:304] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.403232 2272 raft_consensus.cc:2804] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:06.403330 2272 raft_consensus.cc:493] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:06.403430 2272 raft_consensus.cc:3060] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.390962 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:06.404106 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f
I20260619 19:54:06.404526 2026 tablet_replica.cc:333] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.405045 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:06.405788 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f already in progress: creating tablet
I20260619 19:54:06.406637 2272 raft_consensus.cc:515] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.407539 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.408262 2026 raft_consensus.cc:2243] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.408710 2026 raft_consensus.cc:2272] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:06.410059 859 leader_election.cc:343] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 997cd0b5a8d24b56a2d5b95ab877d95f
I20260619 19:54:06.410331 2272 leader_election.cc:290] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.411239 1208 ts_tablet_manager.cc:1434] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.042s user 0.001s sys 0.001s
I20260619 19:54:06.411303 2026 ts_tablet_manager.cc:1916] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.411753 1208 tablet_bootstrap.cc:492] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:06.417395 2026 ts_tablet_manager.cc:1929] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.417290 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9359939c44674491aed56c5ad7d71e13" } new_table_name: "default.Table_87768bcb7d2347faa2a8624f28911b02" modify_external_catalogs: true
I20260619 19:54:06.419181 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9f0ad99a69364bddb17a16eb224030b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.420023 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f0ad99a69364bddb17a16eb224030b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.422169 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3da787af0c3645428fe490e3179bb610"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.422834 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3da787af0c3645428fe490e3179bb610 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.425871 2314 raft_consensus.cc:493] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:06.426023 2314 raft_consensus.cc:515] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.426652 2314 leader_election.cc:290] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:06.428047 720 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 76ffe451545c4af6821971384fce483e
I20260619 19:54:06.430828 1973 ts_tablet_manager.cc:1916] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.431205 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:06.433462 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:06.434195 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cc57b42a97fa437b93842f7cd379dbb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc57b42a97fa437b93842f7cd379dbb7 already in progress: creating tablet
W20260619 19:54:06.434885 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6c6ad82f0c94e27b2eb4dbf185fab66 already in progress: creating tablet
W20260619 19:54:06.435456 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8e3354ae6dd46bd9c5414d4c4a720a1 already in progress: creating tablet
W20260619 19:54:06.436345 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 40e1b92467a44737bfabb6ec1c924ea1 because the tablet was not found. No further retry: Not found: Tablet not found: 40e1b92467a44737bfabb6ec1c924ea1
W20260619 19:54:06.438369 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf175c80483346788a148b7277b9ca9d consensus state has no leader
I20260619 19:54:06.438371 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b289d3068d184d47b671617213aa512a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:06.439646 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 61074.9us
I20260619 19:54:06.440603 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_377571595e3f44ee8f2df88f6a261499" } modify_external_catalogs: true
I20260619 19:54:06.440820 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_377571595e3f44ee8f2df88f6a261499" } modify_external_catalogs: true
I20260619 19:54:06.442440 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1cb5ed58b73446f6bb30ec91f6eecb5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.443105 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb5ed58b73446f6bb30ec91f6eecb5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.445011 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_516e7616f9ea454fbe587f5be52a3c55" } new_table_name: "default.Table_4e0bca12b7834af7a6690074fa09e1e8" modify_external_catalogs: true
I20260619 19:54:06.447554 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dce56a19d6f24028956f0904bad88cd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:06.424612 1201 tablet_bootstrap.cc:492] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:06.448195 2114 consensus_queue.cc:1048] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:06.448298 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dce56a19d6f24028956f0904bad88cd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.434439 858 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.448922 2343 raft_consensus.cc:3060] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.448910 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.449255 761 tablet_service.cc:1558] Processing DeleteTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.450971 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997cd0b5a8d24b56a2d5b95ab877d95f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:06.451155 781 raft_consensus.cc:3060] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.451294 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:06.435005 890 tablet_service.cc:1558] Processing DeleteTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:06.438691 859 consensus_peers.cc:597] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcaeebaaa93c479bafff14d312d526ec. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:06.446662 2272 raft_consensus.cc:493] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:06.452466 2272 raft_consensus.cc:515] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.453614 2114 raft_consensus.cc:493] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.453747 2114 raft_consensus.cc:515] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.454173 913 raft_consensus.cc:2468] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:06.454371 2114 leader_election.cc:290] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:06.454907 859 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 76ffe451545c4af6821971384fce483e
I20260619 19:54:06.455062 2272 leader_election.cc:290] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.455058 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.455258 785 raft_consensus.cc:2468] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:06.455499 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:06.455636 996 leader_election.cc:304] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:06.455868 2114 raft_consensus.cc:2804] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:06.455943 2114 raft_consensus.cc:493] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:06.455999 2114 raft_consensus.cc:3060] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:06.456038 996 leader_election.cc:343] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.456532 2343 raft_consensus.cc:2749] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.457458 1201 ts_tablet_manager.cc:1403] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.177s user 0.012s sys 0.012s
I20260619 19:54:06.458302 781 raft_consensus.cc:2468] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:06.458225 1201 raft_consensus.cc:359] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.458442 1201 raft_consensus.cc:385] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.458513 1201 raft_consensus.cc:740] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.458492 2114 raft_consensus.cc:515] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.458779 1201 consensus_queue.cc:260] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.459468 1201 ts_tablet_manager.cc:1434] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:06.459896 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:06.460193 1201 tablet_bootstrap.cc:492] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:06.460350 996 leader_election.cc:343] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.460788 2114 leader_election.cc:290] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:06.461750 1200 tablet_bootstrap.cc:492] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:06.462023 1201 tablet_bootstrap.cc:654] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.462309 1200 ts_tablet_manager.cc:1403] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.185s user 0.004s sys 0.024s
I20260619 19:54:06.462893 2026 log.cc:1199] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/997cd0b5a8d24b56a2d5b95ab877d95f
I20260619 19:54:06.463464 2026 ts_tablet_manager.cc:1950] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.464044 1200 raft_consensus.cc:359] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.464399 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 114) took 5225 ms. Trace:
I20260619 19:54:06.464437 1200 raft_consensus.cc:385] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.464601 1200 raft_consensus.cc:740] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.465174 1200 consensus_queue.cc:260] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.465744 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_a3f0b91866884789b9a1ddc76a59ca8f [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 2 got 0
I20260619 19:54:06.466189 525 catalog_manager.cc:5696] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:06.466890 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:06.467185 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 3 got 0
I20260619 19:54:06.467085 2026 rpcz_store.cc:276] 0619 19:54:01.238950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.239002 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:06.404263 (+5165261us) ts_tablet_manager.cc:1151] Deleting tablet 997cd0b5a8d24b56a2d5b95ab877d95f
0619 19:54:06.404459 (+ 196us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.408592 (+ 4133us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x616000240454. stack: 00007ff028f96496 00007ff028f96250 00007ff027fc13ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ff03503c7e0 00007ff036388933 00007ff038f4bae7 00007ff038f7ebb4 00007ff038f5f5d0 00007ff038f5f35d 0000000000aa681c 00007ff028fdc9ff 00007ff028fdfd1b 00007ff028fdfb98
0619 19:54:06.414450 (+ 5858us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.417319 (+ 2869us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.464351 (+ 47032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134,"spinlock_wait_cycles":8064256,"tablet-delete.queue_time_us":5165032}
I20260619 19:54:06.465879 1201 tablet_bootstrap.cc:492] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:06.468263 687 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b289d3068d184d47b671617213aa512a
I20260619 19:54:06.468492 1201 ts_tablet_manager.cc:1403] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260619 19:54:06.468885 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 997cd0b5a8d24b56a2d5b95ab877d95f (table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]) successfully deleted
I20260619 19:54:06.470026 1201 raft_consensus.cc:359] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.471112 1201 raft_consensus.cc:385] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.470868 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b289d3068d184d47b671617213aa512a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.469274 2026 tablet_replica.cc:333] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.471622 1201 raft_consensus.cc:740] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.472115 1201 consensus_queue.cc:260] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.472968 1201 ts_tablet_manager.cc:1434] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260619 19:54:06.473165 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet b289d3068d184d47b671617213aa512a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.473574 1201 tablet_bootstrap.cc:492] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:06.473589 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 9d44344339f34866bab486a5abf104e9 (DEFAULT_TABLE table=default.Table_964ffc6514a5430fbe8b02896e73a88d [id=518a38380c6f458293f654e461430357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.474771 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d44344339f34866bab486a5abf104e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.475114 1201 tablet_bootstrap.cc:654] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.476514 2026 raft_consensus.cc:2243] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.479267 1208 tablet_bootstrap.cc:654] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.479403 2026 raft_consensus.cc:2272] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:06.479583 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b289d3068d184d47b671617213aa512a because the tablet was not found. No further retry: Not found: Tablet not found: b289d3068d184d47b671617213aa512a
W20260619 19:54:06.479871 858 consensus_peers.cc:597] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:06.479997 2026 ts_tablet_manager.cc:1916] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.480680 858 leader_election.cc:304] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:06.480861 858 raft_consensus.cc:2686] T 997cd0b5a8d24b56a2d5b95ab877d95f P 95181cc281b946c8b81aa825232d9498: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:06.482064 890 tablet_service.cc:1511] Processing CreateTablet for tablet 9d44344339f34866bab486a5abf104e9 (DEFAULT_TABLE table=default.Table_964ffc6514a5430fbe8b02896e73a88d [id=518a38380c6f458293f654e461430357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.482450 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d44344339f34866bab486a5abf104e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.483603 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6e5f969929426d95a49cf597bda491 (DEFAULT_TABLE table=default.Table_5a96ee39da6c4a1a8987e658455b7ebf [id=57c10ea9f1724c4b8af692f07dc3a0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.483950 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6e5f969929426d95a49cf597bda491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.484490 893 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6e5f969929426d95a49cf597bda491 (DEFAULT_TABLE table=default.Table_5a96ee39da6c4a1a8987e658455b7ebf [id=57c10ea9f1724c4b8af692f07dc3a0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.484886 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6e5f969929426d95a49cf597bda491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.492300 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8522f562665540ce99490ab90e02d801
I20260619 19:54:06.492285 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b289d3068d184d47b671617213aa512a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.493039 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9d44344339f34866bab486a5abf104e9 (DEFAULT_TABLE table=default.Table_964ffc6514a5430fbe8b02896e73a88d [id=518a38380c6f458293f654e461430357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.493268 1201 tablet_bootstrap.cc:492] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:06.493587 2511 tablet.cc:1724] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:06.493907 1201 ts_tablet_manager.cc:1403] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.004s
I20260619 19:54:06.494026 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 8522f562665540ce99490ab90e02d801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.494263 1994 tablet_replica.cc:333] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.494356 2114 raft_consensus.cc:493] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.494451 1994 raft_consensus.cc:2243] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.494521 2114 raft_consensus.cc:515] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.494619 1994 raft_consensus.cc:2272] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.495227 1994 ts_tablet_manager.cc:1916] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.495548 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9e763837fe2d46c9b0f859d4e159a2af" } new_table_name: "default.Table_289e9a40dfe544978d2b24059317037e" modify_external_catalogs: true
I20260619 19:54:06.498180 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_be833bdadf28404f9b58987bb4f6e229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.498991 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be833bdadf28404f9b58987bb4f6e229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.499428 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8522f562665540ce99490ab90e02d801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.501295 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_20dc9175b4c84bc6ac2546afae733eca" } new_table_name: "default.Table_15a49a648c354897900ac3ea18195baa" modify_external_catalogs: true
I20260619 19:54:06.501575 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dcf2293e2d461ca1be171069867d1f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:06.501750 2114 leader_election.cc:290] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:06.503768 1994 ts_tablet_manager.cc:1929] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.503931 1994 log.cc:1199] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/8522f562665540ce99490ab90e02d801
I20260619 19:54:06.504356 1994 ts_tablet_manager.cc:1950] T 8522f562665540ce99490ab90e02d801 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.505427 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]) successfully deleted
W20260619 19:54:06.507144 996 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.507681 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 8522f562665540ce99490ab90e02d801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.509928 1201 raft_consensus.cc:359] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.511188 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbfe0e049fd4b978d92145624e99a5a (DEFAULT_TABLE table=default.Table_4ee47551aa224e8eb4ecb0fa3d80243b [id=6d0f6ba5ba1f4e9a821e2d673584a1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.511682 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbfe0e049fd4b978d92145624e99a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.501950 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dcf2293e2d461ca1be171069867d1f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.513381 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d44344339f34866bab486a5abf104e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:06.513630 996 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:54:06.513736 996 leader_election.cc:304] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:06.514091 2114 raft_consensus.cc:2749] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:06.519716 2026 ts_tablet_manager.cc:1929] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.522110 1201 raft_consensus.cc:385] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.522178 2026 log.cc:1199] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9b08ab9ad59049919649b96890b6785d
I20260619 19:54:06.522236 1201 raft_consensus.cc:740] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.522343 1200 ts_tablet_manager.cc:1434] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260619 19:54:06.522650 2026 ts_tablet_manager.cc:1950] T 9b08ab9ad59049919649b96890b6785d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.522686 1200 tablet_bootstrap.cc:492] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:06.522559 1201 consensus_queue.cc:260] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.523456 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 115) took 5279 ms. Trace:
I20260619 19:54:06.523584 2026 rpcz_store.cc:276] 0619 19:54:01.243967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.244280 (+ 313us) service_pool.cc:224] Handling call
0619 19:54:06.469209 (+5224929us) ts_tablet_manager.cc:1151] Deleting tablet 9b08ab9ad59049919649b96890b6785d
0619 19:54:06.469219 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.484112 (+ 14893us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.519164 (+ 35052us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.523406 (+ 4242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4792,"tablet-delete.queue_time_us":5224661}
I20260619 19:54:06.500308 719 leader_election.cc:304] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.523979 2026 tablet_replica.cc:333] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.524168 2026 raft_consensus.cc:2243] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.524339 2026 raft_consensus.cc:2272] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.523263 1201 ts_tablet_manager.cc:1434] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260619 19:54:06.524814 1201 tablet_bootstrap.cc:492] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:06.524869 2026 ts_tablet_manager.cc:1916] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.529189 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9b08ab9ad59049919649b96890b6785d (table default.Table_9b854aa69df5459692f816d4bdebc8cf [id=4e12ede134634d1a92d756ba9c4b3219]) successfully deleted
I20260619 19:54:06.527170 2314 raft_consensus.cc:2804] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:06.514380 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.529551 2314 raft_consensus.cc:493] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:06.498786 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:06.529628 2314 raft_consensus.cc:3060] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:06.528671 747 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6e5f969929426d95a49cf597bda491 (DEFAULT_TABLE table=default.Table_5a96ee39da6c4a1a8987e658455b7ebf [id=57c10ea9f1724c4b8af692f07dc3a0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.531358 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6e5f969929426d95a49cf597bda491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.529956 785 raft_consensus.cc:3060] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.533947 2026 ts_tablet_manager.cc:1929] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.536513 2314 raft_consensus.cc:515] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.537226 2314 leader_election.cc:290] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.537678 2026 log.cc:1199] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/467bb41a4e9f46e497726c6b29ddeb04
I20260619 19:54:06.538720 893 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbfe0e049fd4b978d92145624e99a5a (DEFAULT_TABLE table=default.Table_4ee47551aa224e8eb4ecb0fa3d80243b [id=6d0f6ba5ba1f4e9a821e2d673584a1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.539229 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbfe0e049fd4b978d92145624e99a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.540755 2114 raft_consensus.cc:493] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.544113 781 raft_consensus.cc:2393] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 2: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:06.544960 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1d03edf897d2401c8e37c1351616b21c" } new_table_name: "default.Table_f689cd38e8504e5086c9f54dbb3cb6ff" modify_external_catalogs: true
I20260619 19:54:06.545087 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ef509392f1b3472db598c8b414258932
I20260619 19:54:06.547055 785 raft_consensus.cc:2468] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:06.547585 890 tablet_service.cc:1558] Processing DeleteTablet for tablet ef509392f1b3472db598c8b414258932 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.547762 996 leader_election.cc:304] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:06.549172 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 3 got 0
I20260619 19:54:06.549386 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet a33cb04fdb8944e8817d51bd56806665 (table default.Table_26bc6a5e8a714cc0a11c5ec477638d40 [id=1ae529940a7b42fdbcdf75f668b99057]). Expected version 2 got 0
I20260619 19:54:06.549543 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 3 got 0
I20260619 19:54:06.549717 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fcb1050f57246feb65f7e8948856c21 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]). Expected version 2 got 0
I20260619 19:54:06.549917 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]). Expected version 2 got 0
I20260619 19:54:06.550227 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:06.550570 529 catalog_manager.cc:5696] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:06.550712 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4846baa998dc44a790af9fe0cc649f59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:06.550997 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
W20260619 19:54:06.552412 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4846baa998dc44a790af9fe0cc649f59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.556016 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_017d2f2270454e479030dd691d1d89b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.556797 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_017d2f2270454e479030dd691d1d89b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.558792 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292] alter complete (version 2)
I20260619 19:54:06.560214 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dcf2293e2d461ca1be171069867d1f with delete_type TABLET_DATA_DELETED (replaced by tablet ba0cd4cd0661415d8b2b2339363e7aca) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.560702 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 28443b4f7da849b7b8d4c9c9b25d2034 (DEFAULT_TABLE table=default.Table_02cea83081424efcbda7f7700b976e6a [id=51db8693fa5b4553b657dadaf663295b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.561081 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28443b4f7da849b7b8d4c9c9b25d2034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.561376 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet ef509392f1b3472db598c8b414258932 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.561583 1994 tablet_replica.cc:333] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.540901 2114 raft_consensus.cc:515] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.561800 1994 raft_consensus.cc:2243] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.561964 1994 raft_consensus.cc:2272] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.561796 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.562463 1994 ts_tablet_manager.cc:1916] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:06.562500 720 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 76ffe451545c4af6821971384fce483e
I20260619 19:54:06.548561 2367 raft_consensus.cc:2804] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:06.563063 2114 leader_election.cc:290] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:06.563221 2114 raft_consensus.cc:493] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.565059 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b08ab9ad59049919649b96890b6785d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.565845 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 906212dd25ef46f2b381ce6a99c39343 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:52 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:06.569290 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2943333e572e4f1384b78d96a27d9c63 consensus state has no leader
I20260619 19:54:06.572196 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1670ddb8874a46b288033b04c6975a24" } modify_external_catalogs: true
I20260619 19:54:06.572429 1208 tablet_bootstrap.cc:492] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:06.572410 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1670ddb8874a46b288033b04c6975a24" } modify_external_catalogs: true
I20260619 19:54:06.572562 1208 ts_tablet_manager.cc:1403] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.161s user 0.004s sys 0.000s
I20260619 19:54:06.576769 1208 raft_consensus.cc:359] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.577152 1208 raft_consensus.cc:385] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.577292 1208 raft_consensus.cc:740] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.577728 1208 consensus_queue.cc:260] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.578660 1208 ts_tablet_manager.cc:1434] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260619 19:54:06.582403 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet bf175c80483346788a148b7277b9ca9d (table default.Table_87768bcb7d2347faa2a8624f28911b02 [id=14dbea33ca974c8fa94e99d0d9f79272], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bf175c80483346788a148b7277b9ca9d consensus state has no leader
I20260619 19:54:06.583014 1208 tablet_bootstrap.cc:492] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:06.584746 1208 tablet_bootstrap.cc:654] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.587906 1038 tablet_service.cc:1511] Processing CreateTablet for tablet c47b97e1eeed4f20bfe001fa48dc0471 (DEFAULT_TABLE table=default.Table_97566a6b6a6041ac9fceff103e3be47b [id=23067799ec0f4b97b8ea5aa4441a1b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.588433 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47b97e1eeed4f20bfe001fa48dc0471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.588654 2114 raft_consensus.cc:515] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.589366 2114 leader_election.cc:290] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:06.592200 897 tablet_service.cc:1511] Processing CreateTablet for tablet 17f1a741ad044673899008364a9685e4 (DEFAULT_TABLE table=default.Table_aa52395b83cb4c0e925e6cb80fe138fc [id=fb95d53613c7467aabe213fb4b8c04b4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:06.594378 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 098d5bd070b54889905539f1fa1a47e6 consensus state has no leader
W20260619 19:54:06.596952 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e90afc275a147c99616529dccc866cd consensus state has no leader
I20260619 19:54:06.601506 1022 tablet_service.cc:1511] Processing CreateTablet for tablet ac55fd703e184730ab053e045b0f4e2c (DEFAULT_TABLE table=default.Table_841448a18d3d49318e834d44004ae04e [id=4033fdba72c749f69ab79c3f6f695af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.602193 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac55fd703e184730ab053e045b0f4e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.602679 887 tablet_service.cc:1511] Processing CreateTablet for tablet ac55fd703e184730ab053e045b0f4e2c (DEFAULT_TABLE table=default.Table_841448a18d3d49318e834d44004ae04e [id=4033fdba72c749f69ab79c3f6f695af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.603103 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac55fd703e184730ab053e045b0f4e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.604378 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 17f1a741ad044673899008364a9685e4 (DEFAULT_TABLE table=default.Table_aa52395b83cb4c0e925e6cb80fe138fc [id=fb95d53613c7467aabe213fb4b8c04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.604755 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f1a741ad044673899008364a9685e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.607015 1200 tablet_bootstrap.cc:654] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.613843 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3c31ae73d7444499bbe2383080d28418"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.614544 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c31ae73d7444499bbe2383080d28418 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.616122 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d78c9341be6f497b822f0d52c9a63534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.616686 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d78c9341be6f497b822f0d52c9a63534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.619313 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d911a0e8835847cb9ccf9d5d192872fe" } modify_external_catalogs: true
I20260619 19:54:06.619499 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d911a0e8835847cb9ccf9d5d192872fe" } modify_external_catalogs: true
I20260619 19:54:06.623553 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_bce503f02a3a4c269e0776c21978ae75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.624668 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bce503f02a3a4c269e0776c21978ae75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.625753 2269 raft_consensus.cc:493] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.625955 2269 raft_consensus.cc:515] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.626804 2269 leader_election.cc:290] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.627880 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 79e86e744f254b7fbca1adfe43e3ade5 (DEFAULT_TABLE table=default.Table_02cb77fd6301496d895a8deaf26a694c [id=2331de8d5c454457a8a990c8d54d912a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.628405 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e86e744f254b7fbca1adfe43e3ade5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.629331 2324 consensus_queue.cc:1048] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:06.629964 892 tablet_service.cc:1511] Processing CreateTablet for tablet 79e86e744f254b7fbca1adfe43e3ade5 (DEFAULT_TABLE table=default.Table_02cb77fd6301496d895a8deaf26a694c [id=2331de8d5c454457a8a990c8d54d912a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.630393 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e86e744f254b7fbca1adfe43e3ade5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:06.642015 2525 log.cc:927] Time spent T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260619 19:54:06.642319 528 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 9cefc8bc179b47e2b5e7a0d71d0335b2
I20260619 19:54:06.647099 902 tablet_service.cc:1511] Processing CreateTablet for tablet e10612b432c64bb4be527cf7b6e86cf8 (DEFAULT_TABLE table=default.Table_cfe3af94594f4627b2472e46a9473733 [id=5442d9bc8ca04eb28427efbf9cd7178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.647620 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10612b432c64bb4be527cf7b6e86cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.652017 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc3a57f082e487fac8f1208193f74de (DEFAULT_TABLE table=default.Table_34389f8a6c6a46a58a7b548dc552be87 [id=2514fea92119430590a34939e95d57cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.652457 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc3a57f082e487fac8f1208193f74de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.654421 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cfe3af94594f4627b2472e46a9473733" } modify_external_catalogs: true
I20260619 19:54:06.654659 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cfe3af94594f4627b2472e46a9473733" } modify_external_catalogs: true
I20260619 19:54:06.655980 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_58ba2f65bfe84e9fab3cad13a6a43fc4" } new_table_name: "default.Table_9c97c6559f804b4eb92351eb88ee1e38" modify_external_catalogs: true
I20260619 19:54:06.656800 1973 ts_tablet_manager.cc:1929] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.656939 1973 log.cc:1199] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/46dcf2293e2d461ca1be171069867d1f
I20260619 19:54:06.657226 1973 ts_tablet_manager.cc:1950] T 46dcf2293e2d461ca1be171069867d1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:06.657526 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 142) took 5352 ms. Trace:
I20260619 19:54:06.657553 913 raft_consensus.cc:3060] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.657599 1973 rpcz_store.cc:276] 0619 19:54:01.305364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.305582 (+ 218us) service_pool.cc:224] Handling call
0619 19:54:06.398011 (+5092429us) ts_tablet_manager.cc:1151] Deleting tablet 46dcf2293e2d461ca1be171069867d1f
0619 19:54:06.398021 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.652859 (+254838us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.656728 (+ 3869us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.657505 (+ 777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23,"tablet-delete.queue_time_us":5092131}
I20260619 19:54:06.658058 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 148) took 5154 ms. Trace:
I20260619 19:54:06.658123 1973 rpcz_store.cc:276] 0619 19:54:01.503941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.503993 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:06.657931 (+5153938us) ts_tablet_manager.cc:1151] Deleting tablet 9b78d8a4d8dd42859be248b698257e2c
0619 19:54:06.657939 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.658044 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5153735}
I20260619 19:54:06.658404 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 149) took 5071 ms. Trace:
I20260619 19:54:06.658461 1973 rpcz_store.cc:276] 0619 19:54:01.586707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.587273 (+ 566us) service_pool.cc:224] Handling call
0619 19:54:06.658309 (+5071036us) ts_tablet_manager.cc:1151] Deleting tablet ba0cd4cd0661415d8b2b2339363e7aca
0619 19:54:06.658318 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.658392 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5070699}
I20260619 19:54:06.658586 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_36b881be5c294228b4f5ca85051fff7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:06.658720 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 171) took 4483 ms. Trace:
W20260619 19:54:06.659215 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36b881be5c294228b4f5ca85051fff7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.658790 1973 rpcz_store.cc:276] 0619 19:54:02.175242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.175299 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:06.658635 (+4483336us) ts_tablet_manager.cc:1151] Deleting tablet 56640f773efb4123b93f4ca3799ddde7
0619 19:54:06.658642 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.658705 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4483031}
I20260619 19:54:06.659266 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76ffe451545c4af6821971384fce483e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:06.659457 918 raft_consensus.cc:3060] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:06.659503 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 179) took 4188 ms. Trace:
I20260619 19:54:06.659564 1973 rpcz_store.cc:276] 0619 19:54:02.471515 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.471908 (+ 393us) service_pool.cc:224] Handling call
0619 19:54:06.659408 (+4187500us) ts_tablet_manager.cc:1151] Deleting tablet c54b2e4f657245c2aa23d138968b3b0d
0619 19:54:06.659416 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.659490 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4148178}
I20260619 19:54:06.659858 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 181) took 4188 ms. Trace:
I20260619 19:54:06.659927 1973 rpcz_store.cc:276] 0619 19:54:02.471850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.472072 (+ 222us) service_pool.cc:224] Handling call
0619 19:54:06.659764 (+4187692us) ts_tablet_manager.cc:1151] Deleting tablet fe814880d9984bbd83fa121cb2a34eac
0619 19:54:06.659771 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.659834 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4148460}
I20260619 19:54:06.660181 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 182) took 4188 ms. Trace:
I20260619 19:54:06.660243 1973 rpcz_store.cc:276] 0619 19:54:02.471989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.472084 (+ 95us) service_pool.cc:224] Handling call
0619 19:54:06.660102 (+4188018us) ts_tablet_manager.cc:1151] Deleting tablet b4f7122fa5f94eeaa3b99cae107d8c9a
0619 19:54:06.660110 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.660169 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4148784}
I20260619 19:54:06.660460 1973 tablet_replica.cc:333] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:06.660653 1973 raft_consensus.cc:2243] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.660838 1973 raft_consensus.cc:2272] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.660969 858 leader_election.cc:304] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:06.661314 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 4b22024a0c434f8e8d4a370dbfb9a4e2
I20260619 19:54:06.661459 1973 ts_tablet_manager.cc:1916] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.661904 923 raft_consensus.cc:3060] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:06.662372 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.667964 1023 tablet_service.cc:1511] Processing CreateTablet for tablet e10612b432c64bb4be527cf7b6e86cf8 (DEFAULT_TABLE table=default.Table_cfe3af94594f4627b2472e46a9473733 [id=5442d9bc8ca04eb28427efbf9cd7178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.668115 900 tablet_service.cc:1511] Processing CreateTablet for tablet 24c05500f1904adf966de2ea644a21d0 (DEFAULT_TABLE table=default.Table_bf2b7abe28794d908335b963f81ec478 [id=0008dbc3884e456f9eac6ca39904fe7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.671196 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.671280 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 24c05500f1904adf966de2ea644a21d0 (DEFAULT_TABLE table=default.Table_bf2b7abe28794d908335b963f81ec478 [id=0008dbc3884e456f9eac6ca39904fe7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.672557 884 tablet_service.cc:1511] Processing CreateTablet for tablet ca02c454eec840eb9289950b6da7b131 (DEFAULT_TABLE table=default.Table_8e1f6da4a6cf4417813e688ab868bfe5 [id=5d2c41238c64437a970164bc23f8368e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.673023 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca02c454eec840eb9289950b6da7b131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.676079 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10612b432c64bb4be527cf7b6e86cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.676348 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c05500f1904adf966de2ea644a21d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.681167 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ca02c454eec840eb9289950b6da7b131 (DEFAULT_TABLE table=default.Table_8e1f6da4a6cf4417813e688ab868bfe5 [id=5d2c41238c64437a970164bc23f8368e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.681720 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca02c454eec840eb9289950b6da7b131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.682628 1035 tablet_service.cc:1511] Processing CreateTablet for tablet ed116f9d309a45dfa9fb175247502448 (DEFAULT_TABLE table=default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1 [id=cc69d0b369f646b3a916fa505778d75b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.682992 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed116f9d309a45dfa9fb175247502448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.684615 889 tablet_service.cc:1511] Processing CreateTablet for tablet ed116f9d309a45dfa9fb175247502448 (DEFAULT_TABLE table=default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1 [id=cc69d0b369f646b3a916fa505778d75b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.685006 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed116f9d309a45dfa9fb175247502448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.686800 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e10612b432c64bb4be527cf7b6e86cf8
I20260619 19:54:06.688081 899 tablet_service.cc:1511] Processing CreateTablet for tablet b289d3068d184d47b671617213aa512a (DEFAULT_TABLE table=default.Table_a427aad23ffe4518bea23a19e106d9da [id=e1a0a9ba629c46c3a3a54db594738d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.688498 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289d3068d184d47b671617213aa512a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:06.691453 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c6cc12c429f4857a67d77c697e6dc67 has no consensus state
I20260619 19:54:06.692615 891 tablet_service.cc:1558] Processing DeleteTablet for tablet e10612b432c64bb4be527cf7b6e86cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.693065 2533 raft_consensus.cc:493] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.693889 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 789f44a51430454db30e41ad2dd2efb0 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:06.696138 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1cb5ed58b73446f6bb30ec91f6eecb5d" } modify_external_catalogs: true
I20260619 19:54:06.696316 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1cb5ed58b73446f6bb30ec91f6eecb5d" } modify_external_catalogs: true
I20260619 19:54:06.698259 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:06.700125 2367 raft_consensus.cc:697] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:06.700460 2367 consensus_queue.cc:237] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.701354 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e10612b432c64bb4be527cf7b6e86cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.701025 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b289d3068d184d47b671617213aa512a (DEFAULT_TABLE table=default.Table_a427aad23ffe4518bea23a19e106d9da [id=e1a0a9ba629c46c3a3a54db594738d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.704267 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289d3068d184d47b671617213aa512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.706179 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_bbf9c52ad68e4f60911fce508327d27e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:06.706446 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cf2b360e04054330b4d943aa98f00f35 (DEFAULT_TABLE table=default.Table_8e946647b6d04169af7519314919e899 [id=ee36d5ee156742fa82f9d878266bdefc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.706799 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b360e04054330b4d943aa98f00f35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:06.706908 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbf9c52ad68e4f60911fce508327d27e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.700181 2533 raft_consensus.cc:515] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.707841 2533 leader_election.cc:290] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:06.713439 719 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.105.189:45849, user_credentials={real_user=slave}} blocked reactor thread for 50129.4us
I20260619 19:54:06.719365 891 tablet_service.cc:1511] Processing CreateTablet for tablet cf2b360e04054330b4d943aa98f00f35 (DEFAULT_TABLE table=default.Table_8e946647b6d04169af7519314919e899 [id=ee36d5ee156742fa82f9d878266bdefc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.719827 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b360e04054330b4d943aa98f00f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.730029 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55684b109a03488a88efd45a067159a0" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.732033 1201 tablet_bootstrap.cc:654] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.732241 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f1a741ad044673899008364a9685e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.732036 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.734205 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_133d7ea5230b46b39f99d27ceeef20c8" } new_table_name: "default.Table_c8ee7b25f5724fe792e9348b66392518" modify_external_catalogs: true
I20260619 19:54:06.737125 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9a415c8fc09b47168de84f6fa673df9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:06.737418 1994 ts_tablet_manager.cc:1929] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.737531 1994 log.cc:1199] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/46dcf2293e2d461ca1be171069867d1f
W20260619 19:54:06.737787 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a415c8fc09b47168de84f6fa673df9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.737823 1994 ts_tablet_manager.cc:1950] T 46dcf2293e2d461ca1be171069867d1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:06.738349 896 tablet_service.cc:1511] Processing CreateTablet for tablet c47b97e1eeed4f20bfe001fa48dc0471 (DEFAULT_TABLE table=default.Table_97566a6b6a6041ac9fceff103e3be47b [id=23067799ec0f4b97b8ea5aa4441a1b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.739688 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f9584ecbe09048ff96f36ffc361d09b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.740319 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9584ecbe09048ff96f36ffc361d09b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.742085 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 789f44a51430454db30e41ad2dd2efb0
I20260619 19:54:06.742427 2272 raft_consensus.cc:493] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.742527 524 catalog_manager.cc:6784] ReplaceTablet: tablet 789f44a51430454db30e41ad2dd2efb0 deleted and replaced by tablet 8604e0a1655c4d7da4100dd304c0d2cf
I20260619 19:54:06.742604 2026 ts_tablet_manager.cc:1950] T 467bb41a4e9f46e497726c6b29ddeb04 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:06.737596 901 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc3a57f082e487fac8f1208193f74de (DEFAULT_TABLE table=default.Table_34389f8a6c6a46a58a7b548dc552be87 [id=2514fea92119430590a34939e95d57cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.743685 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 789f44a51430454db30e41ad2dd2efb0 with delete_type TABLET_DATA_DELETED (replaced by tablet 8604e0a1655c4d7da4100dd304c0d2cf) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.744364 528 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 0c5cdbcbf5cf429284a91bfd64ce946c
I20260619 19:54:06.744318 886 tablet_service.cc:1511] Processing CreateTablet for tablet 28443b4f7da849b7b8d4c9c9b25d2034 (DEFAULT_TABLE table=default.Table_02cea83081424efcbda7f7700b976e6a [id=51db8693fa5b4553b657dadaf663295b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.744763 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47b97e1eeed4f20bfe001fa48dc0471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.745662 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 116) took 5500 ms. Trace:
I20260619 19:54:06.745744 2026 rpcz_store.cc:276] 0619 19:54:01.244828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.245054 (+ 226us) service_pool.cc:224] Handling call
0619 19:54:06.523913 (+5278859us) ts_tablet_manager.cc:1151] Deleting tablet 467bb41a4e9f46e497726c6b29ddeb04
0619 19:54:06.523923 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.530809 (+ 6886us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.533874 (+ 3065us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.745646 (+211772us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5278642}
I20260619 19:54:06.746040 2026 tablet_replica.cc:333] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:06.746810 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 467bb41a4e9f46e497726c6b29ddeb04 (table default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277]) successfully deleted
I20260619 19:54:06.749415 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_673a1e52cb85474ca009c9f232b8c7d2" } modify_external_catalogs: true
I20260619 19:54:06.749727 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_673a1e52cb85474ca009c9f232b8c7d2" } modify_external_catalogs: true
I20260619 19:54:06.753039 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 46dcf2293e2d461ca1be171069867d1f (table default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]) successfully deleted
W20260619 19:54:06.754093 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ef509392f1b3472db598c8b414258932 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef509392f1b3472db598c8b414258932 already in progress: creating tablet
I20260619 19:54:06.754344 1994 tablet_replica.cc:333] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:06.754560 1994 raft_consensus.cc:2243] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.754846 1994 raft_consensus.cc:2272] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.755859 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 789f44a51430454db30e41ad2dd2efb0 with delete_type TABLET_DATA_DELETED (replaced by tablet 8604e0a1655c4d7da4100dd304c0d2cf) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.758342 1994 ts_tablet_manager.cc:1916] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:06.766271 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 93011.5us
I20260619 19:54:06.767975 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc3c20493fd4882a4511b26b3e79b9d (DEFAULT_TABLE table=default.Table_eaf224b2c52848e8a662b28c139cfa86 [id=0725451550f146489c7a323c0def7e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.768446 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc3c20493fd4882a4511b26b3e79b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.772985 1029 tablet_service.cc:1511] Processing CreateTablet for tablet dc912ab07b074d3d836fe53a0de54444 (DEFAULT_TABLE table=default.Table_899273cda1db49d083179e31919b0526 [id=1a71851ba19c44d99eaf561966078b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.773483 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc912ab07b074d3d836fe53a0de54444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.775065 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbfe0e049fd4b978d92145624e99a5a (DEFAULT_TABLE table=default.Table_4ee47551aa224e8eb4ecb0fa3d80243b [id=6d0f6ba5ba1f4e9a821e2d673584a1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.775578 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 736aa49b4d984295a9aefb135b005e07 (DEFAULT_TABLE table=default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.776044 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736aa49b4d984295a9aefb135b005e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.776592 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbfe0e049fd4b978d92145624e99a5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:06.777163 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e65ca84182d40c280ec2b0555c0de86 consensus state has no leader
I20260619 19:54:06.777659 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3c31ae73d7444499bbe2383080d28418" } new_table_name: "default.Table_a2e31faf36224311b5da1fad2378c2b3" modify_external_catalogs: true
I20260619 19:54:06.783759 1025 tablet_service.cc:1511] Processing CreateTablet for tablet aab35d0e315149c5a496fe41a7e68072 (DEFAULT_TABLE table=default.Table_02266d7ef8ad403885398af0c9f825a7 [id=6aac08324a59446d9365fbfff1d426b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.784226 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab35d0e315149c5a496fe41a7e68072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.790338 2272 raft_consensus.cc:515] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.791687 890 tablet_service.cc:1511] Processing CreateTablet for tablet dc912ab07b074d3d836fe53a0de54444 (DEFAULT_TABLE table=default.Table_899273cda1db49d083179e31919b0526 [id=1a71851ba19c44d99eaf561966078b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.792011 885 tablet_service.cc:1511] Processing CreateTablet for tablet 736aa49b4d984295a9aefb135b005e07 (DEFAULT_TABLE table=default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.792665 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ef509392f1b3472db598c8b414258932 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.793641 747 tablet_service.cc:1511] Processing CreateTablet for tablet 28443b4f7da849b7b8d4c9c9b25d2034 (DEFAULT_TABLE table=default.Table_02cea83081424efcbda7f7700b976e6a [id=51db8693fa5b4553b657dadaf663295b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.794123 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28443b4f7da849b7b8d4c9c9b25d2034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.797288 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c05500f1904adf966de2ea644a21d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.797571 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc3a57f082e487fac8f1208193f74de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.799474 903 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc3c20493fd4882a4511b26b3e79b9d (DEFAULT_TABLE table=default.Table_eaf224b2c52848e8a662b28c139cfa86 [id=0725451550f146489c7a323c0def7e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.801245 2272 leader_election.cc:290] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.803691 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_40536a5e373e47c9b8768101493707a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.804831 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40536a5e373e47c9b8768101493707a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.807546 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3f1e6d16452b4e568745f884cd13ebac
I20260619 19:54:06.808708 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a3301c06d179435588fe6dbab182fe11" } new_table_name: "default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac" modify_external_catalogs: true
I20260619 19:54:06.810360 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_aa52395b83cb4c0e925e6cb80fe138fc" } new_table_name: "default.Table_3133ee2af7ed466f8ffd2be8d7f45f98" modify_external_catalogs: true
I20260619 19:54:06.812441 1200 tablet_bootstrap.cc:492] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:06.812608 1200 ts_tablet_manager.cc:1403] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.290s user 0.012s sys 0.007s
I20260619 19:54:06.814777 1200 raft_consensus.cc:359] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.821157 1200 raft_consensus.cc:385] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.821251 1200 raft_consensus.cc:740] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.821499 1200 consensus_queue.cc:260] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.825305 1200 ts_tablet_manager.cc:1434] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
I20260619 19:54:06.825618 1200 tablet_bootstrap.cc:492] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:06.825507 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0b95ccb115dc4f94b0db2f904eda5e2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.826120 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b95ccb115dc4f94b0db2f904eda5e2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.832276 1973 ts_tablet_manager.cc:1929] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:06.832824 1037 tablet_service.cc:1511] Processing CreateTablet for tablet f49aed0b6f9647588f2e3923839b7b92 (DEFAULT_TABLE table=default.Table_7fecc933f5c14c979a3a376db9937ae0 [id=f20edf3ca1154d06b8fccf1f1eda1e40]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:06.833379 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1557244d1ed4490185d85c2f7c028eb1 has no consensus state
I20260619 19:54:06.833523 1973 log.cc:1199] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/30e606b958d940c6a353a09a2eb627ee
I20260619 19:54:06.833894 1973 ts_tablet_manager.cc:1950] T 30e606b958d940c6a353a09a2eb627ee P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:06.834278 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1e6d16452b4e568745f884cd13ebac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:06.834664 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 180) took 4363 ms. Trace:
I20260619 19:54:06.834744 1973 rpcz_store.cc:276] 0619 19:54:02.471595 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.471640 (+ 45us) service_pool.cc:224] Handling call
0619 19:54:06.660419 (+4188779us) ts_tablet_manager.cc:1151] Deleting tablet 30e606b958d940c6a353a09a2eb627ee
0619 19:54:06.660429 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.740291 (+ 79862us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.832198 (+ 91907us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.834644 (+ 2446us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4149048}
I20260619 19:54:06.835081 1973 tablet_replica.cc:333] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:06.835280 1973 raft_consensus.cc:2243] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:06.835608 1973 raft_consensus.cc:2272] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.836452 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 85564712c0584e3f9c9a399a36709e5a (DEFAULT_TABLE table=default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.836894 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85564712c0584e3f9c9a399a36709e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.839852 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_99391b7e2a8246d8a5c13ab7e94001e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.840473 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99391b7e2a8246d8a5c13ab7e94001e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.842903 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1e6d16452b4e568745f884cd13ebac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:06.844255 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e8aecb4ea70048aea4fe2ec891d5e724" } modify_external_catalogs: true
I20260619 19:54:06.844525 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e8aecb4ea70048aea4fe2ec891d5e724" } modify_external_catalogs: true
I20260619 19:54:06.845463 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49aed0b6f9647588f2e3923839b7b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.845263 1208 tablet_bootstrap.cc:492] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:06.851645 1200 tablet_bootstrap.cc:654] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.851881 1208 ts_tablet_manager.cc:1403] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.269s user 0.007s sys 0.015s
I20260619 19:54:06.852733 1208 raft_consensus.cc:359] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.853001 1208 raft_consensus.cc:385] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.853097 1208 raft_consensus.cc:740] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.853329 1208 consensus_queue.cc:260] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.854040 1208 ts_tablet_manager.cc:1434] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:06.854369 1208 tablet_bootstrap.cc:492] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:06.855849 1208 tablet_bootstrap.cc:654] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:06.858753 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28443b4f7da849b7b8d4c9c9b25d2034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.859086 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc912ab07b074d3d836fe53a0de54444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.860069 1973 ts_tablet_manager.cc:1916] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.860389 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc3c20493fd4882a4511b26b3e79b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.861865 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a921ba7a73a1450db17d69d105fb7e54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.862847 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a921ba7a73a1450db17d69d105fb7e54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.866389 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d663e07e37c74d3b97d09e5f020d2586"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:06.867166 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d663e07e37c74d3b97d09e5f020d2586 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:06.868698 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_00c1932320834358a5d2177cce3bd429" } modify_external_catalogs: true
I20260619 19:54:06.868986 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_00c1932320834358a5d2177cce3bd429" } modify_external_catalogs: true
I20260619 19:54:06.872503 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9d1bd98764451990e7e8e1b6fbcb0b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.873021 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.880777 1994 ts_tablet_manager.cc:1929] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:06.880957 1994 log.cc:1199] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:06.888320 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736aa49b4d984295a9aefb135b005e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.888588 894 tablet_service.cc:1511] Processing CreateTablet for tablet aab35d0e315149c5a496fe41a7e68072 (DEFAULT_TABLE table=default.Table_02266d7ef8ad403885398af0c9f825a7 [id=6aac08324a59446d9365fbfff1d426b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.856807 888 tablet_service.cc:1511] Processing CreateTablet for tablet 85564712c0584e3f9c9a399a36709e5a (DEFAULT_TABLE table=default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.893095 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85564712c0584e3f9c9a399a36709e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.893114 1973 ts_tablet_manager.cc:1929] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:06.893265 1973 log.cc:1199] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:06.893656 1973 ts_tablet_manager.cc:1950] T 9a4c335fc5ca4885b5482c6b749f76f9 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:06.893971 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b8468df4a449d088f47b3b150ce54a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:06.895097 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab35d0e315149c5a496fe41a7e68072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.896697 758 tablet_service.cc:1511] Processing CreateTablet for tablet ac55fd703e184730ab053e045b0f4e2c (DEFAULT_TABLE table=default.Table_841448a18d3d49318e834d44004ae04e [id=4033fdba72c749f69ab79c3f6f695af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.897135 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac55fd703e184730ab053e045b0f4e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.896685 761 tablet_service.cc:1511] Processing CreateTablet for tablet c47b97e1eeed4f20bfe001fa48dc0471 (DEFAULT_TABLE table=default.Table_97566a6b6a6041ac9fceff103e3be47b [id=23067799ec0f4b97b8ea5aa4441a1b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.902689 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47b97e1eeed4f20bfe001fa48dc0471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.907485 898 tablet_service.cc:1511] Processing CreateTablet for tablet f49aed0b6f9647588f2e3923839b7b92 (DEFAULT_TABLE table=default.Table_7fecc933f5c14c979a3a376db9937ae0 [id=f20edf3ca1154d06b8fccf1f1eda1e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.908782 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e151dc97ad13456ba35708d50c9d7b26 with delete_type TABLET_DATA_DELETED (replaced by tablet b8e3354ae6dd46bd9c5414d4c4a720a1) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.910504 758 tablet_service.cc:1511] Processing CreateTablet for tablet 79e86e744f254b7fbca1adfe43e3ade5 (DEFAULT_TABLE table=default.Table_02cb77fd6301496d895a8deaf26a694c [id=2331de8d5c454457a8a990c8d54d912a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.910629 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49aed0b6f9647588f2e3923839b7b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.911042 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e86e744f254b7fbca1adfe43e3ade5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.912546 1201 tablet_bootstrap.cc:492] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:06.912735 1201 ts_tablet_manager.cc:1403] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.388s user 0.003s sys 0.004s
I20260619 19:54:06.913825 1201 raft_consensus.cc:359] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.914049 1201 raft_consensus.cc:385] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:06.914113 1201 raft_consensus.cc:740] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:06.914693 1201 consensus_queue.cc:260] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.915555 2548 raft_consensus.cc:493] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:06.915710 1201 ts_tablet_manager.cc:1434] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:06.916607 1201 tablet_bootstrap.cc:492] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:06.917951 2531 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.918095 2531 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.918726 2531 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:06.920552 996 leader_election.cc:343] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:06.920884 996 leader_election.cc:343] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:06.921667 996 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:06.925045 749 tablet_service.cc:1511] Processing CreateTablet for tablet e10612b432c64bb4be527cf7b6e86cf8 (DEFAULT_TABLE table=default.Table_cfe3af94594f4627b2472e46a9473733 [id=5442d9bc8ca04eb28427efbf9cd7178d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.925463 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10612b432c64bb4be527cf7b6e86cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.893971 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 183) took 4294 ms. Trace:
I20260619 19:54:06.926832 1973 rpcz_store.cc:276] 0619 19:54:02.599549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.602775 (+ 3226us) service_pool.cc:224] Handling call
0619 19:54:06.835036 (+4232261us) ts_tablet_manager.cc:1151] Deleting tablet 9a4c335fc5ca4885b5482c6b749f76f9
0619 19:54:06.835046 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.863904 (+ 28858us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.893036 (+ 29132us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.893957 (+ 921us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4232014}
I20260619 19:54:06.928409 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 211) took 3703 ms. Trace:
I20260619 19:54:06.929587 1973 rpcz_store.cc:276] 0619 19:54:03.225224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.225280 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:06.928271 (+3702991us) ts_tablet_manager.cc:1151] Deleting tablet 495bafb07abe45da9f62138453dd6636
0619 19:54:06.928282 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.928393 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3702786}
I20260619 19:54:06.930215 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 210) took 3705 ms. Trace:
I20260619 19:54:06.933440 1973 rpcz_store.cc:276] 0619 19:54:03.225119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.226221 (+ 1102us) service_pool.cc:224] Handling call
0619 19:54:06.930105 (+3703884us) ts_tablet_manager.cc:1151] Deleting tablet 710fae36dd674b1786aa75013284684e
0619 19:54:06.930114 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.930201 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3703738}
I20260619 19:54:06.934173 1973 tablet_replica.cc:333] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:06.934772 1973 raft_consensus.cc:2243] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.935385 1973 raft_consensus.cc:2272] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.936399 1973 ts_tablet_manager.cc:1916] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:06.940689 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.941147 751 tablet_service.cc:1511] Processing CreateTablet for tablet ca02c454eec840eb9289950b6da7b131 (DEFAULT_TABLE table=default.Table_8e1f6da4a6cf4417813e688ab868bfe5 [id=5d2c41238c64437a970164bc23f8368e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.944804 754 tablet_service.cc:1511] Processing CreateTablet for tablet f49aed0b6f9647588f2e3923839b7b92 (DEFAULT_TABLE table=default.Table_7fecc933f5c14c979a3a376db9937ae0 [id=f20edf3ca1154d06b8fccf1f1eda1e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.945019 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca02c454eec840eb9289950b6da7b131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.945169 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1e6d16452b4e568745f884cd13ebac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.945590 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f49aed0b6f9647588f2e3923839b7b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.941604 746 tablet_service.cc:1511] Processing CreateTablet for tablet ed116f9d309a45dfa9fb175247502448 (DEFAULT_TABLE table=default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1 [id=cc69d0b369f646b3a916fa505778d75b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.947518 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed116f9d309a45dfa9fb175247502448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.942278 757 tablet_service.cc:1511] Processing CreateTablet for tablet b289d3068d184d47b671617213aa512a (DEFAULT_TABLE table=default.Table_a427aad23ffe4518bea23a19e106d9da [id=e1a0a9ba629c46c3a3a54db594738d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.942778 752 tablet_service.cc:1511] Processing CreateTablet for tablet cf2b360e04054330b4d943aa98f00f35 (DEFAULT_TABLE table=default.Table_8e946647b6d04169af7519314919e899 [id=ee36d5ee156742fa82f9d878266bdefc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.943240 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e10612b432c64bb4be527cf7b6e86cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.943399 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 789f44a51430454db30e41ad2dd2efb0 with delete_type TABLET_DATA_DELETED (replaced by tablet 8604e0a1655c4d7da4100dd304c0d2cf) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:06.954003 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b360e04054330b4d943aa98f00f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.943481 748 tablet_service.cc:1511] Processing CreateTablet for tablet 736aa49b4d984295a9aefb135b005e07 (DEFAULT_TABLE table=default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.943661 759 tablet_service.cc:1511] Processing CreateTablet for tablet dc912ab07b074d3d836fe53a0de54444 (DEFAULT_TABLE table=default.Table_899273cda1db49d083179e31919b0526 [id=1a71851ba19c44d99eaf561966078b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.955482 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc912ab07b074d3d836fe53a0de54444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.956485 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736aa49b4d984295a9aefb135b005e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.959324 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b289d3068d184d47b671617213aa512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.963526 1973 ts_tablet_manager.cc:1929] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:06.915798 2548 raft_consensus.cc:515] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.943769 763 tablet_service.cc:1511] Processing CreateTablet for tablet aab35d0e315149c5a496fe41a7e68072 (DEFAULT_TABLE table=default.Table_02266d7ef8ad403885398af0c9f825a7 [id=6aac08324a59446d9365fbfff1d426b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.977298 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab35d0e315149c5a496fe41a7e68072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.943718 761 tablet_service.cc:1511] Processing CreateTablet for tablet 24c05500f1904adf966de2ea644a21d0 (DEFAULT_TABLE table=default.Table_bf2b7abe28794d908335b963f81ec478 [id=0008dbc3884e456f9eac6ca39904fe7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.944020 762 tablet_service.cc:1511] Processing CreateTablet for tablet 85564712c0584e3f9c9a399a36709e5a (DEFAULT_TABLE table=default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.980094 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85564712c0584e3f9c9a399a36709e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.943922 755 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc3c20493fd4882a4511b26b3e79b9d (DEFAULT_TABLE table=default.Table_eaf224b2c52848e8a662b28c139cfa86 [id=0725451550f146489c7a323c0def7e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:06.980741 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc3c20493fd4882a4511b26b3e79b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.970582 2324 raft_consensus.cc:493] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:06.983210 2324 raft_consensus.cc:515] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:06.983824 2324 leader_election.cc:290] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:06.984447 1201 tablet_bootstrap.cc:654] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:06.987407 720 leader_election.cc:343] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1202fe45d0964d368989f969e95f880d
I20260619 19:54:06.987880 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c05500f1904adf966de2ea644a21d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:06.990291 1973 log.cc:1199] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/e4132f28c434492cbddc8da7d8075c43
I20260619 19:54:06.990763 1973 ts_tablet_manager.cc:1950] T e4132f28c434492cbddc8da7d8075c43 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:06.991178 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 209) took 3766 ms. Trace:
I20260619 19:54:06.991304 1973 rpcz_store.cc:276] 0619 19:54:03.225024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.241132 (+ 16108us) service_pool.cc:224] Handling call
0619 19:54:06.934122 (+3692990us) ts_tablet_manager.cc:1151] Deleting tablet e4132f28c434492cbddc8da7d8075c43
0619 19:54:06.934133 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:06.953597 (+ 19464us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.963479 (+ 9882us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:06.991120 (+ 27641us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3690083}
I20260619 19:54:06.991739 1973 tablet_replica.cc:333] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:06.991961 1973 raft_consensus.cc:2243] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:06.992158 1973 raft_consensus.cc:2272] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:06.993579 1973 ts_tablet_manager.cc:1916] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.001085 747 tablet_service.cc:1511] Processing CreateTablet for tablet 17f1a741ad044673899008364a9685e4 (DEFAULT_TABLE table=default.Table_aa52395b83cb4c0e925e6cb80fe138fc [id=fb95d53613c7467aabe213fb4b8c04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.001626 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f1a741ad044673899008364a9685e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.004057 2273 raft_consensus.cc:493] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.004280 2273 raft_consensus.cc:515] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:07.004879 2273 leader_election.cc:290] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:07.005049 2273 raft_consensus.cc:493] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:07.005184 2273 raft_consensus.cc:515] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:07.005736 2273 leader_election.cc:290] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:07.012024 1208 tablet_bootstrap.cc:492] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.012248 1208 ts_tablet_manager.cc:1403] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.158s user 0.020s sys 0.000s
W20260619 19:54:07.012488 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84dbba24094d4630be45b7febe8cb29e consensus state has no leader
I20260619 19:54:07.012969 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ec7afef29b0741c89176856851dbff59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:07.013007 1208 raft_consensus.cc:359] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.013162 1208 raft_consensus.cc:385] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.013206 1208 raft_consensus.cc:740] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.013428 1208 consensus_queue.cc:260] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.013612 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec7afef29b0741c89176856851dbff59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:07.015829 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17f1a741ad044673899008364a9685e4 consensus state has no leader
W20260619 19:54:07.015882 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 71414.3us
I20260619 19:54:07.015959 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:07.016114 777 raft_consensus.cc:2468] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:07.016160 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9fa831d3fbc74033a57818cdf0c65c72" } modify_external_catalogs: true
I20260619 19:54:07.016311 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9fa831d3fbc74033a57818cdf0c65c72" } modify_external_catalogs: true
I20260619 19:54:07.016670 1208 ts_tablet_manager.cc:1434] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260619 19:54:07.016988 1208 tablet_bootstrap.cc:492] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.017170 2527 consensus_queue.cc:1048] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:07.017765 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_88bb3e27be5d41d19ecce9b1881cdb1b" } new_table_name: "default.Table_ae96d6ef6aca4cafb6a48fc012ae4c06" modify_external_catalogs: true
W20260619 19:54:07.019237 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9b78d8a4d8dd42859be248b698257e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b78d8a4d8dd42859be248b698257e2c already in progress: creating tablet
W20260619 19:54:07.019562 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 56640f773efb4123b93f4ca3799ddde7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56640f773efb4123b93f4ca3799ddde7 already in progress: creating tablet
I20260619 19:54:07.019695 1973 ts_tablet_manager.cc:1929] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:07.019738 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c54b2e4f657245c2aa23d138968b3b0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c54b2e4f657245c2aa23d138968b3b0d already in progress: creating tablet
I20260619 19:54:07.019791 1973 log.cc:1199] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/1202fe45d0964d368989f969e95f880d
W20260619 19:54:07.019953 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fe814880d9984bbd83fa121cb2a34eac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe814880d9984bbd83fa121cb2a34eac already in progress: creating tablet
I20260619 19:54:07.020085 1973 ts_tablet_manager.cc:1950] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:07.020140 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b4f7122fa5f94eeaa3b99cae107d8c9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f7122fa5f94eeaa3b99cae107d8c9a already in progress: creating tablet
I20260619 19:54:07.020443 1208 tablet_bootstrap.cc:654] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.020468 1200 tablet_bootstrap.cc:492] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.020476 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]) successfully deleted
I20260619 19:54:07.020589 1200 ts_tablet_manager.cc:1403] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.195s user 0.001s sys 0.005s
I20260619 19:54:07.021361 1200 raft_consensus.cc:359] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.021517 1200 raft_consensus.cc:385] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.021569 1200 raft_consensus.cc:740] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.021759 1200 consensus_queue.cc:260] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.022321 1200 ts_tablet_manager.cc:1434] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:07.022572 1200 tablet_bootstrap.cc:492] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:07.023764 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]) successfully deleted
W20260619 19:54:07.024205 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 495bafb07abe45da9f62138453dd6636 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495bafb07abe45da9f62138453dd6636 already in progress: creating tablet
I20260619 19:54:07.025843 1200 tablet_bootstrap.cc:654] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.026238 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 208) took 3801 ms. Trace:
I20260619 19:54:07.026392 1973 rpcz_store.cc:276] 0619 19:54:03.224888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.243771 (+ 18883us) service_pool.cc:224] Handling call
0619 19:54:06.991699 (+3747928us) ts_tablet_manager.cc:1151] Deleting tablet 1202fe45d0964d368989f969e95f880d
0619 19:54:06.991707 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.000944 (+ 9237us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.019642 (+ 18698us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.026220 (+ 6578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3747506}
I20260619 19:54:07.026926 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 213) took 3759 ms. Trace:
I20260619 19:54:07.027055 1973 rpcz_store.cc:276] 0619 19:54:03.267173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.267254 (+ 81us) service_pool.cc:224] Handling call
0619 19:54:07.026810 (+3759556us) ts_tablet_manager.cc:1151] Deleting tablet b65f88b43b4e45c481aa7d43ef59fe7a
0619 19:54:07.026820 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.026909 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3759273}
I20260619 19:54:07.011081 918 raft_consensus.cc:2468] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
I20260619 19:54:07.027488 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 214) took 3759 ms. Trace:
I20260619 19:54:07.015523 2026 raft_consensus.cc:2243] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.027552 1973 rpcz_store.cc:276] 0619 19:54:03.268013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.268074 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:07.027403 (+3759329us) ts_tablet_manager.cc:1151] Deleting tablet 2d64ccbb2f2840f4ac51cf8556da4a2c
0619 19:54:07.027411 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.027464 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3759142}
I20260619 19:54:07.027669 2269 raft_consensus.cc:2749] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:07.016014 2548 leader_election.cc:290] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.027853 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 215) took 3759 ms. Trace:
I20260619 19:54:07.027915 1973 rpcz_store.cc:276] 0619 19:54:03.268649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.268712 (+ 63us) service_pool.cc:224] Handling call
0619 19:54:07.027741 (+3759029us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:54:07.027750 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.027836 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3758847}
I20260619 19:54:07.029876 996 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.030207 2367 raft_consensus.cc:2804] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.030303 2367 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.030390 2367 raft_consensus.cc:3060] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.030333 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 216) took 3761 ms. Trace:
I20260619 19:54:07.030455 1973 rpcz_store.cc:276] 0619 19:54:03.269107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.269280 (+ 173us) service_pool.cc:224] Handling call
0619 19:54:07.030240 (+3760960us) ts_tablet_manager.cc:1151] Deleting tablet 12258d3bcc714f34857d7362c49ee787
0619 19:54:07.030250 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.030314 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3760792}
I20260619 19:54:07.030894 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 217) took 3761 ms. Trace:
I20260619 19:54:07.030962 1973 rpcz_store.cc:276] 0619 19:54:03.269562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.269608 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:07.030812 (+3761204us) ts_tablet_manager.cc:1151] Deleting tablet 6ef20e35c612400bbbf1c707a36ced8c
0619 19:54:07.030820 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.030879 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3761066}
I20260619 19:54:07.031859 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 218) took 3761 ms. Trace:
I20260619 19:54:07.031924 1973 rpcz_store.cc:276] 0619 19:54:03.269981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.270028 (+ 47us) service_pool.cc:224] Handling call
0619 19:54:07.031783 (+3761755us) ts_tablet_manager.cc:1151] Deleting tablet 620f3a56e57e49b7b520012857e71187
0619 19:54:07.031792 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.031846 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3761621}
I20260619 19:54:07.033327 2026 raft_consensus.cc:2272] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.033931 2026 ts_tablet_manager.cc:1916] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.034286 2367 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.034950 2367 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:07.035488 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 219) took 3765 ms. Trace:
I20260619 19:54:07.035622 1973 rpcz_store.cc:276] 0619 19:54:03.270412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.270465 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:07.032161 (+3761696us) ts_tablet_manager.cc:1151] Deleting tablet 2a3fa43017fa4c278111c29d0d22f7da
0619 19:54:07.032168 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.035469 (+ 3301us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3761558}
I20260619 19:54:07.036177 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 222) took 3764 ms. Trace:
I20260619 19:54:07.036944 1973 rpcz_store.cc:276] 0619 19:54:03.271808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.271886 (+ 78us) service_pool.cc:224] Handling call
0619 19:54:07.036099 (+3764213us) ts_tablet_manager.cc:1151] Deleting tablet aafe2a956b844c9998c84bbe52070e5d
0619 19:54:07.036106 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.036164 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3764045}
I20260619 19:54:07.036862 1208 tablet_bootstrap.cc:492] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.037317 1208 ts_tablet_manager.cc:1403] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260619 19:54:07.038050 1208 raft_consensus.cc:359] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.038292 1208 raft_consensus.cc:385] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.038399 1208 raft_consensus.cc:740] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.038707 1208 consensus_queue.cc:260] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.040678 528 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet bb547965fc7e4aa29d427b1acc7d6e51 (table default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6]). Expected version 2 got 0
I20260619 19:54:07.041026 1208 ts_tablet_manager.cc:1434] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:07.041159 528 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:07.041375 1208 tablet_bootstrap.cc:492] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.042966 1208 tablet_bootstrap.cc:654] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.044044 1994 ts_tablet_manager.cc:1950] T d651c8fb8ff244a5a09dd9ea593ecb14 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:07.045173 1994 tablet_replica.cc:333] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:07.045425 1994 raft_consensus.cc:2243] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.045795 1994 raft_consensus.cc:2272] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.046777 1994 ts_tablet_manager.cc:1916] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.047538 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d651c8fb8ff244a5a09dd9ea593ecb14 (table default.Table_24d96d4b01f94727832aaf2c7fc13576 [id=b6c966d7d56a46cfb4fa632aad28d7b6]) successfully deleted
I20260619 19:54:07.046170 1973 tablet_replica.cc:333] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:07.047991 1973 raft_consensus.cc:2243] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.048218 1973 raft_consensus.cc:2272] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.048785 1973 ts_tablet_manager.cc:1916] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.057806 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:07.057993 777 raft_consensus.cc:3060] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.060441 777 raft_consensus.cc:2468] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:07.051880 758 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc3a57f082e487fac8f1208193f74de (DEFAULT_TABLE table=default.Table_34389f8a6c6a46a58a7b548dc552be87 [id=2514fea92119430590a34939e95d57cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.061316 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc3a57f082e487fac8f1208193f74de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.067587 996 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.068094 2367 raft_consensus.cc:2804] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:07.068377 2367 raft_consensus.cc:697] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:07.068701 2367 consensus_queue.cc:237] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.068920 1208 tablet_bootstrap.cc:492] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.069083 1208 ts_tablet_manager.cc:1403] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20260619 19:54:07.069964 1208 raft_consensus.cc:359] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.070272 1208 raft_consensus.cc:385] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.070389 1208 raft_consensus.cc:740] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.070745 1208 consensus_queue.cc:260] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.074832 2537 raft_consensus.cc:493] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:07.075060 2537 raft_consensus.cc:515] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:07.075829 2537 leader_election.cc:290] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:07.076040 2516 raft_consensus.cc:493] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.076193 2516 raft_consensus.cc:515] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.076478 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f4f2b36b8c6849648d4c11f124c441d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:07.076695 2516 leader_election.cc:290] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:07.077044 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f2b36b8c6849648d4c11f124c441d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.077128 1973 ts_tablet_manager.cc:1929] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:07.077229 1973 log.cc:1199] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:07.077338 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f33c2c00b414fbebf1965510e1e2b96" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:07.077535 1057 raft_consensus.cc:2468] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:07.077594 1973 ts_tablet_manager.cc:1950] T c83c093717ef4424b56d49e2689a6d0b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.077893 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 212) took 3828 ms. Trace:
I20260619 19:54:07.077982 720 leader_election.cc:304] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.076052 1208 ts_tablet_manager.cc:1434] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260619 19:54:07.078567 1208 tablet_bootstrap.cc:492] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.080389 1208 tablet_bootstrap.cc:654] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.081568 2324 raft_consensus.cc:493] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.081697 2324 raft_consensus.cc:515] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.082322 2324 leader_election.cc:290] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.077981 1973 rpcz_store.cc:276] 0619 19:54:03.249614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.250087 (+ 473us) service_pool.cc:224] Handling call
0619 19:54:07.046124 (+3796037us) ts_tablet_manager.cc:1151] Deleting tablet c83c093717ef4424b56d49e2689a6d0b
0619 19:54:07.046133 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.055895 (+ 9762us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.077071 (+ 21176us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.077875 (+ 804us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3773824}
I20260619 19:54:07.083778 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 221) took 3812 ms. Trace:
W20260619 19:54:07.083823 720 leader_election.cc:343] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fe14a1f35cf14ca480221ee412c087da
I20260619 19:54:07.086687 1973 rpcz_store.cc:276] 0619 19:54:03.271357 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.271718 (+ 361us) service_pool.cc:224] Handling call
0619 19:54:07.083534 (+3811816us) ts_tablet_manager.cc:1151] Deleting tablet 906212dd25ef46f2b381ce6a99c39343
0619 19:54:07.083545 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.083756 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3811111}
I20260619 19:54:07.087335 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 225) took 3813 ms. Trace:
I20260619 19:54:07.087523 1973 rpcz_store.cc:276] 0619 19:54:03.274102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.274155 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:07.087213 (+3813058us) ts_tablet_manager.cc:1151] Deleting tablet d4771739543f4b4189b7d603f76325f0
0619 19:54:07.087227 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.087317 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3812866}
I20260619 19:54:07.088035 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 220) took 3817 ms. Trace:
I20260619 19:54:07.088196 1973 rpcz_store.cc:276] 0619 19:54:03.270863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.272483 (+ 1620us) service_pool.cc:224] Handling call
0619 19:54:07.087943 (+3815460us) ts_tablet_manager.cc:1151] Deleting tablet 5ea9f17d5e75499a8433fc9a3043a88e
0619 19:54:07.087953 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.088016 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3813490}
I20260619 19:54:07.088415 530 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520] alter complete (version 2)
I20260619 19:54:07.088789 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 223) took 3815 ms. Trace:
I20260619 19:54:07.088928 1973 rpcz_store.cc:276] 0619 19:54:03.273126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.273178 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:07.088497 (+3815319us) ts_tablet_manager.cc:1151] Deleting tablet 2d1b7b743e594e2aaeaeedd8613d9789
0619 19:54:07.088506 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.088772 (+ 266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3813997}
I20260619 19:54:07.089429 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 224) took 3815 ms. Trace:
I20260619 19:54:07.091228 531 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet bec76520d6ca496dade4f9e0b2bfd1a0
I20260619 19:54:07.091187 1973 rpcz_store.cc:276] 0619 19:54:03.273600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.273659 (+ 59us) service_pool.cc:224] Handling call
0619 19:54:07.089343 (+3815684us) ts_tablet_manager.cc:1151] Deleting tablet cbec819571854db8a46daae15b9127bd
0619 19:54:07.089352 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.089403 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3814770}
I20260619 19:54:07.091249 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b8468df4a449d088f47b3b150ce54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:07.091534 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 227) took 3815 ms. Trace:
I20260619 19:54:07.091599 1973 rpcz_store.cc:276] 0619 19:54:03.276192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.276240 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:07.091409 (+3815169us) ts_tablet_manager.cc:1151] Deleting tablet ecbe466eee2f43359181a1d26d6e761e
0619 19:54:07.091430 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.091519 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3812849}
I20260619 19:54:07.078243 2516 raft_consensus.cc:2804] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.092087 2516 raft_consensus.cc:493] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.092177 2516 raft_consensus.cc:3060] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:07.092746 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 710fae36dd674b1786aa75013284684e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 710fae36dd674b1786aa75013284684e already in progress: creating tablet
I20260619 19:54:07.094713 2516 raft_consensus.cc:515] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.096117 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f33c2c00b414fbebf1965510e1e2b96" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:07.096295 1057 raft_consensus.cc:3060] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.098760 1057 raft_consensus.cc:2468] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:07.099457 720 leader_election.cc:304] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.099771 2324 raft_consensus.cc:2804] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:07.099891 2324 raft_consensus.cc:697] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:07.100117 2324 consensus_queue.cc:237] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.100344 1200 tablet_bootstrap.cc:492] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.100471 1200 ts_tablet_manager.cc:1403] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.000s
I20260619 19:54:07.093899 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet e4132f28c434492cbddc8da7d8075c43 (table default.Table_93a36817c65c48b5b2e86a7b7a2937be [id=a57b082016f14ff48e4194fcbd7b63c1]) successfully deleted
I20260619 19:54:07.101941 1200 raft_consensus.cc:359] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.102288 1200 raft_consensus.cc:385] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.102344 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]) successfully deleted
I20260619 19:54:07.102427 1200 raft_consensus.cc:740] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.102639 2516 leader_election.cc:290] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:07.103066 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b65f88b43b4e45c481aa7d43ef59fe7a because the tablet was not found. No further retry: Not found: Tablet not found: b65f88b43b4e45c481aa7d43ef59fe7a
I20260619 19:54:07.102821 1200 consensus_queue.cc:260] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.109341 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe14a1f35cf14ca480221ee412c087da" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:07.109558 777 raft_consensus.cc:2468] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:54:07.109226 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3e84f5ef3ef4ff0b557d65fb5eae97a consensus state has no leader
W20260619 19:54:07.110513 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2d64ccbb2f2840f4ac51cf8556da4a2c because the tablet was not found. No further retry: Not found: Tablet not found: 2d64ccbb2f2840f4ac51cf8556da4a2c
W20260619 19:54:07.110899 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d651c8fb8ff244a5a09dd9ea593ecb14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d651c8fb8ff244a5a09dd9ea593ecb14 already in progress: creating tablet
W20260619 19:54:07.111223 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 12258d3bcc714f34857d7362c49ee787 because the tablet was not found. No further retry: Not found: Tablet not found: 12258d3bcc714f34857d7362c49ee787
I20260619 19:54:07.112217 2026 ts_tablet_manager.cc:1929] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:07.112396 2026 log.cc:1199] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9c379d780b294b9a863576f53f79ee7b
I20260619 19:54:07.112624 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 230) took 3834 ms. Trace:
I20260619 19:54:07.112869 2026 ts_tablet_manager.cc:1950] T 9c379d780b294b9a863576f53f79ee7b P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:07.113096 1973 rpcz_store.cc:276] 0619 19:54:03.278423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.278490 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:07.112509 (+3834019us) ts_tablet_manager.cc:1151] Deleting tablet d97025f1e0634720bc68d0a6196bd20b
0619 19:54:07.112522 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.112600 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3833827}
I20260619 19:54:07.113267 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 117) took 5867 ms. Trace:
I20260619 19:54:07.113390 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:07.113341 2026 rpcz_store.cc:276] 0619 19:54:01.245510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.245737 (+ 227us) service_pool.cc:224] Handling call
0619 19:54:06.746000 (+5500263us) ts_tablet_manager.cc:1151] Deleting tablet 9c379d780b294b9a863576f53f79ee7b
0619 19:54:06.746008 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.054990 (+308982us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.112154 (+ 57164us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.113249 (+ 1095us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269274,"tablet-delete.queue_time_us":5500059}
I20260619 19:54:07.113842 2026 tablet_replica.cc:333] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:07.113806 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 228) took 3837 ms. Trace:
I20260619 19:54:07.113900 1973 rpcz_store.cc:276] 0619 19:54:03.276611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.276668 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:07.113726 (+3837058us) ts_tablet_manager.cc:1151] Deleting tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc
0619 19:54:07.113735 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.113791 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3834872}
I20260619 19:54:07.114171 2026 raft_consensus.cc:2243] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.114400 2026 raft_consensus.cc:2272] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.114991 2026 ts_tablet_manager.cc:1916] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.118559 1208 tablet_bootstrap.cc:492] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.118498 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_35a806d3e4164ed4855c53a228466cc6" } modify_external_catalogs: true
I20260619 19:54:07.118710 1208 ts_tablet_manager.cc:1403] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260619 19:54:07.118721 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_35a806d3e4164ed4855c53a228466cc6" } modify_external_catalogs: true
I20260619 19:54:07.122334 1208 raft_consensus.cc:359] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.128412 1208 raft_consensus.cc:385] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.128592 1208 raft_consensus.cc:740] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.129269 1208 consensus_queue.cc:260] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.130885 1208 ts_tablet_manager.cc:1434] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260619 19:54:07.127175 719 leader_election.cc:304] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.131593 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 229) took 3854 ms. Trace:
I20260619 19:54:07.132519 1973 rpcz_store.cc:276] 0619 19:54:03.277104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.277422 (+ 318us) service_pool.cc:224] Handling call
0619 19:54:07.131507 (+3854085us) ts_tablet_manager.cc:1151] Deleting tablet d29506dab4c84850ad79b8b7a0340987
0619 19:54:07.131515 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.131577 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3852571}
I20260619 19:54:07.132652 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2f513b752aa747ad983090c68ec1cdd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:07.132886 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4f97c7f3371b4cd9bf5b12bd61a73e1a" } new_table_name: "default.Table_2a894d78c6f74731859597df24fb1c07" modify_external_catalogs: true
I20260619 19:54:07.133102 2516 raft_consensus.cc:2804] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:07.133306 2516 raft_consensus.cc:697] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:07.133337 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 226) took 3857 ms. Trace:
I20260619 19:54:07.133394 1973 rpcz_store.cc:276] 0619 19:54:03.275509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.275565 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:07.133251 (+3857686us) ts_tablet_manager.cc:1151] Deleting tablet fd9c959792fa48e89b669520f7332b26
0619 19:54:07.133260 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.133321 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3854265}
I20260619 19:54:07.133585 2516 consensus_queue.cc:237] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.132678 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9f78e22f0138463888f10d7f72494936" } modify_external_catalogs: true
I20260619 19:54:07.134630 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9f78e22f0138463888f10d7f72494936" } modify_external_catalogs: true
I20260619 19:54:07.135288 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4ef8ef5a421b4cd3a6760f75d5fdae07" } new_table_name: "default.Table_6331efa968674c528aa9785a2ee9deb9" modify_external_catalogs: true
I20260619 19:54:07.139461 2367 consensus_queue.cc:1048] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:07.140327 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 62500us
I20260619 19:54:07.140841 858 leader_election.cc:304] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:07.141289 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f33c2c00b414fbebf1965510e1e2b96" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.141536 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1202fe45d0964d368989f969e95f880d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.141853 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 231) took 3862 ms. Trace:
I20260619 19:54:07.141865 2548 raft_consensus.cc:2804] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.141948 2548 raft_consensus.cc:493] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.142045 2548 raft_consensus.cc:3060] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.141993 1973 rpcz_store.cc:276] 0619 19:54:03.279837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.279894 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:07.141743 (+3861849us) ts_tablet_manager.cc:1151] Deleting tablet 184d655694434b0bbfa178fcd3110405
0619 19:54:07.141756 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.141832 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3860933}
I20260619 19:54:07.142272 1973 tablet_replica.cc:333] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:07.142470 1973 raft_consensus.cc:2243] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.142633 1973 raft_consensus.cc:2272] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.131601 1208 tablet_bootstrap.cc:492] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.143381 2542 raft_consensus.cc:493] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.143500 2542 raft_consensus.cc:515] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.143721 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_99b386e9a89b483e91c5ad3fe8f59148"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:07.144043 2542 leader_election.cc:290] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.145038 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe14a1f35cf14ca480221ee412c087da" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.145689 1201 tablet_bootstrap.cc:492] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.146111 1201 ts_tablet_manager.cc:1403] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.230s user 0.001s sys 0.004s
I20260619 19:54:07.146622 1200 ts_tablet_manager.cc:1434] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.046s user 0.003s sys 0.000s
I20260619 19:54:07.146966 1200 tablet_bootstrap.cc:492] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:07.148192 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f33c2c00b414fbebf1965510e1e2b96" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:07.148625 1200 tablet_bootstrap.cc:654] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:07.149822 858 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: a868706c23e948e5ba3320ceb4a19cf8
W20260619 19:54:07.150138 858 leader_election.cc:343] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 37393d7c16594032bf2a69abb0ab5931
W20260619 19:54:07.150422 858 consensus_peers.cc:597] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30e606b958d940c6a353a09a2eb627ee. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:07.150664 858 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:07.151180 2548 raft_consensus.cc:515] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.151496 919 raft_consensus.cc:2393] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:07.151796 2548 leader_election.cc:290] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.153790 1994 ts_tablet_manager.cc:1929] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:07.154250 1994 log.cc:1199] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/4b22024a0c434f8e8d4a370dbfb9a4e2
I20260619 19:54:07.155031 1994 ts_tablet_manager.cc:1950] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:07.155629 1208 tablet_bootstrap.cc:654] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.159819 2324 raft_consensus.cc:493] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.163228 2324 raft_consensus.cc:515] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.164676 2324 leader_election.cc:290] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.169791 1973 ts_tablet_manager.cc:1916] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.170650 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe14a1f35cf14ca480221ee412c087da" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:07.171629 781 raft_consensus.cc:3060] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.172165 1201 raft_consensus.cc:359] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.172309 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:07.172326 1201 raft_consensus.cc:385] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.172375 1201 raft_consensus.cc:740] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.172550 1201 consensus_queue.cc:260] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.173035 1201 ts_tablet_manager.cc:1434] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260619 19:54:07.173306 1201 tablet_bootstrap.cc:492] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:07.174453 781 raft_consensus.cc:2468] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:07.176054 2539 raft_consensus.cc:493] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:07.176172 2539 raft_consensus.cc:515] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.176710 2539 leader_election.cc:290] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:07.171419 719 leader_election.cc:343] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:07.178319 719 leader_election.cc:343] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.178426 719 leader_election.cc:304] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:07.178580 719 raft_consensus.cc:2686] T 1202fe45d0964d368989f969e95f880d P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:54:07.179234 719 leader_election.cc:343] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.179508 719 leader_election.cc:304] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.180267 2324 raft_consensus.cc:2749] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.182390 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.183343 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9d1bd98764451990e7e8e1b6fbcb0b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.184084 2567 tablet.cc:1724] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:07.185755 1208 tablet_bootstrap.cc:492] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.185889 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b8468df4a449d088f47b3b150ce54a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.187245 1208 ts_tablet_manager.cc:1403] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.002s
I20260619 19:54:07.187987 1208 raft_consensus.cc:359] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.189695 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f513b752aa747ad983090c68ec1cdd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.191095 1208 raft_consensus.cc:385] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:54:07.191217 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99b386e9a89b483e91c5ad3fe8f59148 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.191319 1208 raft_consensus.cc:740] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.191475 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.186645 2516 raft_consensus.cc:493] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.191792 2516 raft_consensus.cc:515] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.111500 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6ef20e35c612400bbbf1c707a36ced8c because the tablet was not found. No further retry: Not found: Tablet not found: 6ef20e35c612400bbbf1c707a36ced8c
W20260619 19:54:07.193163 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 81681.9us
W20260619 19:54:07.193509 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 620f3a56e57e49b7b520012857e71187 because the tablet was not found. No further retry: Not found: Tablet not found: 620f3a56e57e49b7b520012857e71187
W20260619 19:54:07.193804 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2a3fa43017fa4c278111c29d0d22f7da because the tablet was not found. No further retry: Not found: Tablet not found: 2a3fa43017fa4c278111c29d0d22f7da
W20260619 19:54:07.194075 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet aafe2a956b844c9998c84bbe52070e5d because the tablet was not found. No further retry: Not found: Tablet not found: aafe2a956b844c9998c84bbe52070e5d
I20260619 19:54:07.197142 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet c83c093717ef4424b56d49e2689a6d0b (table default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]) successfully deleted
W20260619 19:54:07.197502 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 906212dd25ef46f2b381ce6a99c39343 because the tablet was not found. No further retry: Not found: Tablet not found: 906212dd25ef46f2b381ce6a99c39343
W20260619 19:54:07.197921 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d4771739543f4b4189b7d603f76325f0 because the tablet was not found. No further retry: Not found: Tablet not found: d4771739543f4b4189b7d603f76325f0
W20260619 19:54:07.198163 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5ea9f17d5e75499a8433fc9a3043a88e because the tablet was not found. No further retry: Not found: Tablet not found: 5ea9f17d5e75499a8433fc9a3043a88e
W20260619 19:54:07.198405 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2d1b7b743e594e2aaeaeedd8613d9789 because the tablet was not found. No further retry: Not found: Tablet not found: 2d1b7b743e594e2aaeaeedd8613d9789
W20260619 19:54:07.198799 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet cbec819571854db8a46daae15b9127bd because the tablet was not found. No further retry: Not found: Tablet not found: cbec819571854db8a46daae15b9127bd
W20260619 19:54:07.199079 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ecbe466eee2f43359181a1d26d6e761e because the tablet was not found. No further retry: Not found: Tablet not found: ecbe466eee2f43359181a1d26d6e761e
W20260619 19:54:07.199401 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d97025f1e0634720bc68d0a6196bd20b because the tablet was not found. No further retry: Not found: Tablet not found: d97025f1e0634720bc68d0a6196bd20b
I20260619 19:54:07.199437 1200 tablet_bootstrap.cc:492] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.199590 1200 ts_tablet_manager.cc:1403] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
W20260619 19:54:07.199716 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc because the tablet was not found. No further retry: Not found: Tablet not found: 7fb8df8d8ac047bfa6ab7a6b533e38fc
W20260619 19:54:07.200119 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fd9c959792fa48e89b669520f7332b26 because the tablet was not found. No further retry: Not found: Tablet not found: fd9c959792fa48e89b669520f7332b26
W20260619 19:54:07.200414 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 184d655694434b0bbfa178fcd3110405 because the tablet was not found. No further retry: Not found: Tablet not found: 184d655694434b0bbfa178fcd3110405
I20260619 19:54:07.201404 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9c379d780b294b9a863576f53f79ee7b (table default.Table_9c718229c76b4c2794a9bd5d5a26fc86 [id=e546025d2806485aa4b7d9ec209ab2d6]) successfully deleted
W20260619 19:54:07.202348 859 consensus_peers.cc:597] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8522f562665540ce99490ab90e02d801. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:07.202661 859 leader_election.cc:304] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.203047 2538 raft_consensus.cc:2749] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.203636 2516 leader_election.cc:290] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.203723 2565 tablet.cc:1724] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:07.204111 859 leader_election.cc:343] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fe14a1f35cf14ca480221ee412c087da
I20260619 19:54:07.205515 1208 consensus_queue.cc:260] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.205885 720 leader_election.cc:343] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 0b55debc1b064192a56d2453364ba260
I20260619 19:54:07.207850 1208 ts_tablet_manager.cc:1434] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260619 19:54:07.208519 1201 tablet_bootstrap.cc:654] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.208910 1208 tablet_bootstrap.cc:492] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.210831 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:07.211825 919 raft_consensus.cc:3060] T 29e73d38af8241b29b8d47a5f9db1834 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.215458 2570 tablet.cc:1724] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:07.220387 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (table default.Table_d911a0e8835847cb9ccf9d5d192872fe [id=57b57ad63a674bf08da4cf6d7bcd1b4e]) successfully deleted
W20260619 19:54:07.220719 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e10612b432c64bb4be527cf7b6e86cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e10612b432c64bb4be527cf7b6e86cf8 already in progress: creating tablet
I20260619 19:54:07.205245 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9d1bd98764451990e7e8e1b6fbcb0b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:07.223716 1059 raft_consensus.cc:2468] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:07.223912 1208 tablet_bootstrap.cc:654] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.224265 720 leader_election.cc:304] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.224488 2516 raft_consensus.cc:2804] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.224567 2516 raft_consensus.cc:493] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.224642 2516 raft_consensus.cc:3060] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.225296 1200 raft_consensus.cc:359] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.225507 1200 raft_consensus.cc:385] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.225630 1200 raft_consensus.cc:740] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.225957 1200 consensus_queue.cc:260] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.226420 1201 tablet_bootstrap.cc:492] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.226565 1201 ts_tablet_manager.cc:1403] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260619 19:54:07.226962 1200 ts_tablet_manager.cc:1434] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:07.227177 2516 raft_consensus.cc:515] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.227380 858 leader_election.cc:343] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:54:07.227430 1201 raft_consensus.cc:359] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.227596 1201 raft_consensus.cc:385] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.227658 1201 raft_consensus.cc:740] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.227830 1201 consensus_queue.cc:260] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.228188 858 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:07.228458 1201 ts_tablet_manager.cc:1434] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:07.228499 2516 leader_election.cc:290] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.228727 1201 tablet_bootstrap.cc:492] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:07.228956 858 leader_election.cc:304] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:07.229007 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b55debc1b064192a56d2453364ba260" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.229259 2563 raft_consensus.cc:2804] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:07.229403 2563 raft_consensus.cc:697] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:07.229683 2563 consensus_queue.cc:237] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.230911 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9d1bd98764451990e7e8e1b6fbcb0b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:07.231069 1059 raft_consensus.cc:3060] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:07.218050 996 leader_election.cc:343] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.231871 996 leader_election.cc:304] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:07.232100 2367 raft_consensus.cc:2749] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:07.232815 996 leader_election.cc:343] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.232911 996 leader_election.cc:304] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:07.233558 2533 consensus_queue.cc:1048] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:07.233892 2509 raft_consensus.cc:493] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:07.234117 2509 raft_consensus.cc:515] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.234298 1059 raft_consensus.cc:2468] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:07.235096 2509 leader_election.cc:290] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.239249 720 leader_election.cc:304] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.239583 2324 raft_consensus.cc:493] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.239733 1201 tablet_bootstrap.cc:654] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.239696 2324 raft_consensus.cc:515] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.240240 2324 leader_election.cc:290] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.239552 2516 raft_consensus.cc:2804] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:54:07.241086 720 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:07.241221 2516 raft_consensus.cc:697] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:07.241467 2516 consensus_queue.cc:237] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.241677 1994 tablet_replica.cc:333] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:07.241639 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 789f44a51430454db30e41ad2dd2efb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 789f44a51430454db30e41ad2dd2efb0 already in progress: creating tablet
I20260619 19:54:07.241853 1994 raft_consensus.cc:2243] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:07.241963 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 3f1e6d16452b4e568745f884cd13ebac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f1e6d16452b4e568745f884cd13ebac already in progress: creating tablet
I20260619 19:54:07.242009 1994 raft_consensus.cc:2272] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.242540 1994 ts_tablet_manager.cc:1916] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.243621 2367 raft_consensus.cc:2749] T ed9d1bd98764451990e7e8e1b6fbcb0b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.249254 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c59b58766d634684a17e2a7591efb8f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:07.250020 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c59b58766d634684a17e2a7591efb8f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.252317 779 raft_consensus.cc:3060] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.255245 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:07.255223 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9d1bd98764451990e7e8e1b6fbcb0b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.256780 1201 tablet_bootstrap.cc:492] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.257020 1201 ts_tablet_manager.cc:1403] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260619 19:54:07.257843 1201 raft_consensus.cc:359] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.258176 1201 raft_consensus.cc:385] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.258266 1201 raft_consensus.cc:740] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.258530 1201 consensus_queue.cc:260] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.259181 1201 ts_tablet_manager.cc:1434] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:07.260082 1200 tablet_bootstrap.cc:492] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:07.262091 1200 tablet_bootstrap.cc:654] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.262382 1201 tablet_bootstrap.cc:492] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:07.263319 996 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.263517 996 leader_election.cc:304] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:07.263732 996 raft_consensus.cc:2686] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:54:07.264524 996 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.264647 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d651c8fb8ff244a5a09dd9ea593ecb14" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.264863 919 raft_consensus.cc:2468] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:07.265298 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9d1bd98764451990e7e8e1b6fbcb0b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:07.265604 996 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.266320 2533 consensus_queue.cc:1048] T 29e73d38af8241b29b8d47a5f9db1834 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:07.268784 858 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:07.271284 1208 tablet_bootstrap.cc:492] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.272403 1201 tablet_bootstrap.cc:654] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.271910 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4c335fc5ca4885b5482c6b749f76f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 32648df603ac442396922383ffbd2e31) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:07.274359 1208 ts_tablet_manager.cc:1403] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.001s
I20260619 19:54:07.275084 1208 raft_consensus.cc:359] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.275274 1208 raft_consensus.cc:385] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.275326 1208 raft_consensus.cc:740] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.275513 1208 consensus_queue.cc:260] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.275879 1208 ts_tablet_manager.cc:1434] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260619 19:54:07.286424 1201 tablet_bootstrap.cc:492] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.286674 1201 ts_tablet_manager.cc:1403] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260619 19:54:07.292253 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 28e463032d0744cc88d011accbebfe1f
I20260619 19:54:07.294525 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e463032d0744cc88d011accbebfe1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:07.300348 1973 ts_tablet_manager.cc:1929] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:07.300652 1973 log.cc:1199] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/0f32e1c7a27941ca9377901b19b32af3
I20260619 19:54:07.301357 1973 ts_tablet_manager.cc:1950] T 0f32e1c7a27941ca9377901b19b32af3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.302367 1208 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.304107 1208 tablet_bootstrap.cc:654] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.307909 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]). Expected version 2 got 0
I20260619 19:54:07.311226 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 1202fe45d0964d368989f969e95f880d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:07.311913 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 9f6ec149e1ac475f8038b328dae4af2a from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:07.312255 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 997cd0b5a8d24b56a2d5b95ab877d95f with delete_type TABLET_DATA_DELETED (replaced by tablet e6dcf87d57044279a218cbb21c383352) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:07.312913 719 leader_election.cc:304] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.313205 2516 raft_consensus.cc:2749] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:07.314236 719 leader_election.cc:343] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.314560 719 leader_election.cc:304] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.314844 2516 raft_consensus.cc:2804] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.314919 2516 raft_consensus.cc:493] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.314977 2516 raft_consensus.cc:3060] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.319453 2516 raft_consensus.cc:515] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.320895 720 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:07.321115 2516 leader_election.cc:290] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.322165 1201 raft_consensus.cc:359] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.322340 1201 raft_consensus.cc:385] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.322384 1201 raft_consensus.cc:740] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.322559 1201 consensus_queue.cc:260] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.323036 1201 ts_tablet_manager.cc:1434] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260619 19:54:07.323375 1201 tablet_bootstrap.cc:492] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:07.324429 1208 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.324548 1208 ts_tablet_manager.cc:1403] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.000s
I20260619 19:54:07.325059 1201 tablet_bootstrap.cc:654] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.325287 1208 raft_consensus.cc:359] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.325453 1208 raft_consensus.cc:385] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.325507 1208 raft_consensus.cc:740] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.325677 1208 consensus_queue.cc:260] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.326306 1208 ts_tablet_manager.cc:1434] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:07.326582 1208 tablet_bootstrap.cc:492] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.317718 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 8bc11c632b514118856ea4c11b431142 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:07.328212 1208 tablet_bootstrap.cc:654] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.328332 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e463032d0744cc88d011accbebfe1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:07.329434 2533 raft_consensus.cc:493] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.329574 2533 raft_consensus.cc:515] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.330183 2533 leader_election.cc:290] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:07.330859 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6ec149e1ac475f8038b328dae4af2a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:07.331436 996 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.332796 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6ec149e1ac475f8038b328dae4af2a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.340199 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983faf8557814093bc427291711f3fce" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:07.342432 996 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.342646 996 leader_election.cc:304] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:07.342923 2533 raft_consensus.cc:2749] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:07.345620 859 leader_election.cc:343] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: a868706c23e948e5ba3320ceb4a19cf8
W20260619 19:54:07.347841 719 leader_election.cc:343] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.353036 1200 tablet_bootstrap.cc:492] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.353353 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 232) took 4072 ms. Trace:
I20260619 19:54:07.353295 1200 ts_tablet_manager.cc:1403] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.000s
I20260619 19:54:07.353443 1973 rpcz_store.cc:276] 0619 19:54:03.280682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.280738 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:07.142223 (+3861485us) ts_tablet_manager.cc:1151] Deleting tablet 0f32e1c7a27941ca9377901b19b32af3
0619 19:54:07.142231 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.250256 (+108025us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.300287 (+ 50031us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.353330 (+ 53043us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3861301}
I20260619 19:54:07.354518 1200 raft_consensus.cc:359] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:07.354667 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc313f3185814ffea50ceb2a804ed158 consensus state has no leader
I20260619 19:54:07.355089 1200 raft_consensus.cc:385] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.355427 1200 raft_consensus.cc:740] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.355825 1200 consensus_queue.cc:260] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.356889 1200 ts_tablet_manager.cc:1434] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:07.356940 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c74d4bc43ada4b1aa48e77789c8e04b2" } new_table_name: "default.Table_869856a5e6e142f9ae4c72eacebc1090" modify_external_catalogs: true
I20260619 19:54:07.357443 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d651c8fb8ff244a5a09dd9ea593ecb14" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:07.357595 1200 tablet_bootstrap.cc:492] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:07.357612 920 raft_consensus.cc:3060] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.358966 1200 tablet_bootstrap.cc:654] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.360473 920 raft_consensus.cc:2468] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:07.344769 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cb87313898af41e9bb3b7ecbd9e58203"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:07.362206 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb87313898af41e9bb3b7ecbd9e58203 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.345799 859 leader_election.cc:304] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.365957 2563 raft_consensus.cc:2749] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:07.366842 859 leader_election.cc:343] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 37393d7c16594032bf2a69abb0ab5931
I20260619 19:54:07.367462 2587 tablet.cc:1724] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:07.369693 859 leader_election.cc:304] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.370427 2563 raft_consensus.cc:2749] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:07.370934 859 consensus_peers.cc:597] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91e43148bb5b47128e08ed7faf8c7c1f. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:07.353823 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 234) took 4067 ms. Trace:
I20260619 19:54:07.373783 1973 rpcz_store.cc:276] 0619 19:54:03.286147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.286498 (+ 351us) service_pool.cc:224] Handling call
0619 19:54:07.353721 (+4067223us) ts_tablet_manager.cc:1151] Deleting tablet 45c0ffb4629a46349ccfe473cc20cdfc
0619 19:54:07.353731 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.353810 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4067014}
I20260619 19:54:07.374588 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 235) took 4088 ms. Trace:
I20260619 19:54:07.374761 1973 rpcz_store.cc:276] 0619 19:54:03.286241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.286602 (+ 361us) service_pool.cc:224] Handling call
0619 19:54:07.374443 (+4087841us) ts_tablet_manager.cc:1151] Deleting tablet 1bc12bcf50074b46860899a82dc0b46e
0619 19:54:07.374460 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.374569 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4087681}
I20260619 19:54:07.375577 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 237) took 4089 ms. Trace:
I20260619 19:54:07.375764 1973 rpcz_store.cc:276] 0619 19:54:03.286447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.286744 (+ 297us) service_pool.cc:224] Handling call
0619 19:54:07.375439 (+4088695us) ts_tablet_manager.cc:1151] Deleting tablet 1a686826694b49b9bb5bcdefd61c9a15
0619 19:54:07.375480 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.375564 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4088558}
I20260619 19:54:07.376339 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 236) took 4090 ms. Trace:
I20260619 19:54:07.376518 1973 rpcz_store.cc:276] 0619 19:54:03.286336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.286790 (+ 454us) service_pool.cc:224] Handling call
0619 19:54:07.376211 (+4089421us) ts_tablet_manager.cc:1151] Deleting tablet 4e2f73871161488dbad7a19fc9e20b9c
0619 19:54:07.376219 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.376326 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4089296}
I20260619 19:54:07.377002 1973 tablet_replica.cc:333] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:07.377314 1973 raft_consensus.cc:2243] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:07.377877 1973 raft_consensus.cc:2272] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:07.378125 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5482cf46c91d426484938c387b785d61 consensus state has no leader
I20260619 19:54:07.396806 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e463032d0744cc88d011accbebfe1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:07.398437 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 0f32e1c7a27941ca9377901b19b32af3 (table default.Table_baef1a6b19f94884934f0c54a4dda5d0 [id=d69648d0cdb042a3a4e487ef0cf0088b]) successfully deleted
W20260619 19:54:07.398765 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 45c0ffb4629a46349ccfe473cc20cdfc because the tablet was not found. No further retry: Not found: Tablet not found: 45c0ffb4629a46349ccfe473cc20cdfc
W20260619 19:54:07.398970 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1bc12bcf50074b46860899a82dc0b46e because the tablet was not found. No further retry: Not found: Tablet not found: 1bc12bcf50074b46860899a82dc0b46e
W20260619 19:54:07.399204 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1a686826694b49b9bb5bcdefd61c9a15 because the tablet was not found. No further retry: Not found: Tablet not found: 1a686826694b49b9bb5bcdefd61c9a15
W20260619 19:54:07.399392 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 4e2f73871161488dbad7a19fc9e20b9c because the tablet was not found. No further retry: Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:07.373036 1200 tablet_bootstrap.cc:492] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.400205 1200 ts_tablet_manager.cc:1403] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.001s
W20260619 19:54:07.400563 859 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:07.400682 859 leader_election.cc:304] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.400961 1200 raft_consensus.cc:359] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.401111 1200 raft_consensus.cc:385] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.401153 1200 raft_consensus.cc:740] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:07.401152 859 leader_election.cc:343] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:54:07.401264 859 leader_election.cc:304] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.401459 1200 consensus_queue.cc:260] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.401539 2343 raft_consensus.cc:2749] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:07.401618 859 consensus_peers.cc:597] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b22024a0c434f8e8d4a370dbfb9a4e2. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:07.401697 2343 raft_consensus.cc:2749] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:07.401806 859 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:07.401927 859 leader_election.cc:304] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.402166 1200 ts_tablet_manager.cc:1434] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:07.402331 2563 raft_consensus.cc:2749] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.402485 1200 tablet_bootstrap.cc:492] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:07.402762 859 leader_election.cc:343] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fe14a1f35cf14ca480221ee412c087da
W20260619 19:54:07.403230 859 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:07.403349 859 leader_election.cc:304] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.403750 2343 raft_consensus.cc:2749] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:07.403839 859 leader_election.cc:304] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.381464 2026 ts_tablet_manager.cc:1929] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:07.404227 2026 log.cc:1199] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/6baa466f30c2460697217f526fc4617f
I20260619 19:54:07.404534 1200 tablet_bootstrap.cc:654] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.404729 2026 ts_tablet_manager.cc:1950] T 6baa466f30c2460697217f526fc4617f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:07.384814 1201 tablet_bootstrap.cc:492] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.405249 1201 ts_tablet_manager.cc:1403] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.082s user 0.012s sys 0.000s
I20260619 19:54:07.406288 1994 ts_tablet_manager.cc:1929] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:07.406503 1994 log.cc:1199] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:07.407362 1994 ts_tablet_manager.cc:1950] T 90b8468df4a449d088f47b3b150ce54a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:07.423370 719 leader_election.cc:304] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.423872 2516 raft_consensus.cc:2804] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:07.424023 2516 raft_consensus.cc:697] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:07.424299 2516 consensus_queue.cc:237] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.430792 2324 raft_consensus.cc:493] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.431043 2324 raft_consensus.cc:515] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.432014 2324 leader_election.cc:290] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:07.433478 720 leader_election.cc:343] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:07.438185 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54b2e4f657245c2aa23d138968b3b0d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.439957 1208 tablet_bootstrap.cc:492] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.440622 1208 ts_tablet_manager.cc:1403] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.114s user 0.016s sys 0.016s
I20260619 19:54:07.441795 1208 raft_consensus.cc:359] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.443087 1208 raft_consensus.cc:385] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.443424 1208 raft_consensus.cc:740] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.443995 1208 consensus_queue.cc:260] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.444944 1208 ts_tablet_manager.cc:1434] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:54:07.445832 1208 tablet_bootstrap.cc:492] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.446316 2567 tablet.cc:1724] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:07.447595 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_61001685074b47918bcf2235c53aee59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:07.448541 1208 tablet_bootstrap.cc:654] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:07.448743 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61001685074b47918bcf2235c53aee59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.454906 2343 raft_consensus.cc:2749] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:07.455827 2533 raft_consensus.cc:493] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.455982 2533 raft_consensus.cc:515] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.456749 2533 leader_election.cc:290] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:07.457665 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:07.458185 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 118) took 6201 ms. Trace:
I20260619 19:54:07.459018 2538 raft_consensus.cc:493] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.459553 2538 raft_consensus.cc:515] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.460343 2538 leader_election.cc:290] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:07.460760 719 leader_election.cc:343] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:07.460870 996 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.461325 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.462103 1201 raft_consensus.cc:359] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.462394 1201 raft_consensus.cc:385] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.462499 1201 raft_consensus.cc:740] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:54:07.462467 996 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.462594 996 leader_election.cc:304] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:07.462828 1201 consensus_queue.cc:260] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.463428 1201 ts_tablet_manager.cc:1434] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260619 19:54:07.463912 1201 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:07.465178 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 90b8468df4a449d088f47b3b150ce54a (table default.Table_9b463251c2ed4c56aeccc8c045d3dd06 [id=56ee4af476f74b9ab373fb2bfc1c315e]) successfully deleted
I20260619 19:54:07.465272 719 leader_election.cc:304] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.465605 1200 tablet_bootstrap.cc:492] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.465875 1200 ts_tablet_manager.cc:1403] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.015s
I20260619 19:54:07.465998 1201 tablet_bootstrap.cc:654] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.465651 2533 raft_consensus.cc:2749] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.466368 2324 raft_consensus.cc:2749] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.457681 1973 ts_tablet_manager.cc:1916] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.467037 1200 raft_consensus.cc:359] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.468366 1200 raft_consensus.cc:385] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.468497 1200 raft_consensus.cc:740] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.468940 1200 consensus_queue.cc:260] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.474472 1200 ts_tablet_manager.cc:1434] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:54:07.457653 1208 tablet_bootstrap.cc:492] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.474815 1208 ts_tablet_manager.cc:1403] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.000s
I20260619 19:54:07.475864 1208 raft_consensus.cc:359] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.476130 1208 raft_consensus.cc:385] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.476240 1208 raft_consensus.cc:740] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:54:07.476387 858 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 46dcf2293e2d461ca1be171069867d1f
I20260619 19:54:07.476509 1208 consensus_queue.cc:260] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.476961 2516 raft_consensus.cc:493] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.470105 2593 tablet.cc:1724] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:07.477136 1208 ts_tablet_manager.cc:1434] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:07.477413 1208 tablet_bootstrap.cc:492] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.473579 1994 tablet_replica.cc:333] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:07.481696 1994 raft_consensus.cc:2243] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.482013 1994 raft_consensus.cc:2272] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.482622 1994 ts_tablet_manager.cc:1916] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.458290 2026 rpcz_store.cc:276] 0619 19:54:01.256605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.256657 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:07.113798 (+5857141us) ts_tablet_manager.cc:1151] Deleting tablet 6baa466f30c2460697217f526fc4617f
0619 19:54:07.113806 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.256776 (+142970us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.365442 (+108666us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.458159 (+ 92717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50098,"tablet-delete.queue_time_us":5856913}
I20260619 19:54:07.483265 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 119) took 6224 ms. Trace:
I20260619 19:54:07.483335 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 6baa466f30c2460697217f526fc4617f (table default.Table_5fbfc5adf799430e85b4aa1130d23699 [id=7066539595c04958818108ac6cf39581]) successfully deleted
I20260619 19:54:07.483422 2026 rpcz_store.cc:276] 0619 19:54:01.258646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.258709 (+ 63us) service_pool.cc:224] Handling call
0619 19:54:07.483119 (+6224410us) ts_tablet_manager.cc:1151] Deleting tablet a690a4fdf60947acb271abe588d4b5c0
0619 19:54:07.483154 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.483246 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6224138}
I20260619 19:54:07.483726 2026 tablet_replica.cc:333] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:07.483914 2026 raft_consensus.cc:2243] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:07.484053 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet a690a4fdf60947acb271abe588d4b5c0 because the tablet was not found. No further retry: Not found: Tablet not found: a690a4fdf60947acb271abe588d4b5c0
I20260619 19:54:07.484091 2026 raft_consensus.cc:2272] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.484802 1200 tablet_bootstrap.cc:492] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:07.484848 2026 ts_tablet_manager.cc:1916] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.486433 1200 tablet_bootstrap.cc:654] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.477137 2516 raft_consensus.cc:515] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:07.487375 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 83541.6us
I20260619 19:54:07.489511 1973 ts_tablet_manager.cc:1929] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:07.489738 1973 log.cc:1199] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/19d6333b0c8940b2802307d0da8a57ac
I20260619 19:54:07.490198 1973 ts_tablet_manager.cc:1950] T 19d6333b0c8940b2802307d0da8a57ac P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.490600 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 233) took 4204 ms. Trace:
I20260619 19:54:07.490744 1973 rpcz_store.cc:276] 0619 19:54:03.286008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.286507 (+ 499us) service_pool.cc:224] Handling call
0619 19:54:07.376902 (+4090395us) ts_tablet_manager.cc:1151] Deleting tablet 19d6333b0c8940b2802307d0da8a57ac
0619 19:54:07.376940 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.472097 (+ 95157us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.489447 (+ 17350us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.490580 (+ 1133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4089933}
I20260619 19:54:07.491258 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 238) took 4199 ms. Trace:
I20260619 19:54:07.491387 1973 rpcz_store.cc:276] 0619 19:54:03.291768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.291829 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:07.491119 (+4199290us) ts_tablet_manager.cc:1151] Deleting tablet c2c0afdcf96247b0a16c8f9ac71cc24a
0619 19:54:07.491165 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.491243 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4199085}
I20260619 19:54:07.491786 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 239) took 4199 ms. Trace:
I20260619 19:54:07.491927 1973 rpcz_store.cc:276] 0619 19:54:03.291898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.291978 (+ 80us) service_pool.cc:224] Handling call
0619 19:54:07.491697 (+4199719us) ts_tablet_manager.cc:1151] Deleting tablet 82d2dd6eedd24f44a6a17aceb20e62bb
0619 19:54:07.491706 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.491773 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4199548}
I20260619 19:54:07.492265 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 240) took 4200 ms. Trace:
W20260619 19:54:07.498427 996 consensus_peers.cc:597] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:07.498847 1973 rpcz_store.cc:276] 0619 19:54:03.292018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.292093 (+ 75us) service_pool.cc:224] Handling call
0619 19:54:07.492195 (+4200102us) ts_tablet_manager.cc:1151] Deleting tablet 5bae5be1340f4158a0b243415e232ae5
0619 19:54:07.492203 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.492251 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4199970}
I20260619 19:54:07.499500 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 241) took 4181 ms. Trace:
I20260619 19:54:07.499683 1973 rpcz_store.cc:276] 0619 19:54:03.318302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.318380 (+ 78us) service_pool.cc:224] Handling call
0619 19:54:07.499365 (+4180985us) ts_tablet_manager.cc:1151] Deleting tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60
0619 19:54:07.499378 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.499481 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4152090}
I20260619 19:54:07.500119 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 244) took 4095 ms. Trace:
I20260619 19:54:07.500250 1973 rpcz_store.cc:276] 0619 19:54:03.404512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.404560 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:07.500005 (+4095445us) ts_tablet_manager.cc:1151] Deleting tablet dcc9c4167c58495fbfcf5fb60952c884
0619 19:54:07.500015 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.500102 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4095255}
I20260619 19:54:07.500595 1973 tablet_replica.cc:333] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:07.501837 2324 raft_consensus.cc:493] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.507261 2324 raft_consensus.cc:515] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.507417 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5235127fb54d3dba90c9f9f8c134b4" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:07.507589 1056 raft_consensus.cc:2468] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:07.507884 2324 leader_election.cc:290] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.508244 720 leader_election.cc:304] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.509189 1039 tablet_service.cc:1511] Processing CreateTablet for tablet c355288287bf47bca2083a3bb915d323 (DEFAULT_TABLE table=default.Table_36b881be5c294228b4f5ca85051fff7b [id=89b3a68121c24d1c8a8e710025937d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.509608 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c355288287bf47bca2083a3bb915d323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.511863 1973 raft_consensus.cc:2243] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:07.512105 1973 pending_rounds.cc:70] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:07.512152 1973 pending_rounds.cc:77] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7298657677864468480 op_type: NO_OP noop_request { }
I20260619 19:54:07.512235 1973 raft_consensus.cc:2889] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:07.512306 1973 raft_consensus.cc:2272] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.513127 1973 ts_tablet_manager.cc:1916] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.514074 526 catalog_manager.cc:5696] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:07.514464 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_a3f0b91866884789b9a1ddc76a59ca8f [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 2 got 0
I20260619 19:54:07.514696 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:07.515517 2324 raft_consensus.cc:2804] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.515600 2324 raft_consensus.cc:493] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.515663 2324 raft_consensus.cc:3060] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.518215 2324 raft_consensus.cc:515] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.515007 526 catalog_manager.cc:5696] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:07.519311 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 3 got 0
W20260619 19:54:07.519975 859 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 46dcf2293e2d461ca1be171069867d1f
I20260619 19:54:07.520097 859 leader_election.cc:304] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:07.520308 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6c396a42add84c62acecb9bbb5d57f1d (table default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313]). Expected version 1 got 0
I20260619 19:54:07.520617 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 3 got 0
I20260619 19:54:07.520864 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:07.521867 1973 ts_tablet_manager.cc:1929] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260619 19:54:07.521975 1973 log.cc:1199] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/76ffe451545c4af6821971384fce483e
I20260619 19:54:07.522282 1973 ts_tablet_manager.cc:1950] T 76ffe451545c4af6821971384fce483e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.522235 887 tablet_service.cc:1511] Processing CreateTablet for tablet c679a253254d449fb57fc458acab7b86 (DEFAULT_TABLE table=default.Table_bbf9c52ad68e4f60911fce508327d27e [id=c0eed04adc7845a0b7709e84ec93ddd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.522611 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c679a253254d449fb57fc458acab7b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.523429 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6fa17f0fb0426d87c26840e9760f80 (DEFAULT_TABLE table=default.Table_bce503f02a3a4c269e0776c21978ae75 [id=14f77e34fe414f9ba79185e71ae43a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.523780 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6fa17f0fb0426d87c26840e9760f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.527434 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 (DEFAULT_TABLE table=default.Table_6920393f5922435bbf9c6a6a1a16dff2 [id=c1382da014f14094b6678d7774d12fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.527792 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5c1ffd83c944ada87d59439b6a9cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.527985 885 tablet_service.cc:1511] Processing CreateTablet for tablet c355288287bf47bca2083a3bb915d323 (DEFAULT_TABLE table=default.Table_36b881be5c294228b4f5ca85051fff7b [id=89b3a68121c24d1c8a8e710025937d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.528375 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c355288287bf47bca2083a3bb915d323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.531162 1208 tablet_bootstrap.cc:654] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.531414 1032 tablet_service.cc:1511] Processing CreateTablet for tablet eb43742411444ecaa62f74fc729c7745 (DEFAULT_TABLE table=default.Table_be833bdadf28404f9b58987bb4f6e229 [id=51b5610286194c489ff492591abce4d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.531409 886 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6fa17f0fb0426d87c26840e9760f80 (DEFAULT_TABLE table=default.Table_bce503f02a3a4c269e0776c21978ae75 [id=14f77e34fe414f9ba79185e71ae43a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.531755 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb43742411444ecaa62f74fc729c7745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.531776 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6fa17f0fb0426d87c26840e9760f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.532804 900 tablet_service.cc:1511] Processing CreateTablet for tablet 97c85ec29991418796f1af65e0604323 (DEFAULT_TABLE table=default.Table_3da787af0c3645428fe490e3179bb610 [id=71c2a9916e69444b9926d4c9feb4ceff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.533139 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c85ec29991418796f1af65e0604323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.534148 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 258) took 3800 ms. Trace:
I20260619 19:54:07.534273 1973 rpcz_store.cc:276] 0619 19:54:03.733717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.733773 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:07.500531 (+3766758us) ts_tablet_manager.cc:1151] Deleting tablet 76ffe451545c4af6821971384fce483e
0619 19:54:07.500554 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.519154 (+ 18600us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.521811 (+ 2657us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.534123 (+ 12312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3766545}
I20260619 19:54:07.534675 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 259) took 3800 ms. Trace:
I20260619 19:54:07.534740 1973 rpcz_store.cc:276] 0619 19:54:03.734379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.734433 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:07.534545 (+3800112us) ts_tablet_manager.cc:1151] Deleting tablet 02c5f9405d6a4a16bd49697001c201e1
0619 19:54:07.534558 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.534659 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3799940}
I20260619 19:54:07.535037 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 260) took 3800 ms. Trace:
I20260619 19:54:07.535099 1973 rpcz_store.cc:276] 0619 19:54:03.734529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.734582 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:07.534946 (+3800364us) ts_tablet_manager.cc:1151] Deleting tablet 47ace991ad1a4d52ab609940aacf6681
0619 19:54:07.534955 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.535023 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800233}
I20260619 19:54:07.535341 1973 tablet_replica.cc:333] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:07.537092 720 leader_election.cc:343] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74949d09466f42e2852389e10192989d
I20260619 19:54:07.528376 903 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 (DEFAULT_TABLE table=default.Table_6920393f5922435bbf9c6a6a1a16dff2 [id=c1382da014f14094b6678d7774d12fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.537811 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5c1ffd83c944ada87d59439b6a9cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.537922 2324 leader_election.cc:290] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.538589 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5235127fb54d3dba90c9f9f8c134b4" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:07.538756 1059 raft_consensus.cc:3060] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.538769 887 tablet_service.cc:1511] Processing CreateTablet for tablet eb43742411444ecaa62f74fc729c7745 (DEFAULT_TABLE table=default.Table_be833bdadf28404f9b58987bb4f6e229 [id=51b5610286194c489ff492591abce4d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.540993 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb43742411444ecaa62f74fc729c7745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.541261 1059 raft_consensus.cc:2468] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:07.541680 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 97c85ec29991418796f1af65e0604323 (DEFAULT_TABLE table=default.Table_3da787af0c3645428fe490e3179bb610 [id=71c2a9916e69444b9926d4c9feb4ceff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.542004 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c85ec29991418796f1af65e0604323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.543393 1973 raft_consensus.cc:2243] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:07.543494 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97bcd24488634ad1a7b636e894bd36f2" } new_table_name: "default.Table_c752ae3fb15b43a19f8a402dc1557a49" modify_external_catalogs: true
I20260619 19:54:07.543759 1973 raft_consensus.cc:2272] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.544317 1973 ts_tablet_manager.cc:1916] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.547451 1035 tablet_service.cc:1511] Processing CreateTablet for tablet fcb37eed280c48e8931b6fc94f7600dd (DEFAULT_TABLE table=default.Table_9a415c8fc09b47168de84f6fa673df9e [id=b01b09a8f82b4025a07fed579131c072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.547801 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb37eed280c48e8931b6fc94f7600dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.549968 1973 ts_tablet_manager.cc:1929] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:07.550071 1973 log.cc:1199] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/33ee0b30259741cdb2fb0e3c815e6b17
I20260619 19:54:07.550370 1973 ts_tablet_manager.cc:1950] T 33ee0b30259741cdb2fb0e3c815e6b17 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.551869 1208 tablet_bootstrap.cc:492] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.552637 720 leader_election.cc:304] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.552879 1208 ts_tablet_manager.cc:1403] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.076s user 0.017s sys 0.000s
I20260619 19:54:07.553689 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb499b2e5374912a10bc6379dba55b4 (DEFAULT_TABLE table=default.Table_0bc540dd0cf9434fb277800208ee0d23 [id=3f6740ded6b646feb3d38896b1d402e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.553718 1208 raft_consensus.cc:359] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.553884 1208 raft_consensus.cc:385] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.553938 1208 raft_consensus.cc:740] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.554122 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb499b2e5374912a10bc6379dba55b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.554157 1208 consensus_queue.cc:260] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.554618 1208 ts_tablet_manager.cc:1434] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:07.554895 1208 tablet_bootstrap.cc:492] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.555236 2527 raft_consensus.cc:2804] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:07.555387 2527 raft_consensus.cc:697] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:07.555616 2527 consensus_queue.cc:237] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.556218 1208 tablet_bootstrap.cc:654] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.557191 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 261) took 3822 ms. Trace:
I20260619 19:54:07.557278 1973 rpcz_store.cc:276] 0619 19:54:03.734874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.734921 (+ 47us) service_pool.cc:224] Handling call
0619 19:54:07.535296 (+3800375us) ts_tablet_manager.cc:1151] Deleting tablet 33ee0b30259741cdb2fb0e3c815e6b17
0619 19:54:07.535306 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.547239 (+ 11933us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.549916 (+ 2677us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.557170 (+ 7254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7830,"tablet-delete.queue_time_us":3800239}
I20260619 19:54:07.557832 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 257) took 3824 ms. Trace:
W20260619 19:54:07.559473 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28fc6b68c1584bb2bcc27a63cf0df0ba consensus state has no leader
I20260619 19:54:07.559734 1973 rpcz_store.cc:276] 0619 19:54:03.733260 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.735289 (+ 2029us) service_pool.cc:224] Handling call
0619 19:54:07.557704 (+3822415us) ts_tablet_manager.cc:1151] Deleting tablet 8ce7f825e5f84d5985427e83ee6a989d
0619 19:54:07.557714 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.557816 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3822195}
I20260619 19:54:07.560418 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 262) took 3824 ms. Trace:
I20260619 19:54:07.560875 1973 rpcz_store.cc:276] 0619 19:54:03.735511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.735684 (+ 173us) service_pool.cc:224] Handling call
0619 19:54:07.560296 (+3824612us) ts_tablet_manager.cc:1151] Deleting tablet 0991105460f749e1854d512304ff56cd
0619 19:54:07.560306 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.560403 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3824426}
I20260619 19:54:07.561487 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 263) took 3664 ms. Trace:
I20260619 19:54:07.561865 1973 rpcz_store.cc:276] 0619 19:54:03.897089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.897145 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:07.561378 (+3664233us) ts_tablet_manager.cc:1151] Deleting tablet 1ff5eab435484861b8bccece188f7a46
0619 19:54:07.561387 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.561472 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3664031}
I20260619 19:54:07.562397 1973 tablet_replica.cc:333] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:07.562814 1973 raft_consensus.cc:2243] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:07.563702 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c679a253254d449fb57fc458acab7b86 (DEFAULT_TABLE table=default.Table_bbf9c52ad68e4f60911fce508327d27e [id=c0eed04adc7845a0b7709e84ec93ddd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.564146 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c679a253254d449fb57fc458acab7b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.567231 2343 raft_consensus.cc:2749] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.567601 1973 raft_consensus.cc:2272] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:07.568109 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 48144.5us
I20260619 19:54:07.569191 1973 ts_tablet_manager.cc:1916] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.569732 885 tablet_service.cc:1511] Processing CreateTablet for tablet fcb37eed280c48e8931b6fc94f7600dd (DEFAULT_TABLE table=default.Table_9a415c8fc09b47168de84f6fa673df9e [id=b01b09a8f82b4025a07fed579131c072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.570189 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb37eed280c48e8931b6fc94f7600dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.570706 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_67dfa6733a6d46649a28c9b2eb7249b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:07.571334 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67dfa6733a6d46649a28c9b2eb7249b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:07.573186 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 96420us
I20260619 19:54:07.574144 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5235127fb54d3dba90c9f9f8c134b4" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.574381 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74949d09466f42e2852389e10192989d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:07.574584 913 raft_consensus.cc:2468] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:07.575444 2516 leader_election.cc:290] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.575556 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 19d6333b0c8940b2802307d0da8a57ac (table default.Table_62d0e0d461a74b99bac5c2251f7f7f63 [id=73d986c5f5974ea790e236843abdf930]) successfully deleted
W20260619 19:54:07.576294 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c2c0afdcf96247b0a16c8f9ac71cc24a because the tablet was not found. No further retry: Not found: Tablet not found: c2c0afdcf96247b0a16c8f9ac71cc24a
W20260619 19:54:07.577111 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 82d2dd6eedd24f44a6a17aceb20e62bb because the tablet was not found. No further retry: Not found: Tablet not found: 82d2dd6eedd24f44a6a17aceb20e62bb
W20260619 19:54:07.577905 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5bae5be1340f4158a0b243415e232ae5 because the tablet was not found. No further retry: Not found: Tablet not found: 5bae5be1340f4158a0b243415e232ae5
W20260619 19:54:07.578747 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 because the tablet was not found. No further retry: Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
W20260619 19:54:07.579510 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet dcc9c4167c58495fbfcf5fb60952c884 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcc9c4167c58495fbfcf5fb60952c884 already in progress: creating tablet
I20260619 19:54:07.580045 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5235127fb54d3dba90c9f9f8c134b4" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:07.581573 2570 tablet.cc:1724] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:07.582672 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 76ffe451545c4af6821971384fce483e (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]) successfully deleted
I20260619 19:54:07.582553 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_97bf32159dc444559df0fc5c5cfd2452"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:07.582906 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 02c5f9405d6a4a16bd49697001c201e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02c5f9405d6a4a16bd49697001c201e1 already in progress: creating tablet
W20260619 19:54:07.583151 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 47ace991ad1a4d52ab609940aacf6681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ace991ad1a4d52ab609940aacf6681 already in progress: creating tablet
W20260619 19:54:07.583199 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97bf32159dc444559df0fc5c5cfd2452 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.583384 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]) successfully deleted
W20260619 19:54:07.583614 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8ce7f825e5f84d5985427e83ee6a989d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ce7f825e5f84d5985427e83ee6a989d already in progress: creating tablet
W20260619 19:54:07.583820 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0991105460f749e1854d512304ff56cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0991105460f749e1854d512304ff56cd already in progress: creating tablet
W20260619 19:54:07.584045 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1ff5eab435484861b8bccece188f7a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ff5eab435484861b8bccece188f7a46 already in progress: creating tablet
I20260619 19:54:07.585021 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d6bc861cb7d941f380671105fd338538 (DEFAULT_TABLE table=default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.585427 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bc861cb7d941f380671105fd338538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.585906 1973 ts_tablet_manager.cc:1929] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:07.591701 900 tablet_service.cc:1511] Processing CreateTablet for tablet d6bc861cb7d941f380671105fd338538 (DEFAULT_TABLE table=default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.592306 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bc861cb7d941f380671105fd338538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.593233 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ac2d419a6e5d466e97df971b31640519 (DEFAULT_TABLE table=default.Table_f9584ecbe09048ff96f36ffc361d09b7 [id=f71693afcf0649c6a78860233e907ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.593722 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2d419a6e5d466e97df971b31640519. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:07.594726 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 28fc6b68c1584bb2bcc27a63cf0df0ba (table default.Table_869856a5e6e142f9ae4c72eacebc1090 [id=fad8a846289946d696cd2467b360eb77], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 28fc6b68c1584bb2bcc27a63cf0df0ba consensus state has no leader
I20260619 19:54:07.597271 1973 log.cc:1199] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fade40bf3e7145f29076821f091677bd
I20260619 19:54:07.597733 1973 ts_tablet_manager.cc:1950] T fade40bf3e7145f29076821f091677bd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.598045 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 264) took 3697 ms. Trace:
I20260619 19:54:07.597982 886 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb499b2e5374912a10bc6379dba55b4 (DEFAULT_TABLE table=default.Table_0bc540dd0cf9434fb277800208ee0d23 [id=3f6740ded6b646feb3d38896b1d402e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.598121 1973 rpcz_store.cc:276] 0619 19:54:03.900823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.900950 (+ 127us) service_pool.cc:224] Handling call
0619 19:54:07.562354 (+3661404us) ts_tablet_manager.cc:1151] Deleting tablet fade40bf3e7145f29076821f091677bd
0619 19:54:07.562363 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.572367 (+ 10004us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.585849 (+ 13482us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.598031 (+ 12182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3661165}
I20260619 19:54:07.598477 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb499b2e5374912a10bc6379dba55b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.598649 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 265) took 3661 ms. Trace:
I20260619 19:54:07.598724 1973 rpcz_store.cc:276] 0619 19:54:03.937298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.937364 (+ 66us) service_pool.cc:224] Handling call
0619 19:54:07.598533 (+3661169us) ts_tablet_manager.cc:1151] Deleting tablet d6a6ffdcd55d4db6870fe032f72ab3b1
0619 19:54:07.598541 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.598634 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3660918}
I20260619 19:54:07.598995 1973 tablet_replica.cc:333] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:07.599200 1973 raft_consensus.cc:2243] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.603996 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 67faf5d554074ab3bdf79075f649f4e0 (DEFAULT_TABLE table=default.Table_d78c9341be6f497b822f0d52c9a63534 [id=c14a59dd48c340f6bbc18a87628add74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.604823 1973 raft_consensus.cc:2272] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.605057 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67faf5d554074ab3bdf79075f649f4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.605397 1973 ts_tablet_manager.cc:1916] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:07.607460 903 tablet_service.cc:1511] Processing CreateTablet for tablet ac2d419a6e5d466e97df971b31640519 (DEFAULT_TABLE table=default.Table_f9584ecbe09048ff96f36ffc361d09b7 [id=f71693afcf0649c6a78860233e907ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.607890 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2d419a6e5d466e97df971b31640519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.610924 1973 ts_tablet_manager.cc:1929] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:07.611038 1973 log.cc:1199] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fe14a1f35cf14ca480221ee412c087da
I20260619 19:54:07.614159 1201 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.614342 1201 ts_tablet_manager.cc:1403] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.151s user 0.003s sys 0.004s
I20260619 19:54:07.615227 1201 raft_consensus.cc:359] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.615547 1201 raft_consensus.cc:385] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.615667 1201 raft_consensus.cc:740] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.616055 1201 consensus_queue.cc:260] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.616978 1201 ts_tablet_manager.cc:1434] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:07.619388 1201 tablet_bootstrap.cc:492] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:07.621178 1201 tablet_bootstrap.cc:654] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.625939 1973 ts_tablet_manager.cc:1950] T fe14a1f35cf14ca480221ee412c087da P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:07.627417 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d5de5ed4c25e4cacadac49134c646e84" } modify_external_catalogs: true
I20260619 19:54:07.627648 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d5de5ed4c25e4cacadac49134c646e84" } modify_external_catalogs: true
I20260619 19:54:07.631721 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 266) took 3693 ms. Trace:
I20260619 19:54:07.632459 1973 rpcz_store.cc:276] 0619 19:54:03.938892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.938945 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:07.598954 (+3660009us) ts_tablet_manager.cc:1151] Deleting tablet fe14a1f35cf14ca480221ee412c087da
0619 19:54:07.598962 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.608230 (+ 9268us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.610877 (+ 2647us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.631699 (+ 20822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304,"tablet-delete.queue_time_us":3659834}
I20260619 19:54:07.633253 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 267) took 3619 ms. Trace:
I20260619 19:54:07.633705 1973 rpcz_store.cc:276] 0619 19:54:04.014156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.014210 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:07.633126 (+3618916us) ts_tablet_manager.cc:1151] Deleting tablet 1ca68b755bf841509b6ffcfbe212278c
0619 19:54:07.633136 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.633237 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3618724}
I20260619 19:54:07.635380 762 tablet_service.cc:1511] Processing CreateTablet for tablet eb43742411444ecaa62f74fc729c7745 (DEFAULT_TABLE table=default.Table_be833bdadf28404f9b58987bb4f6e229 [id=51b5610286194c489ff492591abce4d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.635767 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb43742411444ecaa62f74fc729c7745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.637637 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 10c73b679e394f31b9e5d51681e06976
I20260619 19:54:07.633991 758 tablet_service.cc:1511] Processing CreateTablet for tablet c679a253254d449fb57fc458acab7b86 (DEFAULT_TABLE table=default.Table_bbf9c52ad68e4f60911fce508327d27e [id=c0eed04adc7845a0b7709e84ec93ddd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.640300 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c679a253254d449fb57fc458acab7b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.642000 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5e80cab5977d47aeba48ad866fdf975a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:07.642611 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e80cab5977d47aeba48ad866fdf975a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.643337 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 74e17caefca44171b451258424497769 (DEFAULT_TABLE table=default.Table_017d2f2270454e479030dd691d1d89b6 [id=129ca6aa170c49489575e8ca981e587f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.634454 747 tablet_service.cc:1511] Processing CreateTablet for tablet c355288287bf47bca2083a3bb915d323 (DEFAULT_TABLE table=default.Table_36b881be5c294228b4f5ca85051fff7b [id=89b3a68121c24d1c8a8e710025937d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.634855 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6fa17f0fb0426d87c26840e9760f80 (DEFAULT_TABLE table=default.Table_bce503f02a3a4c269e0776c21978ae75 [id=14f77e34fe414f9ba79185e71ae43a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.635320 755 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 (DEFAULT_TABLE table=default.Table_6920393f5922435bbf9c6a6a1a16dff2 [id=c1382da014f14094b6678d7774d12fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.643744 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e17caefca44171b451258424497769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.643916 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5c1ffd83c944ada87d59439b6a9cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.644100 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6fa17f0fb0426d87c26840e9760f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.647251 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c355288287bf47bca2083a3bb915d323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.647835 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 8604e0a1655c4d7da4100dd304c0d2cf (DEFAULT_TABLE table=default.Table_256452144ec04479a8f18bd678b4c377 [id=206afee239284a8296ea0c97b8473de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.648178 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8604e0a1655c4d7da4100dd304c0d2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.651458 2533 raft_consensus.cc:493] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.651582 2533 raft_consensus.cc:515] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.652211 2533 leader_election.cc:290] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:07.652606 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 10c73b679e394f31b9e5d51681e06976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:07.652865 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f9e5a4dedd4c81901cb99fecff0919" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:07.653421 996 leader_election.cc:343] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.656376 1208 tablet_bootstrap.cc:492] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.656533 1208 ts_tablet_manager.cc:1403] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.102s user 0.018s sys 0.004s
I20260619 19:54:07.657166 1208 raft_consensus.cc:359] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.657305 1208 raft_consensus.cc:385] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.657347 1208 raft_consensus.cc:740] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.657541 1208 consensus_queue.cc:260] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.657982 1208 ts_tablet_manager.cc:1434] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260619 19:54:07.658233 1208 tablet_bootstrap.cc:492] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.659519 1208 tablet_bootstrap.cc:654] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.667472 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 53f548f7a6c44be998687058a6ba88ce (DEFAULT_TABLE table=default.Table_1c6a727020ed49ac83911dca4c46a392 [id=95d401b88c8c4f819e4956c88a0ad7ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.668303 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f548f7a6c44be998687058a6ba88ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:07.669613 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 172295us
I20260619 19:54:07.670388 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 74d8cd01251f4cfa93ecddb391c1c91e
I20260619 19:54:07.671106 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a7c1681538764a19a55ac9927e210067" } new_table_name: "default.Table_af8f4c6facda472389bbb8f287eb8c70" modify_external_catalogs: true
I20260619 19:54:07.671594 747 tablet_service.cc:1511] Processing CreateTablet for tablet 97c85ec29991418796f1af65e0604323 (DEFAULT_TABLE table=default.Table_3da787af0c3645428fe490e3179bb610 [id=71c2a9916e69444b9926d4c9feb4ceff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.672560 758 tablet_service.cc:1511] Processing CreateTablet for tablet fcb37eed280c48e8931b6fc94f7600dd (DEFAULT_TABLE table=default.Table_9a415c8fc09b47168de84f6fa673df9e [id=b01b09a8f82b4025a07fed579131c072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.672858 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:07.673152 755 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb499b2e5374912a10bc6379dba55b4 (DEFAULT_TABLE table=default.Table_0bc540dd0cf9434fb277800208ee0d23 [id=3f6740ded6b646feb3d38896b1d402e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.673285 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcc9a948562461092da5bb781854652 (DEFAULT_TABLE table=default.Table_8349f974cb2246779c7c71dada5fcd52 [id=d8bfd149ac0448eb9b9900aae7e06df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.673516 763 tablet_service.cc:1511] Processing CreateTablet for tablet d6bc861cb7d941f380671105fd338538 (DEFAULT_TABLE table=default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.673549 749 tablet_service.cc:1511] Processing CreateTablet for tablet ac2d419a6e5d466e97df971b31640519 (DEFAULT_TABLE table=default.Table_f9584ecbe09048ff96f36ffc361d09b7 [id=f71693afcf0649c6a78860233e907ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.673804 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcc9a948562461092da5bb781854652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.674220 752 tablet_service.cc:1511] Processing CreateTablet for tablet 67faf5d554074ab3bdf79075f649f4e0 (DEFAULT_TABLE table=default.Table_d78c9341be6f497b822f0d52c9a63534 [id=c14a59dd48c340f6bbc18a87628add74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.674837 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcc9a948562461092da5bb781854652 (DEFAULT_TABLE table=default.Table_8349f974cb2246779c7c71dada5fcd52 [id=d8bfd149ac0448eb9b9900aae7e06df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.675524 746 tablet_service.cc:1511] Processing CreateTablet for tablet 74e17caefca44171b451258424497769 (DEFAULT_TABLE table=default.Table_017d2f2270454e479030dd691d1d89b6 [id=129ca6aa170c49489575e8ca981e587f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.676355 748 tablet_service.cc:1511] Processing CreateTablet for tablet 8604e0a1655c4d7da4100dd304c0d2cf (DEFAULT_TABLE table=default.Table_256452144ec04479a8f18bd678b4c377 [id=206afee239284a8296ea0c97b8473de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.676525 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 10c73b679e394f31b9e5d51681e06976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:07.677353 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2090db1e6d5646bbbef77ab6776fe3d2 (DEFAULT_TABLE table=default.Table_f9c88e691c944cbb8c6e440fb6e88f4c [id=32294cc91a7345778d1160121951a03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.677822 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2090db1e6d5646bbbef77ab6776fe3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.678860 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c85ec29991418796f1af65e0604323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.680948 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a9bdcbcf35e14a7ca2c0241478d278cd
I20260619 19:54:07.684732 526 master_service.cc:960] ReplaceTablet: received request to replace tablet e6dcf87d57044279a218cbb21c383352 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:07.686789 530 catalog_manager.cc:5696] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:07.687389 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:07.687743 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]). Expected version 2 got 0
I20260619 19:54:07.687979 530 catalog_manager.cc:5696] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:07.688349 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 3 got 0
I20260619 19:54:07.690198 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d895be304fcf445e9a4d2d8242becdd5 with delete_type TABLET_DATA_DELETED (replaced by tablet 10c73b679e394f31b9e5d51681e06976) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:07.690595 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet a9bdcbcf35e14a7ca2c0241478d278cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:07.694886 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6cc12c429f4857a67d77c697e6dc67 (DEFAULT_TABLE table=default.Table_9c97c6559f804b4eb92351eb88ee1e38 [id=85ac48c937424d8a8f7735c3cba437ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.695451 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6cc12c429f4857a67d77c697e6dc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.699478 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d3a10b360439454f962bcfef44f41a05 (DEFAULT_TABLE table=default.Table_8b584703372a4447845a8fcfeabeaf0c [id=7bb8820b88ba4fe4a7e538066cc2dbfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.700120 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a10b360439454f962bcfef44f41a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.704885 1208 tablet_bootstrap.cc:492] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:07.705214 1208 ts_tablet_manager.cc:1403] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.006s
I20260619 19:54:07.706041 1208 raft_consensus.cc:359] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.706303 1208 raft_consensus.cc:385] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.706418 1208 raft_consensus.cc:740] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.706727 1208 consensus_queue.cc:260] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.707667 1208 ts_tablet_manager.cc:1434] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:07.629601 898 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcc9a948562461092da5bb781854652 (DEFAULT_TABLE table=default.Table_8349f974cb2246779c7c71dada5fcd52 [id=d8bfd149ac0448eb9b9900aae7e06df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.715468 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcc9a948562461092da5bb781854652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.717367 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a8b0d5d52f264281993fdb86c8658b88 (DEFAULT_TABLE table=default.Table_c7f823584528450b8a8b973c9d7617c4 [id=dff764f2dc7943e3a6e7c712241d8507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.717839 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b0d5d52f264281993fdb86c8658b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.718763 903 tablet_service.cc:1511] Processing CreateTablet for tablet 53f548f7a6c44be998687058a6ba88ce (DEFAULT_TABLE table=default.Table_1c6a727020ed49ac83911dca4c46a392 [id=95d401b88c8c4f819e4956c88a0ad7ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.629927 887 tablet_service.cc:1511] Processing CreateTablet for tablet 67faf5d554074ab3bdf79075f649f4e0 (DEFAULT_TABLE table=default.Table_d78c9341be6f497b822f0d52c9a63534 [id=c14a59dd48c340f6bbc18a87628add74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.630573 897 tablet_service.cc:1511] Processing CreateTablet for tablet 74e17caefca44171b451258424497769 (DEFAULT_TABLE table=default.Table_017d2f2270454e479030dd691d1d89b6 [id=129ca6aa170c49489575e8ca981e587f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.634886 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8604e0a1655c4d7da4100dd304c0d2cf (DEFAULT_TABLE table=default.Table_256452144ec04479a8f18bd678b4c377 [id=206afee239284a8296ea0c97b8473de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.638622 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 10c73b679e394f31b9e5d51681e06976 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:07.655440 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f9e5a4dedd4c81901cb99fecff0919" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:07.722661 996 leader_election.cc:343] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:07.722792 996 leader_election.cc:304] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:07.723208 2533 raft_consensus.cc:2749] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:07.728263 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_59b60a002f8f410484eb04cb5925bb66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:07.729135 1200 tablet_bootstrap.cc:492] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:07.729524 1200 ts_tablet_manager.cc:1403] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.245s user 0.005s sys 0.004s
W20260619 19:54:07.729894 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59b60a002f8f410484eb04cb5925bb66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.731333 1200 raft_consensus.cc:359] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.732679 1200 raft_consensus.cc:385] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.732820 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:07.732892 1200 raft_consensus.cc:740] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.733494 1200 consensus_queue.cc:260] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:07.737208 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 (DEFAULT_TABLE table=default.Table_8ced5f8d284a4065bf67d55d8b216f0b [id=1ea7008fd4f942f3905667950fa26262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.737687 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.739090 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e89f230ad9644e8f8bedfb0b54399712 (DEFAULT_TABLE table=default.Table_41a860a9f0aa442fa44bb1a677587282 [id=537364fb23d046cea541f5fd42dc20d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.739573 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89f230ad9644e8f8bedfb0b54399712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.739652 1031 tablet_service.cc:1511] Processing CreateTablet for tablet cb068672e26d48b9a871ceb1c81022cc (DEFAULT_TABLE table=default.Table_2d8e5fe907c946cab36fcb67654f064b [id=b59fbc444db44c709747550e0374bfe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.739990 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb068672e26d48b9a871ceb1c81022cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.741375 885 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 (DEFAULT_TABLE table=default.Table_8ced5f8d284a4065bf67d55d8b216f0b [id=1ea7008fd4f942f3905667950fa26262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.741801 898 tablet_service.cc:1511] Processing CreateTablet for tablet e89f230ad9644e8f8bedfb0b54399712 (DEFAULT_TABLE table=default.Table_41a860a9f0aa442fa44bb1a677587282 [id=537364fb23d046cea541f5fd42dc20d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.743387 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9c977ca621224d7ab73a9e9f39540c86 (DEFAULT_TABLE table=default.Table_ee493ced7f6f407db5eda645752fb00a [id=346f6003053545e4a46b988a36c5d625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.739652 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 9c977ca621224d7ab73a9e9f39540c86 (DEFAULT_TABLE table=default.Table_ee493ced7f6f407db5eda645752fb00a [id=346f6003053545e4a46b988a36c5d625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.744251 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c977ca621224d7ab73a9e9f39540c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.747452 886 tablet_service.cc:1511] Processing CreateTablet for tablet a8b0d5d52f264281993fdb86c8658b88 (DEFAULT_TABLE table=default.Table_c7f823584528450b8a8b973c9d7617c4 [id=dff764f2dc7943e3a6e7c712241d8507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.767174 899 tablet_service.cc:1511] Processing CreateTablet for tablet cb068672e26d48b9a871ceb1c81022cc (DEFAULT_TABLE table=default.Table_2d8e5fe907c946cab36fcb67654f064b [id=b59fbc444db44c709747550e0374bfe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.769428 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb590e469b64fa0af0b75476e73a681 (DEFAULT_TABLE table=default.Table_93b0810be0b54d468ad337442bb61eb0 [id=0a48808664fa4c59ace771398401f8ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.772871 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f7830d1bf3d24690974e40ce41686a3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:07.773553 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7830d1bf3d24690974e40ce41686a3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:07.774782 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb590e469b64fa0af0b75476e73a681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.775074 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_94637363307d4dca9da129b82be2b4b5" } modify_external_catalogs: true
I20260619 19:54:07.775270 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_94637363307d4dca9da129b82be2b4b5" } modify_external_catalogs: true
I20260619 19:54:07.779960 888 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb590e469b64fa0af0b75476e73a681 (DEFAULT_TABLE table=default.Table_93b0810be0b54d468ad337442bb61eb0 [id=0a48808664fa4c59ace771398401f8ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.784814 1022 tablet_service.cc:1511] Processing CreateTablet for tablet a977e889c36b434388fc7a3a5cd42e8c (DEFAULT_TABLE table=default.Table_153389b9465647c6b228f0ade84d6853 [id=e6455d8ae07b4c77ac1426c2e8091226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.787264 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a977e889c36b434388fc7a3a5cd42e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.800563 901 tablet_service.cc:1511] Processing CreateTablet for tablet a977e889c36b434388fc7a3a5cd42e8c (DEFAULT_TABLE table=default.Table_153389b9465647c6b228f0ade84d6853 [id=e6455d8ae07b4c77ac1426c2e8091226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.817163 2563 raft_consensus.cc:493] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.817348 2563 raft_consensus.cc:515] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.818060 2563 leader_election.cc:290] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:07.819478 859 leader_election.cc:343] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3
I20260619 19:54:07.826200 2324 raft_consensus.cc:493] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.826375 2324 raft_consensus.cc:515] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.827745 2593 tablet.cc:1724] T 6c396a42add84c62acecb9bbb5d57f1d P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:07.829255 859 consensus_peers.cc:597] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d29506dab4c84850ad79b8b7a0340987. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:07.657204 2026 ts_tablet_manager.cc:1929] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:07.709336 884 tablet_service.cc:1558] Processing DeleteTablet for tablet a9bdcbcf35e14a7ca2c0241478d278cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:07.709986 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2090db1e6d5646bbbef77ab6776fe3d2 (DEFAULT_TABLE table=default.Table_f9c88e691c944cbb8c6e440fb6e88f4c [id=32294cc91a7345778d1160121951a03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.710462 892 tablet_service.cc:1511] Processing CreateTablet for tablet d3a10b360439454f962bcfef44f41a05 (DEFAULT_TABLE table=default.Table_8b584703372a4447845a8fcfeabeaf0c [id=7bb8820b88ba4fe4a7e538066cc2dbfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.710803 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6cc12c429f4857a67d77c697e6dc67 (DEFAULT_TABLE table=default.Table_9c97c6559f804b4eb92351eb88ee1e38 [id=85ac48c937424d8a8f7735c3cba437ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.720741 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f548f7a6c44be998687058a6ba88ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.834741 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b0d5d52f264281993fdb86c8658b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.834928 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6cc12c429f4857a67d77c697e6dc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.835083 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e17caefca44171b451258424497769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.839118 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89f230ad9644e8f8bedfb0b54399712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.839388 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67faf5d554074ab3bdf79075f649f4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.839557 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2090db1e6d5646bbbef77ab6776fe3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.839951 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb068672e26d48b9a871ceb1c81022cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.842886 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8604e0a1655c4d7da4100dd304c0d2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.843439 884 tablet_service.cc:1511] Processing CreateTablet for tablet 951dfc443c4944d0a44864184e0da9d4 (DEFAULT_TABLE table=default.Table_ece67ba490164fbda8ded59ca42a5b12 [id=94be851bc6834ed6aee099a5917e1ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.843755 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951dfc443c4944d0a44864184e0da9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.843896 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a977e889c36b434388fc7a3a5cd42e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.844085 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a10b360439454f962bcfef44f41a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.844863 902 tablet_service.cc:1511] Processing CreateTablet for tablet a6433bc9150946d5b0bb7900cc30ed42 (DEFAULT_TABLE table=default.Table_b53b86c349a64aa58319ee1134c1b1de [id=e2811c103fec4686b1442791b7a9e72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.845198 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6433bc9150946d5b0bb7900cc30ed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.847229 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb590e469b64fa0af0b75476e73a681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.847550 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.848949 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a6433bc9150946d5b0bb7900cc30ed42 (DEFAULT_TABLE table=default.Table_b53b86c349a64aa58319ee1134c1b1de [id=e2811c103fec4686b1442791b7a9e72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.861137 1023 tablet_service.cc:1511] Processing CreateTablet for tablet b546831050f84a91b8e4df5b96b1be14 (DEFAULT_TABLE table=default.Table_d5de5ed4c25e4cacadac49134c646e84 [id=26c675f2171940f089b3dc8e2e1300f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.861703 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 15b81edd27d14611b3a66c547117c532 (DEFAULT_TABLE table=default.Table_9f0ad99a69364bddb17a16eb224030b1 [id=926ef286ddd34e1092a0e0d890ac4c9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.865377 2343 raft_consensus.cc:493] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.865387 1037 tablet_service.cc:1511] Processing CreateTablet for tablet f40da590ead8491788f59f1711e7e525 (DEFAULT_TABLE table=default.Table_dce56a19d6f24028956f0904bad88cd5 [id=d9e476d02b9f43d18edb3b857aff0d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.865533 2343 raft_consensus.cc:515] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.865773 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c977ca621224d7ab73a9e9f39540c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.866159 2343 leader_election.cc:290] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.867085 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:07.867295 1056 raft_consensus.cc:2468] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:07.867830 859 leader_election.cc:304] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.868152 2269 raft_consensus.cc:2804] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:07.868260 2269 raft_consensus.cc:493] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:07.868319 2269 raft_consensus.cc:3060] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.870805 2269 raft_consensus.cc:515] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.871969 2269 leader_election.cc:290] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.872614 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:07.872816 1056 raft_consensus.cc:3060] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:07.873397 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 46c2a94a4d794f2aa94b77885812831f (DEFAULT_TABLE table=default.Table_4846baa998dc44a790af9fe0cc649f59 [id=bf3f5f5eeb5a4dd9a30db4ed053dbdac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.876806 1056 raft_consensus.cc:2468] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:07.877523 859 leader_election.cc:304] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:07.877880 2269 raft_consensus.cc:2804] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:07.877992 2269 raft_consensus.cc:697] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:07.878216 2269 consensus_queue.cc:237] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.878575 896 tablet_service.cc:1511] Processing CreateTablet for tablet 15b81edd27d14611b3a66c547117c532 (DEFAULT_TABLE table=default.Table_9f0ad99a69364bddb17a16eb224030b1 [id=926ef286ddd34e1092a0e0d890ac4c9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.878947 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b81edd27d14611b3a66c547117c532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.880108 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 1557244d1ed4490185d85c2f7c028eb1 (DEFAULT_TABLE table=default.Table_a2e31faf36224311b5da1fad2378c2b3 [id=17316b2f71a54927a1efe4211f354ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.883450 884 tablet_service.cc:1511] Processing CreateTablet for tablet 46c2a94a4d794f2aa94b77885812831f (DEFAULT_TABLE table=default.Table_4846baa998dc44a790af9fe0cc649f59 [id=bf3f5f5eeb5a4dd9a30db4ed053dbdac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.884063 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c2a94a4d794f2aa94b77885812831f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.887792 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6433bc9150946d5b0bb7900cc30ed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.888000 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1557244d1ed4490185d85c2f7c028eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.888360 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40da590ead8491788f59f1711e7e525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.888736 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c2a94a4d794f2aa94b77885812831f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.889138 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b81edd27d14611b3a66c547117c532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.889566 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546831050f84a91b8e4df5b96b1be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.893249 1994 ts_tablet_manager.cc:1929] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:07.893400 1994 log.cc:1199] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/28e463032d0744cc88d011accbebfe1f
I20260619 19:54:07.893743 1994 ts_tablet_manager.cc:1950] T 28e463032d0744cc88d011accbebfe1f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:07.894688 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 28e463032d0744cc88d011accbebfe1f (table default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]) successfully deleted
W20260619 19:54:07.895335 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 10c73b679e394f31b9e5d51681e06976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c73b679e394f31b9e5d51681e06976 already in progress: creating tablet
W20260619 19:54:07.895874 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 74d8cd01251f4cfa93ecddb391c1c91e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74d8cd01251f4cfa93ecddb391c1c91e already in progress: creating tablet
I20260619 19:54:07.896142 1994 tablet_replica.cc:333] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:07.908988 2343 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.909157 2343 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.909794 2343 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.910722 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:07.911353 2026 log.cc:1199] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a868706c23e948e5ba3320ceb4a19cf8
I20260619 19:54:07.911743 2026 ts_tablet_manager.cc:1950] T a868706c23e948e5ba3320ceb4a19cf8 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:07.912072 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 120) took 6652 ms. Trace:
I20260619 19:54:07.912199 2026 rpcz_store.cc:276] 0619 19:54:01.259817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.259865 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:07.483677 (+6223812us) ts_tablet_manager.cc:1151] Deleting tablet a868706c23e948e5ba3320ceb4a19cf8
0619 19:54:07.483686 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.564469 (+ 80783us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.657141 (+ 92672us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:07.912059 (+254918us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6223606}
I20260619 19:54:07.912846 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet a868706c23e948e5ba3320ceb4a19cf8 (table default.Table_2e44172c64aa41b6aabeefb64c938a21 [id=f0136eccfb674a15bb48064b19eef96e]) successfully deleted
I20260619 19:54:07.917315 2324 leader_election.cc:290] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:07.917990 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]) successfully deleted
I20260619 19:54:07.921562 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2d419a6e5d466e97df971b31640519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.921658 887 tablet_service.cc:1511] Processing CreateTablet for tablet b546831050f84a91b8e4df5b96b1be14 (DEFAULT_TABLE table=default.Table_d5de5ed4c25e4cacadac49134c646e84 [id=26c675f2171940f089b3dc8e2e1300f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.922041 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546831050f84a91b8e4df5b96b1be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.924775 1208 tablet_bootstrap.cc:492] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:07.925572 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bc861cb7d941f380671105fd338538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.925755 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcc9a948562461092da5bb781854652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.929548 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8604e0a1655c4d7da4100dd304c0d2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.929885 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb499b2e5374912a10bc6379dba55b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.932897 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67faf5d554074ab3bdf79075f649f4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.935288 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e17caefca44171b451258424497769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.940927 1208 tablet_bootstrap.cc:654] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.941339 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb37eed280c48e8931b6fc94f7600dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.953655 891 tablet_service.cc:1511] Processing CreateTablet for tablet f40da590ead8491788f59f1711e7e525 (DEFAULT_TABLE table=default.Table_dce56a19d6f24028956f0904bad88cd5 [id=d9e476d02b9f43d18edb3b857aff0d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.954252 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40da590ead8491788f59f1711e7e525. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:07.957315 859 consensus_peers.cc:597] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f25c0378a6f4e9ea1a62d98f27778ee. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:07.957856 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 951dfc443c4944d0a44864184e0da9d4 (DEFAULT_TABLE table=default.Table_ece67ba490164fbda8ded59ca42a5b12 [id=94be851bc6834ed6aee099a5917e1ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:07.958326 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951dfc443c4944d0a44864184e0da9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:07.959571 2618 raft_consensus.cc:493] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:07.959810 2618 raft_consensus.cc:515] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.960875 2618 leader_election.cc:290] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:07.967886 720 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:07.977564 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 268) took 3958 ms. Trace:
I20260619 19:54:07.977809 1973 rpcz_store.cc:276] 0619 19:54:04.019367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.019427 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:07.635552 (+3616125us) ts_tablet_manager.cc:1151] Deleting tablet 4cd6b786bd844781af7fdc5849e90009
0619 19:54:07.977352 (+341800us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.977532 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3615865}
I20260619 19:54:07.978576 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 270) took 3928 ms. Trace:
I20260619 19:54:07.980386 1200 ts_tablet_manager.cc:1434] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.251s user 0.002s sys 0.000s
I20260619 19:54:07.980527 1201 tablet_bootstrap.cc:492] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:07.980727 1201 ts_tablet_manager.cc:1403] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.361s user 0.003s sys 0.001s
I20260619 19:54:07.981859 1201 raft_consensus.cc:359] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.982226 1201 raft_consensus.cc:385] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:07.982342 1201 raft_consensus.cc:740] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:07.982718 1201 consensus_queue.cc:260] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:07.983613 1201 ts_tablet_manager.cc:1434] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:07.984108 1201 tablet_bootstrap.cc:492] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:07.986371 1201 tablet_bootstrap.cc:654] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:07.987648 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d6a6ffdcd55d4db6870fe032f72ab3b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6a6ffdcd55d4db6870fe032f72ab3b1 already in progress: creating tablet
I20260619 19:54:07.990393 1994 raft_consensus.cc:2243] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:07.990612 1994 raft_consensus.cc:2272] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:07.991231 1994 ts_tablet_manager.cc:1916] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:07.991268 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 222185us
I20260619 19:54:07.993516 1973 rpcz_store.cc:276] 0619 19:54:04.050151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.050746 (+ 595us) service_pool.cc:224] Handling call
0619 19:54:07.978433 (+3927687us) ts_tablet_manager.cc:1151] Deleting tablet f658e85be0c843f2b02e4567a80521c4
0619 19:54:07.978446 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.978558 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3927481}
I20260619 19:54:07.994097 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 273) took 3794 ms. Trace:
I20260619 19:54:07.994191 1973 rpcz_store.cc:276] 0619 19:54:04.199419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.199490 (+ 71us) service_pool.cc:224] Handling call
0619 19:54:07.993913 (+3794423us) ts_tablet_manager.cc:1151] Deleting tablet 9d905e7076014c818e1fb1ef09c15342
0619 19:54:07.993929 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.994077 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3794173}
I20260619 19:54:07.994594 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 274) took 3793 ms. Trace:
I20260619 19:54:07.994676 1973 rpcz_store.cc:276] 0619 19:54:04.201530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.201690 (+ 160us) service_pool.cc:224] Handling call
0619 19:54:07.994450 (+3792760us) ts_tablet_manager.cc:1151] Deleting tablet d703c5c2820642aab6dd1e500ce1e9fd
0619 19:54:07.994461 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.994577 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3792552}
I20260619 19:54:07.995050 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 280) took 3615 ms. Trace:
I20260619 19:54:07.995177 1973 rpcz_store.cc:276] 0619 19:54:04.379714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.379775 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:07.994924 (+3615149us) ts_tablet_manager.cc:1151] Deleting tablet e68808ad4f64475782f8fba579fdb8bd
0619 19:54:07.994936 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.995033 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3610802}
I20260619 19:54:07.995658 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 282) took 3531 ms. Trace:
I20260619 19:54:07.995744 1973 rpcz_store.cc:276] 0619 19:54:04.463780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.469973 (+ 6193us) service_pool.cc:224] Handling call
0619 19:54:07.995441 (+3525468us) ts_tablet_manager.cc:1151] Deleting tablet 01fe4b37c74b4fb496f2842407c65eb1
0619 19:54:07.995452 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.995639 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3525127}
I20260619 19:54:07.996373 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 283) took 3434 ms. Trace:
I20260619 19:54:07.996937 1200 tablet_bootstrap.cc:492] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:07.999617 1200 tablet_bootstrap.cc:654] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:07.989578 897 tablet_service.cc:1511] Processing CreateTablet for tablet 1557244d1ed4490185d85c2f7c028eb1 (DEFAULT_TABLE table=default.Table_a2e31faf36224311b5da1fad2378c2b3 [id=17316b2f71a54927a1efe4211f354ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.010646 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1557244d1ed4490185d85c2f7c028eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.015554 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b88dd7d19514e83857e2c6108291b9f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:08.016165 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b546831050f84a91b8e4df5b96b1be14
I20260619 19:54:08.026984 900 tablet_service.cc:1558] Processing DeleteTablet for tablet b546831050f84a91b8e4df5b96b1be14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:07.993140 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 121) took 6730 ms. Trace:
I20260619 19:54:08.007057 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d895be304fcf445e9a4d2d8242becdd5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.030154 2026 rpcz_store.cc:276] 0619 19:54:01.262896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.262977 (+ 81us) service_pool.cc:224] Handling call
0619 19:54:07.992981 (+6730004us) ts_tablet_manager.cc:1151] Deleting tablet cbec819571854db8a46daae15b9127bd
0619 19:54:07.992996 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.993114 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6729672}
I20260619 19:54:08.032588 2026 tablet_replica.cc:333] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:08.032877 2026 raft_consensus.cc:2243] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:08.033380 2026 raft_consensus.cc:2272] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:08.035843 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet cbec819571854db8a46daae15b9127bd because the tablet was not found. No further retry: Not found: Tablet not found: cbec819571854db8a46daae15b9127bd
I20260619 19:54:08.036216 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]) successfully deleted
W20260619 19:54:08.036936 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1ca68b755bf841509b6ffcfbe212278c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca68b755bf841509b6ffcfbe212278c already in progress: creating tablet
W20260619 19:54:08.052723 859 consensus_peers.cc:597] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd9c959792fa48e89b669520f7332b26. This is attempt 6: this message will repeat every 5th retry.
W20260619 19:54:08.052911 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47eb6580ead349188460a0fb8ada1262 consensus state has no leader
I20260619 19:54:08.058876 2026 ts_tablet_manager.cc:1916] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.062516 525 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 1 got 0
I20260619 19:54:08.078646 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e1f6da4a6cf4417813e688ab868bfe5" } new_table_name: "default.Table_e02ea57361e747bc95c820d5eccb8964" modify_external_catalogs: true
I20260619 19:54:08.080348 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c83114cdb88a48a79cc3c49817a51222"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.080967 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c83114cdb88a48a79cc3c49817a51222 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.082792 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_153389b9465647c6b228f0ade84d6853" } new_table_name: "default.Table_ea0540509a4445559c0986f276263022" modify_external_catalogs: true
I20260619 19:54:08.000429 1994 ts_tablet_manager.cc:1929] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:08.018229 996 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:08.019690 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet b546831050f84a91b8e4df5b96b1be14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:08.019706 2593 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:08.087764 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 69539.7us
I20260619 19:54:08.087960 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8080156f951b428fac94858452041919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.088814 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8080156f951b428fac94858452041919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.090649 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_bbf9c52ad68e4f60911fce508327d27e" } new_table_name: "default.Table_6728f3a489334e6998bf316b5cfc7859" modify_external_catalogs: true
I20260619 19:54:08.090713 2570 tablet.cc:1724] T 6c396a42add84c62acecb9bbb5d57f1d P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:08.091221 2615 raft_consensus.cc:493] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.091379 2615 raft_consensus.cc:515] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.092150 2615 leader_election.cc:290] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:08.093322 996 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.094403 996 leader_election.cc:304] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:08.094635 996 raft_consensus.cc:2686] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:08.094646 2632 tablet.cc:1724] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.096560 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ea0c90c0f0554b60a2b9e8e37c4fe43e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:08.097653 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:08.097875 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea0c90c0f0554b60a2b9e8e37c4fe43e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:08.106616 996 leader_election.cc:343] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.118402 2570 tablet.cc:1724] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.124042 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b12efc4264ae48e29fbcd446ea161307
I20260619 19:54:08.125104 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6163515494404bd0aeba25314d70b905"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.125881 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6163515494404bd0aeba25314d70b905 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.127161 1994 log.cc:1199] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:08.127743 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet b12efc4264ae48e29fbcd446ea161307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:08.128288 1994 ts_tablet_manager.cc:1950] T d895be304fcf445e9a4d2d8242becdd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:08.129580 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d895be304fcf445e9a4d2d8242becdd5 (table default.Table_9fa831d3fbc74033a57818cdf0c65c72 [id=f097182abb8d4815befec43f3b218b90]) successfully deleted
W20260619 19:54:08.130038 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a9bdcbcf35e14a7ca2c0241478d278cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9bdcbcf35e14a7ca2c0241478d278cd already in progress: creating tablet
W20260619 19:54:08.130383 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b546831050f84a91b8e4df5b96b1be14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b546831050f84a91b8e4df5b96b1be14 already in progress: creating tablet
W20260619 19:54:08.130749 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b12efc4264ae48e29fbcd446ea161307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b12efc4264ae48e29fbcd446ea161307 already in progress: creating tablet
I20260619 19:54:08.137451 2611 consensus_queue.cc:1048] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:08.138013 1201 tablet_bootstrap.cc:492] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:08.138285 1201 ts_tablet_manager.cc:1403] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.154s user 0.037s sys 0.019s
I20260619 19:54:08.139635 1201 raft_consensus.cc:359] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.139911 1201 raft_consensus.cc:385] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.140113 1201 raft_consensus.cc:740] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.140419 1201 consensus_queue.cc:260] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.141108 1201 ts_tablet_manager.cc:1434] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:08.141433 1201 tablet_bootstrap.cc:492] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:08.143674 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
W20260619 19:54:08.145475 2434 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Append to log took a long time: real 0.159s user 0.004s sys 0.000s
I20260619 19:54:08.148523 1201 tablet_bootstrap.cc:654] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.004560 785 raft_consensus.cc:1275] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Refusing update from remote peer e78a44e2c8824fe7bce462e9d33f660c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:54:08.038043 2324 raft_consensus.cc:493] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.038002 2622 raft_consensus.cc:493] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.154202 2324 raft_consensus.cc:515] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.154322 2622 raft_consensus.cc:515] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.154824 2622 leader_election.cc:290] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.154953 2622 raft_consensus.cc:493] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:08.154824 2324 leader_election.cc:290] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.155045 2622 raft_consensus.cc:515] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:08.155537 2622 leader_election.cc:290] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.045383 2516 raft_consensus.cc:493] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.155877 2516 raft_consensus.cc:515] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.156383 2516 leader_election.cc:290] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.165696 2611 consensus_queue.cc:1048] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:08.168596 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca02c454eec840eb9289950b6da7b131 consensus state has no leader
I20260619 19:54:08.171406 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_54977c57c4894a379cf160aba236e9e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.045653 719 leader_election.cc:343] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.071810 2314 consensus_queue.cc:1048] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:08.172106 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54977c57c4894a379cf160aba236e9e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.072837 2527 raft_consensus.cc:493] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.172518 2527 raft_consensus.cc:515] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.173242 2527 leader_election.cc:290] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.174063 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c40742ccfff440839dde7425edcac1d8" } modify_external_catalogs: true
I20260619 19:54:08.174296 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c40742ccfff440839dde7425edcac1d8" } modify_external_catalogs: true
W20260619 19:54:08.174522 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 128872us
I20260619 19:54:08.174762 719 leader_election.cc:304] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.177320 2527 raft_consensus.cc:2804] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.177404 2527 raft_consensus.cc:493] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.177479 2527 raft_consensus.cc:3060] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.180615 2527 raft_consensus.cc:515] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.181324 2527 leader_election.cc:290] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.182318 719 leader_election.cc:343] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:08.183058 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a977e889c36b434388fc7a3a5cd42e8c consensus state has no leader
I20260619 19:54:08.082844 1208 tablet_bootstrap.cc:492] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:08.096390 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:08.184711 996 leader_election.cc:343] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.184907 996 leader_election.cc:304] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:08.185474 1208 ts_tablet_manager.cc:1403] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.261s user 0.006s sys 0.006s
I20260619 19:54:08.185652 2611 raft_consensus.cc:2749] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:08.185873 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7e1870963343443fac9b7d18ea95ac26" } modify_external_catalogs: true
I20260619 19:54:08.186133 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7e1870963343443fac9b7d18ea95ac26" } modify_external_catalogs: true
W20260619 19:54:08.189920 858 consensus_peers.cc:597] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4132f28c434492cbddc8da7d8075c43. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.190563 1208 raft_consensus.cc:359] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.148963 2570 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.148523 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b12efc4264ae48e29fbcd446ea161307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.197572 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b8468df4a449d088f47b3b150ce54a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:08.199092 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 4cd6b786bd844781af7fdc5849e90009 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd6b786bd844781af7fdc5849e90009 already in progress: creating tablet
W20260619 19:54:08.200009 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f658e85be0c843f2b02e4567a80521c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f658e85be0c843f2b02e4567a80521c4 already in progress: creating tablet
W20260619 19:54:08.200229 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9d905e7076014c818e1fb1ef09c15342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d905e7076014c818e1fb1ef09c15342 already in progress: creating tablet
W20260619 19:54:08.200906 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d703c5c2820642aab6dd1e500ce1e9fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d703c5c2820642aab6dd1e500ce1e9fd already in progress: creating tablet
W20260619 19:54:08.201143 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e68808ad4f64475782f8fba579fdb8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e68808ad4f64475782f8fba579fdb8bd already in progress: creating tablet
W20260619 19:54:08.201393 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 01fe4b37c74b4fb496f2842407c65eb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01fe4b37c74b4fb496f2842407c65eb1 already in progress: creating tablet
I20260619 19:54:08.208356 920 raft_consensus.cc:3060] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.209167 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_58686549f5974cedb2fc3a15c08d9207" } modify_external_catalogs: true
I20260619 19:54:08.209419 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_58686549f5974cedb2fc3a15c08d9207" } modify_external_catalogs: true
I20260619 19:54:08.212494 2611 consensus_queue.cc:1048] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:08.217062 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c679a253254d449fb57fc458acab7b86 consensus state has no leader
I20260619 19:54:08.217872 2570 tablet.cc:1724] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:08.219640 2611 raft_consensus.cc:493] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.219799 2611 raft_consensus.cc:515] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.220577 2611 leader_election.cc:290] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:08.222031 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3064bd01ced9429d82ce449e8afc4999" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:08.222993 996 leader_election.cc:343] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.223377 1208 raft_consensus.cc:385] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.221423 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3064bd01ced9429d82ce449e8afc4999" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.223592 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0bc540dd0cf9434fb277800208ee0d23" } new_table_name: "default.Table_3dedb27eb07a4f858fdd9e39751a063e" modify_external_catalogs: true
W20260619 19:54:08.224191 996 leader_election.cc:343] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.224557 996 leader_election.cc:304] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:08.224865 2611 raft_consensus.cc:2749] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:08.191676 1973 rpcz_store.cc:276] 0619 19:54:04.561986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.562050 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:07.995971 (+3433921us) ts_tablet_manager.cc:1151] Deleting tablet 2718b9619524430388f0760485d8e4be
0619 19:54:07.995980 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:07.996273 (+ 293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3433732}
I20260619 19:54:08.225178 1973 tablet_replica.cc:333] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:08.225476 1973 raft_consensus.cc:2243] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:08.226269 1973 raft_consensus.cc:2272] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.228422 1973 ts_tablet_manager.cc:1916] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.229118 2539 raft_consensus.cc:493] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.229282 2539 raft_consensus.cc:515] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.230036 2539 leader_election.cc:290] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.231164 859 leader_election.cc:343] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1202fe45d0964d368989f969e95f880d
I20260619 19:54:08.241518 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d7e553f15ae24ab3bf8ebd401bc9d588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.242524 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.242760 2539 raft_consensus.cc:493] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.242937 2539 raft_consensus.cc:515] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.243695 2539 leader_election.cc:290] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.244696 859 leader_election.cc:343] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:08.246447 1201 tablet_bootstrap.cc:492] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:08.246585 1201 ts_tablet_manager.cc:1403] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.105s user 0.033s sys 0.044s
I20260619 19:54:08.247422 1201 raft_consensus.cc:359] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.247666 1201 raft_consensus.cc:385] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.247749 1201 raft_consensus.cc:740] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.248335 1201 consensus_queue.cc:260] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.248886 1201 ts_tablet_manager.cc:1434] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:08.249174 1201 tablet_bootstrap.cc:492] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:08.250613 1200 tablet_bootstrap.cc:492] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:08.250769 1200 ts_tablet_manager.cc:1403] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.254s user 0.004s sys 0.000s
I20260619 19:54:08.251734 1201 tablet_bootstrap.cc:654] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.252193 2539 raft_consensus.cc:493] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.252336 2539 raft_consensus.cc:515] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.253051 2539 leader_election.cc:290] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.253299 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 76ffe451545c4af6821971384fce483e from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:08.253935 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e9d63130dc4e4f208012f0bff14d0489"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.254472 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9d63130dc4e4f208012f0bff14d0489 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:08.254971 859 leader_election.cc:343] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:54:08.263319 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.264317 2539 raft_consensus.cc:493] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:08.264374 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26355bc6b5c147a88c14a9f053b4e1f3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.264549 919 raft_consensus.cc:2468] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:08.264503 2539 raft_consensus.cc:515] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.265866 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f8635b919a44a8a1e5fe48420ca4b7" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.265867 2539 leader_election.cc:290] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.267514 859 leader_election.cc:343] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 221cc85629ca41e9ad71adfe0beb392a
I20260619 19:54:08.231004 1208 raft_consensus.cc:740] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.245229 2314 raft_consensus.cc:493] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.273969 2314 raft_consensus.cc:515] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.274082 1208 consensus_queue.cc:260] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.274740 2314 leader_election.cc:290] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:08.274878 1208 ts_tablet_manager.cc:1434] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.089s user 0.001s sys 0.001s
I20260619 19:54:08.275214 1208 tablet_bootstrap.cc:492] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:08.277456 884 tablet_service.cc:1511] Processing CreateTablet for tablet 8c10ee4d02fa48fdb10e3e5110f85cad (DEFAULT_TABLE table=default.Table_61001685074b47918bcf2235c53aee59 [id=db9584a57c4e4d2f8e30a9d1b36d28ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.277706 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:08.277907 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c10ee4d02fa48fdb10e3e5110f85cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.277966 526 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:08.279057 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f5fef4f5041d18f399cf9eab4d63f (DEFAULT_TABLE table=default.Table_99b386e9a89b483e91c5ad3fe8f59148 [id=d4bacf74e5dc4473b2000b3f2f88650b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.279392 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f5fef4f5041d18f399cf9eab4d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.279343 896 tablet_service.cc:1511] Processing CreateTablet for tablet a4f175d5443c406590f373fc0c73c230 (DEFAULT_TABLE table=default.Table_cb87313898af41e9bb3b7ecbd9e58203 [id=0f6a89a8d303448891d933a00ff1c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.279618 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f175d5443c406590f373fc0c73c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.279979 530 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_4e0bca12b7834af7a6690074fa09e1e8 [id=af3f4335b675482195a6511647ca2871] alter complete (version 1)
I20260619 19:54:08.280054 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 6c42d47f65e844ea903cb544db21dd86 (DEFAULT_TABLE table=default.Table_f4f2b36b8c6849648d4c11f124c441d7 [id=520d7231e7a44fc0b2638313da114940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.280403 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c42d47f65e844ea903cb544db21dd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.280464 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 8c10ee4d02fa48fdb10e3e5110f85cad (DEFAULT_TABLE table=default.Table_61001685074b47918bcf2235c53aee59 [id=db9584a57c4e4d2f8e30a9d1b36d28ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.280839 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c10ee4d02fa48fdb10e3e5110f85cad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:08.281926 530 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 207) took 922 ms (client timeout 1000 ms). Trace:
I20260619 19:54:08.282063 1035 tablet_service.cc:1511] Processing CreateTablet for tablet a4f175d5443c406590f373fc0c73c230 (DEFAULT_TABLE table=default.Table_cb87313898af41e9bb3b7ecbd9e58203 [id=0f6a89a8d303448891d933a00ff1c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.282358 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f175d5443c406590f373fc0c73c230. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:08.282020 530 rpcz_store.cc:269] 0619 19:54:07.359216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.378353 (+ 19137us) service_pool.cc:224] Handling call
0619 19:54:07.382134 (+ 3781us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:08.281871 (+899737us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:07.869081 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:07.869210 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:07.869217 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:07.869220 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:07.869343 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:07.869356 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:07.869363 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:07.869480 (+ 117us) tablet.cc:701] Row locks acquired
0619 19:54:07.869482 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:07.869520 (+ 38us) write_op.cc:270] Start()
0619 19:54:07.869571 (+ 51us) write_op.cc:276] Timestamp: P: 1781898847869455 usec, L: 0
0619 19:54:07.869575 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:07.869770 (+ 195us) log.cc:844] Serialized 913 byte log entry
0619 19:54:08.051207 (+181437us) op_driver.cc:464] REPLICATION: finished
0619 19:54:08.052031 (+ 824us) write_op.cc:301] APPLY: starting
0619 19:54:08.052046 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:08.052093 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:08.052138 (+ 45us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:08.052223 (+ 85us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:08.052260 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:08.052273 (+ 13us) write_op.cc:312] APPLY: finished
0619 19:54:08.052337 (+ 64us) log.cc:844] Serialized 29 byte log entry
0619 19:54:08.052385 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:08.052403 (+ 18us) write_op.cc:454] Released schema lock
0619 19:54:08.052411 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0619 19:54:08.059685 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:08.059841 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:08.059849 (+ 8us) write_op.cc:435] Acquired schema lock
0619 19:54:08.059985 (+ 136us) tablet.cc:662] Decoding operations
0619 19:54:08.060376 (+ 391us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:08.060422 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:08.060429 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:08.060573 (+ 144us) tablet.cc:701] Row locks acquired
0619 19:54:08.060577 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:54:08.060641 (+ 64us) write_op.cc:270] Start()
0619 19:54:08.060688 (+ 47us) write_op.cc:276] Timestamp: P: 1781898848060606 usec, L: 0
0619 19:54:08.060693 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 19:54:08.085212 (+ 24519us) log.cc:844] Serialized 356 byte log entry
0619 19:54:08.085455 (+ 243us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fd74f1a9f22 00007fd75058b305 00007fd750589e29 00007fd750592250 00007fd75059205d 0000000000aa681c 00007fd7431749ff 00007fd743177d1b 00007fd743177b98 0000000000aa681c
0619 19:54:08.129359 (+ 43904us) op_driver.cc:464] REPLICATION: finished
0619 19:54:08.131147 (+ 1788us) write_op.cc:301] APPLY: starting
0619 19:54:08.131167 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:08.131216 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:08.131219 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:08.131275 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:08.131311 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:08.131320 (+ 9us) write_op.cc:312] APPLY: finished
0619 19:54:08.131409 (+ 89us) log.cc:844] Serialized 23 byte log entry
0619 19:54:08.132437 (+ 1028us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:08.132461 (+ 24us) write_op.cc:454] Released schema lock
0619 19:54:08.132469 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:08.139887 (+ 7418us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:08.139895 (+ 8us) write_op.cc:454] Released schema lock
0619 19:54:08.140936 (+ 1041us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x6170000b2ef0. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f0adeb8 00007fd74f0b7bd1 00007fd74f0b78bd 0000000000aa681c 00007fd7431749ff 00007fd743177d1b 00007fd743177b98 0000000000aa681c 00007fd743153f48
Metrics: {"reported_tablets":16,"spinlock_wait_cycles":5992704,"child_traces":[["op",{"apply.queue_time_us":780,"apply.run_cpu_time_us":447,"apply.run_wall_time_us":447,"num_ops":2,"prepare.queue_time_us":179879,"prepare.run_cpu_time_us":803,"prepare.run_wall_time_us":2751,"replication_time_us":181608}],["op",{"apply.queue_time_us":286,"apply.run_cpu_time_us":466,"apply.run_wall_time_us":1729,"num_ops":1,"prepare.queue_time_us":2853,"prepare.run_cpu_time_us":12696,"prepare.run_wall_time_us":80222,"raft.queue_time_us":31380,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":24068,"replication_time_us":68638,"spinlock_wait_cycles":110761984,"thread_start_us":54323,"threads_started":1}]]}
W20260619 19:54:08.284909 525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:53243 (request call id 201) took 896 ms (client timeout 1000 ms). Trace:
W20260619 19:54:08.284996 525 rpcz_store.cc:269] 0619 19:54:07.388542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.428937 (+ 40395us) service_pool.cc:224] Handling call
0619 19:54:07.434934 (+ 5997us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:08.284858 (+849924us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":11155328}
I20260619 19:54:08.287339 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f5fef4f5041d18f399cf9eab4d63f (DEFAULT_TABLE table=default.Table_99b386e9a89b483e91c5ad3fe8f59148 [id=d4bacf74e5dc4473b2000b3f2f88650b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.287662 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f5fef4f5041d18f399cf9eab4d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.287834 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7fce2193633d4d80b56750d4df0c8e90" } modify_external_catalogs: true
I20260619 19:54:08.288000 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7fce2193633d4d80b56750d4df0c8e90" } modify_external_catalogs: true
I20260619 19:54:08.289073 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.289567 749 tablet_service.cc:1511] Processing CreateTablet for tablet 53f548f7a6c44be998687058a6ba88ce (DEFAULT_TABLE table=default.Table_1c6a727020ed49ac83911dca4c46a392 [id=95d401b88c8c4f819e4956c88a0ad7ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.289541 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_80b5f0844e274a0f9bf20c3ac5445137"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:08.289904 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f548f7a6c44be998687058a6ba88ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:08.290032 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80b5f0844e274a0f9bf20c3ac5445137 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.295737 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.295894 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.296136 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74949d09466f42e2852389e10192989d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:08.296260 917 raft_consensus.cc:3060] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.298719 2633 tablet.cc:1724] T 6c396a42add84c62acecb9bbb5d57f1d P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:08.299000 917 raft_consensus.cc:2468] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:08.300089 887 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.302860 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7c2adacdb99143a0a08280f26b2502ec" } new_table_name: "default.Table_48bc9c3ec6e24b32a9167c87711237f9" modify_external_catalogs: true
I20260619 19:54:08.304236 2638 tablet.cc:1724] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.308550 2635 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.314790 2632 tablet.cc:1724] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.318995 897 tablet_service.cc:1511] Processing CreateTablet for tablet 6c42d47f65e844ea903cb544db21dd86 (DEFAULT_TABLE table=default.Table_f4f2b36b8c6849648d4c11f124c441d7 [id=520d7231e7a44fc0b2638313da114940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.319998 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c42d47f65e844ea903cb544db21dd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.321364 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.321663 1056 raft_consensus.cc:2393] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:08.323197 2610 raft_consensus.cc:493] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.323329 2610 raft_consensus.cc:515] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.324009 2610 leader_election.cc:290] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:08.331636 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc57b42a97fa437b93842f7cd379dbb7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.333158 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc57b42a97fa437b93842f7cd379dbb7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.333453 781 raft_consensus.cc:2468] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:08.333964 996 leader_election.cc:304] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:08.334329 996 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.334830 2615 raft_consensus.cc:2804] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.334944 2615 raft_consensus.cc:493] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.335027 2615 raft_consensus.cc:3060] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.338932 2615 raft_consensus.cc:515] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.342594 2637 tablet.cc:1724] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:08.343387 2615 leader_election.cc:290] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:08.344776 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.345242 1056 raft_consensus.cc:2468] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:08.352739 749 tablet_service.cc:1558] Processing DeleteTablet for tablet a9bdcbcf35e14a7ca2c0241478d278cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.251806 1200 raft_consensus.cc:359] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.356671 2539 raft_consensus.cc:493] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.356978 2539 raft_consensus.cc:515] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.356878 2632 tablet.cc:1724] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:08.358345 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ebb013fe22fd4021a84e85813ca7484a (DEFAULT_TABLE table=default.Table_ec7afef29b0741c89176856851dbff59 [id=2cc067b1e8a240ebb61cdce15977180a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.359525 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 9d49b16f9b9e4b79ae0045c3f0542d23 (DEFAULT_TABLE table=default.Table_d663e07e37c74d3b97d09e5f020d2586 [id=60647013b3054bc5a88db110c26df578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.359743 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb013fe22fd4021a84e85813ca7484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.360553 887 tablet_service.cc:1511] Processing CreateTablet for tablet 9d49b16f9b9e4b79ae0045c3f0542d23 (DEFAULT_TABLE table=default.Table_d663e07e37c74d3b97d09e5f020d2586 [id=60647013b3054bc5a88db110c26df578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.360915 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d49b16f9b9e4b79ae0045c3f0542d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.362080 1200 raft_consensus.cc:385] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.362155 1200 raft_consensus.cc:740] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.363235 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 42027d2587914413bb674025df6503c4 (DEFAULT_TABLE table=default.Table_2f513b752aa747ad983090c68ec1cdd9 [id=14e0854a75fb43c58d2cada284017772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.363373 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f4b47d0e7451d91add5a81330bc7d (DEFAULT_TABLE table=default.Table_0b95ccb115dc4f94b0db2f904eda5e2c [id=13a54bc3bdb04d96afdbbc9daf0a6781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.363566 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42027d2587914413bb674025df6503c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.363803 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 6da56cd05ea740eb949abb9bba60760a (DEFAULT_TABLE table=default.Table_99391b7e2a8246d8a5c13ab7e94001e0 [id=c3d8ee2b3fcf494c841aae2384e56e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.364127 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da56cd05ea740eb949abb9bba60760a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.367269 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f4b47d0e7451d91add5a81330bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.367488 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 0168c82ece6e4ce683265229a5d4c6ea (DEFAULT_TABLE table=default.Table_40536a5e373e47c9b8768101493707a2 [id=e37abdd24aa54863a0fa7a6dfdbdcff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.367946 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0168c82ece6e4ce683265229a5d4c6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.371646 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d49b16f9b9e4b79ae0045c3f0542d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.374118 749 tablet_service.cc:1511] Processing CreateTablet for tablet 2090db1e6d5646bbbef77ab6776fe3d2 (DEFAULT_TABLE table=default.Table_f9c88e691c944cbb8c6e440fb6e88f4c [id=32294cc91a7345778d1160121951a03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.374524 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2090db1e6d5646bbbef77ab6776fe3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.376384 900 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f4b47d0e7451d91add5a81330bc7d (DEFAULT_TABLE table=default.Table_0b95ccb115dc4f94b0db2f904eda5e2c [id=13a54bc3bdb04d96afdbbc9daf0a6781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.376788 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f4b47d0e7451d91add5a81330bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.381361 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc57b42a97fa437b93842f7cd379dbb7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:08.381547 780 raft_consensus.cc:3060] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.376394 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0168c82ece6e4ce683265229a5d4c6ea (DEFAULT_TABLE table=default.Table_40536a5e373e47c9b8768101493707a2 [id=e37abdd24aa54863a0fa7a6dfdbdcff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.383227 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0168c82ece6e4ce683265229a5d4c6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.383880 894 tablet_service.cc:1511] Processing CreateTablet for tablet 6da56cd05ea740eb949abb9bba60760a (DEFAULT_TABLE table=default.Table_99391b7e2a8246d8a5c13ab7e94001e0 [id=c3d8ee2b3fcf494c841aae2384e56e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.384068 780 raft_consensus.cc:2468] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:08.384200 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da56cd05ea740eb949abb9bba60760a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.384897 746 tablet_service.cc:1511] Processing CreateTablet for tablet d3a10b360439454f962bcfef44f41a05 (DEFAULT_TABLE table=default.Table_8b584703372a4447845a8fcfeabeaf0c [id=7bb8820b88ba4fe4a7e538066cc2dbfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.385228 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a10b360439454f962bcfef44f41a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.389241 2548 raft_consensus.cc:493] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:08.389379 2548 raft_consensus.cc:515] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.390148 2548 leader_election.cc:290] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.391155 2539 leader_election.cc:290] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.391722 859 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
W20260619 19:54:08.392105 859 leader_election.cc:343] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fbc952b283d94035be1f86f3b90382b6
I20260619 19:54:08.395643 897 tablet_service.cc:1511] Processing CreateTablet for tablet ebb013fe22fd4021a84e85813ca7484a (DEFAULT_TABLE table=default.Table_ec7afef29b0741c89176856851dbff59 [id=2cc067b1e8a240ebb61cdce15977180a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:08.396409 859 consensus_peers.cc:597] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe14a1f35cf14ca480221ee412c087da. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.380316 1200 consensus_queue.cc:260] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.396905 1200 ts_tablet_manager.cc:1434] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.146s user 0.002s sys 0.000s
I20260619 19:54:08.397050 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb013fe22fd4021a84e85813ca7484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.397212 1200 tablet_bootstrap.cc:492] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:08.398634 1200 tablet_bootstrap.cc:654] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.384896 996 leader_election.cc:304] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:08.393761 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.399679 1059 raft_consensus.cc:2468] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:08.399964 2611 raft_consensus.cc:2804] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:08.400074 2611 raft_consensus.cc:697] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:08.400414 2611 consensus_queue.cc:237] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.394053 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3354ae6dd46bd9c5414d4c4a720a1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.404424 746 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6cc12c429f4857a67d77c697e6dc67 (DEFAULT_TABLE table=default.Table_9c97c6559f804b4eb92351eb88ee1e38 [id=85ac48c937424d8a8f7735c3cba437ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.404820 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6cc12c429f4857a67d77c697e6dc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.409819 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc57b42a97fa437b93842f7cd379dbb7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:08.412722 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b57381b0a02141459dc582196d0c0095
W20260619 19:54:08.413396 996 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.414058 1208 tablet_bootstrap.cc:700] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent opening tablet: real 0.137s user 0.002s sys 0.000s
I20260619 19:54:08.415196 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b57381b0a02141459dc582196d0c0095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:08.415465 1994 tablet_replica.cc:333] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:08.415679 1994 raft_consensus.cc:2243] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:08.416093 1994 raft_consensus.cc:2272] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:08.416553 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4bb499b2e5374912a10bc6379dba55b4 consensus state has no leader
I20260619 19:54:08.416869 1994 ts_tablet_manager.cc:1916] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.417464 894 tablet_service.cc:1558] Processing DeleteTablet for tablet b57381b0a02141459dc582196d0c0095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.419093 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8f50b9f07f3b4d00b500adef6c67e36d (DEFAULT_TABLE table=default.Table_c59b58766d634684a17e2a7591efb8f4 [id=b138e4c3fea745c0b5ea2a27dd4ee675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.419552 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f50b9f07f3b4d00b500adef6c67e36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.420543 887 tablet_service.cc:1511] Processing CreateTablet for tablet 8f50b9f07f3b4d00b500adef6c67e36d (DEFAULT_TABLE table=default.Table_c59b58766d634684a17e2a7591efb8f4 [id=b138e4c3fea745c0b5ea2a27dd4ee675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.421021 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f50b9f07f3b4d00b500adef6c67e36d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:08.423240 859 consensus_peers.cc:597] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28e463032d0744cc88d011accbebfe1f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.423524 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_41bf6e80789b46a3b057c38ee5d318d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.424192 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41bf6e80789b46a3b057c38ee5d318d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.424082 755 tablet_service.cc:1511] Processing CreateTablet for tablet e89f230ad9644e8f8bedfb0b54399712 (DEFAULT_TABLE table=default.Table_41a860a9f0aa442fa44bb1a677587282 [id=537364fb23d046cea541f5fd42dc20d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.427733 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89f230ad9644e8f8bedfb0b54399712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.428735 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e8c3aef303b94d58aaa24917399ac240 (table default.Table_a3f0b91866884789b9a1ddc76a59ca8f [id=8de7c14aec0549bfa81434211594c5eb]). Expected version 2 got 0
I20260619 19:54:08.429126 527 catalog_manager.cc:5696] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:08.429739 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf]). Expected version 3 got 0
I20260619 19:54:08.430675 894 tablet_service.cc:1511] Processing CreateTablet for tablet 42027d2587914413bb674025df6503c4 (DEFAULT_TABLE table=default.Table_2f513b752aa747ad983090c68ec1cdd9 [id=14e0854a75fb43c58d2cada284017772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.431092 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42027d2587914413bb674025df6503c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.434437 1208 tablet_bootstrap.cc:654] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.442132 900 tablet_service.cc:1511] Processing CreateTablet for tablet 140de873b1094bf4ac9fa29507722300 (DEFAULT_TABLE table=default.Table_a921ba7a73a1450db17d69d105fb7e54 [id=df4fa9ddc0cf43939afd4f282bd8d131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.442612 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140de873b1094bf4ac9fa29507722300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.442745 1031 tablet_service.cc:1511] Processing CreateTablet for tablet dfb556a60a9749a2889ad84db2294f8e (DEFAULT_TABLE table=default.Table_67dfa6733a6d46649a28c9b2eb7249b5 [id=b3e4dc3e1b7f4d99bd35dd69ddf17875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.438863 763 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 (DEFAULT_TABLE table=default.Table_8ced5f8d284a4065bf67d55d8b216f0b [id=1ea7008fd4f942f3905667950fa26262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.443746 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.443710 758 tablet_service.cc:1511] Processing CreateTablet for tablet cb068672e26d48b9a871ceb1c81022cc (DEFAULT_TABLE table=default.Table_2d8e5fe907c946cab36fcb67654f064b [id=b59fbc444db44c709747550e0374bfe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.442673 755 tablet_service.cc:1511] Processing CreateTablet for tablet 9c977ca621224d7ab73a9e9f39540c86 (DEFAULT_TABLE table=default.Table_ee493ced7f6f407db5eda645752fb00a [id=346f6003053545e4a46b988a36c5d625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.444054 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb068672e26d48b9a871ceb1c81022cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.447494 752 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb590e469b64fa0af0b75476e73a681 (DEFAULT_TABLE table=default.Table_93b0810be0b54d468ad337442bb61eb0 [id=0a48808664fa4c59ace771398401f8ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.447841 757 tablet_service.cc:1511] Processing CreateTablet for tablet a977e889c36b434388fc7a3a5cd42e8c (DEFAULT_TABLE table=default.Table_153389b9465647c6b228f0ade84d6853 [id=e6455d8ae07b4c77ac1426c2e8091226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.448127 891 tablet_service.cc:1511] Processing CreateTablet for tablet dfb556a60a9749a2889ad84db2294f8e (DEFAULT_TABLE table=default.Table_67dfa6733a6d46649a28c9b2eb7249b5 [id=b3e4dc3e1b7f4d99bd35dd69ddf17875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.448513 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb556a60a9749a2889ad84db2294f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.449496 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c977ca621224d7ab73a9e9f39540c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.449648 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a977e889c36b434388fc7a3a5cd42e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.454897 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb590e469b64fa0af0b75476e73a681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.457280 2648 tablet.cc:1724] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.463661 2634 raft_consensus.cc:493] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.463852 2634 raft_consensus.cc:515] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.464681 2634 leader_election.cc:290] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:08.478283 720 leader_election.cc:343] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3
W20260619 19:54:08.478530 720 leader_election.cc:343] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:08.478698 720 leader_election.cc:304] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:08.479434 2639 raft_consensus.cc:2804] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.479545 2639 raft_consensus.cc:493] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.479624 2639 raft_consensus.cc:3060] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:08.483743 720 leader_election.cc:343] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74949d09466f42e2852389e10192989d
I20260619 19:54:08.486963 2026 ts_tablet_manager.cc:1929] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.487224 2026 log.cc:1199] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/19d6333b0c8940b2802307d0da8a57ac
I20260619 19:54:08.487771 2026 ts_tablet_manager.cc:1950] T 19d6333b0c8940b2802307d0da8a57ac P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:08.491225 2434 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Append to log took a long time: real 0.060s user 0.002s sys 0.000s
I20260619 19:54:08.512262 747 tablet_service.cc:1511] Processing CreateTablet for tablet 951dfc443c4944d0a44864184e0da9d4 (DEFAULT_TABLE table=default.Table_ece67ba490164fbda8ded59ca42a5b12 [id=94be851bc6834ed6aee099a5917e1ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.512710 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951dfc443c4944d0a44864184e0da9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.514643 2638 tablet.cc:1724] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:08.519331 752 tablet_service.cc:1511] Processing CreateTablet for tablet 15b81edd27d14611b3a66c547117c532 (DEFAULT_TABLE table=default.Table_9f0ad99a69364bddb17a16eb224030b1 [id=926ef286ddd34e1092a0e0d890ac4c9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.519529 747 tablet_service.cc:1511] Processing CreateTablet for tablet a6433bc9150946d5b0bb7900cc30ed42 (DEFAULT_TABLE table=default.Table_b53b86c349a64aa58319ee1134c1b1de [id=e2811c103fec4686b1442791b7a9e72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.519730 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b81edd27d14611b3a66c547117c532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.522585 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6433bc9150946d5b0bb7900cc30ed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.523442 758 tablet_service.cc:1511] Processing CreateTablet for tablet f40da590ead8491788f59f1711e7e525 (DEFAULT_TABLE table=default.Table_dce56a19d6f24028956f0904bad88cd5 [id=d9e476d02b9f43d18edb3b857aff0d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.523813 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40da590ead8491788f59f1711e7e525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.527429 757 tablet_service.cc:1511] Processing CreateTablet for tablet 46c2a94a4d794f2aa94b77885812831f (DEFAULT_TABLE table=default.Table_4846baa998dc44a790af9fe0cc649f59 [id=bf3f5f5eeb5a4dd9a30db4ed053dbdac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.527781 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c2a94a4d794f2aa94b77885812831f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.529894 1994 ts_tablet_manager.cc:1929] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.529999 1994 log.cc:1199] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b57381b0a02141459dc582196d0c0095
I20260619 19:54:08.530386 1994 ts_tablet_manager.cc:1950] T b57381b0a02141459dc582196d0c0095 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:08.532339 763 tablet_service.cc:1511] Processing CreateTablet for tablet 1557244d1ed4490185d85c2f7c028eb1 (DEFAULT_TABLE table=default.Table_a2e31faf36224311b5da1fad2378c2b3 [id=17316b2f71a54927a1efe4211f354ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.532624 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb556a60a9749a2889ad84db2294f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.532713 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1557244d1ed4490185d85c2f7c028eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.539562 720 leader_election.cc:304] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:08.540171 755 tablet_service.cc:1511] Processing CreateTablet for tablet b546831050f84a91b8e4df5b96b1be14 (DEFAULT_TABLE table=default.Table_d5de5ed4c25e4cacadac49134c646e84 [id=26c675f2171940f089b3dc8e2e1300f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.540587 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546831050f84a91b8e4df5b96b1be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.518862 918 raft_consensus.cc:3060] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.544562 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 122) took 7275 ms. Trace:
I20260619 19:54:08.544649 2026 rpcz_store.cc:276] 0619 19:54:01.269081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.269144 (+ 63us) service_pool.cc:224] Handling call
0619 19:54:08.032523 (+6763379us) ts_tablet_manager.cc:1151] Deleting tablet 19d6333b0c8940b2802307d0da8a57ac
0619 19:54:08.032532 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.218942 (+186410us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.486893 (+267951us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.544537 (+ 57644us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6763155}
I20260619 19:54:08.545056 2026 tablet_replica.cc:333] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:08.545228 2026 raft_consensus.cc:2243] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:08.545358 2026 raft_consensus.cc:2272] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.545855 2026 ts_tablet_manager.cc:1916] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.546667 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 19d6333b0c8940b2802307d0da8a57ac (table default.Table_62d0e0d461a74b99bac5c2251f7f7f63 [id=73d986c5f5974ea790e236843abdf930]) successfully deleted
I20260619 19:54:08.547433 2527 raft_consensus.cc:2804] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.547533 2527 raft_consensus.cc:493] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.547613 2527 raft_consensus.cc:3060] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.550239 2527 raft_consensus.cc:515] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.550882 2527 leader_election.cc:290] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.551529 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8c10ee4d02fa48fdb10e3e5110f85cad (DEFAULT_TABLE table=default.Table_61001685074b47918bcf2235c53aee59 [id=db9584a57c4e4d2f8e30a9d1b36d28ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.551923 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c10ee4d02fa48fdb10e3e5110f85cad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:08.558573 720 leader_election.cc:343] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.483083 2639 raft_consensus.cc:515] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.559657 2639 leader_election.cc:290] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.561347 749 tablet_service.cc:1558] Processing DeleteTablet for tablet b12efc4264ae48e29fbcd446ea161307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.561802 761 tablet_service.cc:1511] Processing CreateTablet for tablet a4f175d5443c406590f373fc0c73c230 (DEFAULT_TABLE table=default.Table_cb87313898af41e9bb3b7ecbd9e58203 [id=0f6a89a8d303448891d933a00ff1c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.562602 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f175d5443c406590f373fc0c73c230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.561769 746 tablet_service.cc:1511] Processing CreateTablet for tablet a8b0d5d52f264281993fdb86c8658b88 (DEFAULT_TABLE table=default.Table_c7f823584528450b8a8b973c9d7617c4 [id=dff764f2dc7943e3a6e7c712241d8507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.563715 526 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_51eb31da347849a3a2e206fec7dbcee5 [id=043c20ae78a943e0bbf1c9a6753261b1] alter complete (version 1)
W20260619 19:54:08.565176 526 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 243) took 870 ms (client timeout 1000 ms). Trace:
W20260619 19:54:08.565295 526 rpcz_store.cc:269] 0619 19:54:07.694245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.724952 (+ 30707us) service_pool.cc:224] Handling call
0619 19:54:08.565139 (+840187us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:08.421534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:08.421614 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:08.421618 (+ 4us) write_op.cc:435] Acquired schema lock
0619 19:54:08.421620 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:08.447913 (+ 26293us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:08.447927 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:08.447934 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:08.448040 (+ 106us) tablet.cc:701] Row locks acquired
0619 19:54:08.448043 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:08.448090 (+ 47us) write_op.cc:270] Start()
0619 19:54:08.448134 (+ 44us) write_op.cc:276] Timestamp: P: 1781898848448068 usec, L: 0
0619 19:54:08.448137 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:08.448339 (+ 202us) log.cc:844] Serialized 356 byte log entry
0619 19:54:08.562103 (+113764us) op_driver.cc:464] REPLICATION: finished
0619 19:54:08.562369 (+ 266us) write_op.cc:301] APPLY: starting
0619 19:54:08.562420 (+ 51us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:08.562489 (+ 69us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:08.562529 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:08.562593 (+ 64us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:08.562629 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:08.562636 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:08.562723 (+ 87us) log.cc:844] Serialized 23 byte log entry
0619 19:54:08.562790 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:08.562810 (+ 20us) write_op.cc:454] Released schema lock
0619 19:54:08.562817 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:08.562891 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:08.562894 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":186,"apply.run_cpu_time_us":516,"apply.run_wall_time_us":516,"num_ops":1,"prepare.queue_time_us":142563,"prepare.run_cpu_time_us":682,"prepare.run_wall_time_us":26880,"replication_time_us":113916}]]}
I20260619 19:54:08.566076 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e8b0363f7f4a4634977b3e2f64ec2386"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.566658 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8b0363f7f4a4634977b3e2f64ec2386 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.566864 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b0d5d52f264281993fdb86c8658b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.568351 749 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f5fef4f5041d18f399cf9eab4d63f (DEFAULT_TABLE table=default.Table_99b386e9a89b483e91c5ad3fe8f59148 [id=d4bacf74e5dc4473b2000b3f2f88650b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.574882 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f5fef4f5041d18f399cf9eab4d63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.577186 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b57381b0a02141459dc582196d0c0095 (table default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]) successfully deleted
I20260619 19:54:08.577288 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 140de873b1094bf4ac9fa29507722300 (DEFAULT_TABLE table=default.Table_a921ba7a73a1450db17d69d105fb7e54 [id=df4fa9ddc0cf43939afd4f282bd8d131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.577525 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:08.577715 1059 raft_consensus.cc:3060] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.572108 758 tablet_service.cc:1511] Processing CreateTablet for tablet 6c42d47f65e844ea903cb544db21dd86 (DEFAULT_TABLE table=default.Table_f4f2b36b8c6849648d4c11f124c441d7 [id=520d7231e7a44fc0b2638313da114940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.579294 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c42d47f65e844ea903cb544db21dd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.579434 2509 raft_consensus.cc:493] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:08.579592 2509 raft_consensus.cc:515] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.580317 2509 leader_election.cc:290] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.580794 1059 raft_consensus.cc:2468] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:08.572525 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.572718 748 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.581118 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.572798 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 76ffe451545c4af6821971384fce483e with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3a48eabb574be3bc6883cf555b657f) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.581549 759 tablet_service.cc:1558] Processing DeleteTablet for tablet fade40bf3e7145f29076821f091677bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.581923 2637 tablet.cc:1724] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.582001 754 tablet_service.cc:1511] Processing CreateTablet for tablet ebb013fe22fd4021a84e85813ca7484a (DEFAULT_TABLE table=default.Table_ec7afef29b0741c89176856851dbff59 [id=2cc067b1e8a240ebb61cdce15977180a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.582413 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb013fe22fd4021a84e85813ca7484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.572870 763 tablet_service.cc:1558] Processing DeleteTablet for tablet b546831050f84a91b8e4df5b96b1be14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.575271 2516 consensus_queue.cc:1048] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:08.577615 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f32e1c7a27941ca9377901b19b32af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.577952 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.587284 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9d49b16f9b9e4b79ae0045c3f0542d23 (DEFAULT_TABLE table=default.Table_d663e07e37c74d3b97d09e5f020d2586 [id=60647013b3054bc5a88db110c26df578]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.587725 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d49b16f9b9e4b79ae0045c3f0542d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.588347 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140de873b1094bf4ac9fa29507722300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.588903 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0168c82ece6e4ce683265229a5d4c6ea (DEFAULT_TABLE table=default.Table_40536a5e373e47c9b8768101493707a2 [id=e37abdd24aa54863a0fa7a6dfdbdcff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.589259 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0168c82ece6e4ce683265229a5d4c6ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.571635 1973 ts_tablet_manager.cc:1929] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:08.590642 1973 log.cc:1199] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:08.590473 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.593078 1208 tablet_bootstrap.cc:492] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:08.593243 1208 ts_tablet_manager.cc:1403] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.318s user 0.006s sys 0.000s
I20260619 19:54:08.594529 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:08.594710 1059 raft_consensus.cc:3060] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.597163 1973 ts_tablet_manager.cc:1950] T 365c0bb1e9ac480e96e7f4d604048663 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:08.597723 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 284) took 3951 ms. Trace:
I20260619 19:54:08.597857 1059 raft_consensus.cc:2468] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:08.599762 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:08.601697 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:08.608836 1994 tablet_replica.cc:333] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:08.609458 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 4bb499b2e5374912a10bc6379dba55b4 (table default.Table_3dedb27eb07a4f858fdd9e39751a063e [id=3f6740ded6b646feb3d38896b1d402e8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4bb499b2e5374912a10bc6379dba55b4 consensus state has no leader
I20260619 19:54:08.609519 1994 raft_consensus.cc:2243] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:08.610271 1994 raft_consensus.cc:2272] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.612322 1994 ts_tablet_manager.cc:1916] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.620237 1994 ts_tablet_manager.cc:1929] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:08.620615 1973 rpcz_store.cc:276] 0619 19:54:04.645989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.646079 (+ 90us) service_pool.cc:224] Handling call
0619 19:54:08.225111 (+3579032us) ts_tablet_manager.cc:1151] Deleting tablet 365c0bb1e9ac480e96e7f4d604048663
0619 19:54:08.225124 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.425771 (+200647us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.571579 (+145808us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.597707 (+ 26128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3578734}
I20260619 19:54:08.621212 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 285) took 3931 ms. Trace:
I20260619 19:54:08.621342 1973 rpcz_store.cc:276] 0619 19:54:04.689671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.689753 (+ 82us) service_pool.cc:224] Handling call
0619 19:54:08.621062 (+3931309us) ts_tablet_manager.cc:1151] Deleting tablet 910cf00e57404f1097800e84a2070b26
0619 19:54:08.621075 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.621194 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3930276}
I20260619 19:54:08.621729 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 286) took 3810 ms. Trace:
I20260619 19:54:08.621851 1973 rpcz_store.cc:276] 0619 19:54:04.811445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.811567 (+ 122us) service_pool.cc:224] Handling call
0619 19:54:08.621631 (+3810064us) ts_tablet_manager.cc:1151] Deleting tablet f305a99e3481419196532cb5c62c2500
0619 19:54:08.621639 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.621715 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3809766}
I20260619 19:54:08.622627 1973 tablet_replica.cc:333] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:08.622864 1973 raft_consensus.cc:2243] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:08.623220 1973 raft_consensus.cc:2272] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.623742 763 tablet_service.cc:1511] Processing CreateTablet for tablet 8f50b9f07f3b4d00b500adef6c67e36d (DEFAULT_TABLE table=default.Table_c59b58766d634684a17e2a7591efb8f4 [id=b138e4c3fea745c0b5ea2a27dd4ee675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.624357 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f50b9f07f3b4d00b500adef6c67e36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.626318 762 tablet_service.cc:1511] Processing CreateTablet for tablet 140de873b1094bf4ac9fa29507722300 (DEFAULT_TABLE table=default.Table_a921ba7a73a1450db17d69d105fb7e54 [id=df4fa9ddc0cf43939afd4f282bd8d131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.628131 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140de873b1094bf4ac9fa29507722300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.627529 747 tablet_service.cc:1511] Processing CreateTablet for tablet 42027d2587914413bb674025df6503c4 (DEFAULT_TABLE table=default.Table_2f513b752aa747ad983090c68ec1cdd9 [id=14e0854a75fb43c58d2cada284017772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.634523 1201 tablet_bootstrap.cc:492] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:08.634688 1201 ts_tablet_manager.cc:1403] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.386s user 0.052s sys 0.136s
I20260619 19:54:08.635905 1201 raft_consensus.cc:359] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.636072 1201 raft_consensus.cc:385] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.636123 1201 raft_consensus.cc:740] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.636301 1201 consensus_queue.cc:260] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.636785 1201 ts_tablet_manager.cc:1434] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:08.637084 1201 tablet_bootstrap.cc:492] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:08.600313 1208 raft_consensus.cc:359] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.600630 750 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f4b47d0e7451d91add5a81330bc7d (DEFAULT_TABLE table=default.Table_0b95ccb115dc4f94b0db2f904eda5e2c [id=13a54bc3bdb04d96afdbbc9daf0a6781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.618392 751 tablet_service.cc:1558] Processing DeleteTablet for tablet b57381b0a02141459dc582196d0c0095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.639338 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:08.635511 758 tablet_service.cc:1511] Processing CreateTablet for tablet dfb556a60a9749a2889ad84db2294f8e (DEFAULT_TABLE table=default.Table_67dfa6733a6d46649a28c9b2eb7249b5 [id=b3e4dc3e1b7f4d99bd35dd69ddf17875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.644044 1201 tablet_bootstrap.cc:654] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.643767 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6da56cd05ea740eb949abb9bba60760a (DEFAULT_TABLE table=default.Table_99391b7e2a8246d8a5c13ab7e94001e0 [id=c3d8ee2b3fcf494c841aae2384e56e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:08.639544 1208 raft_consensus.cc:385] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.644889 1208 raft_consensus.cc:740] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.645289 1208 consensus_queue.cc:260] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.641506 1973 ts_tablet_manager.cc:1916] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.647917 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3be362aa28504b729801de35d869beac
I20260619 19:54:08.648818 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_53c4ff46dfa649b29c6dfe8e8af85a17" } new_table_name: "default.Table_a1c8ee1b3f864b24aacf7f9089b5411d" modify_external_catalogs: true
I20260619 19:54:08.650071 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5ffe2eed21c644c4b91c87f6abd8a9a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.650584 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ffe2eed21c644c4b91c87f6abd8a9a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.652887 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be362aa28504b729801de35d869beac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.653309 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_919c11e15e44489aa549a3f8f596b11a" } new_table_name: "default.Table_9dcb6cc8908f4c278d72bd81045ebfe5" modify_external_catalogs: true
I20260619 19:54:08.654716 2539 raft_consensus.cc:493] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:08.654829 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 180c3fd33d854a06a7cfd2f9671557a7
I20260619 19:54:08.654861 2539 raft_consensus.cc:515] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:08.655551 2539 leader_election.cc:290] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:08.654775 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1d23b9d751c48ad858a35771b0ded61 consensus state has no leader
W20260619 19:54:08.656526 859 leader_election.cc:343] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 82d2dd6eedd24f44a6a17aceb20e62bb
I20260619 19:54:08.647181 1208 ts_tablet_manager.cc:1434] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260619 19:54:08.647085 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26355bc6b5c147a88c14a9f053b4e1f3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.647895 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.657086 779 raft_consensus.cc:2468] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:08.657087 780 raft_consensus.cc:2468] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:08.657629 1208 tablet_bootstrap.cc:492] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:08.658766 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_508ca7090aa54693b073adb86fe4f9ad" } modify_external_catalogs: true
I20260619 19:54:08.658919 527 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_b6efadaef25c49f19f72b09c08e1b25a [id=b9dc702105844f9a8864d15332e30313] alter complete (version 1)
I20260619 19:54:08.662137 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_508ca7090aa54693b073adb86fe4f9ad" } modify_external_catalogs: true
I20260619 19:54:08.664232 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2f909ced98f04ff089efa555b29ebc90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:08.664081 1994 log.cc:1199] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:08.664578 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dd8210ab7a3b44dfabe35847cb0edd27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:08.657199 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be362aa28504b729801de35d869beac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:08.665073 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd8210ab7a3b44dfabe35847cb0edd27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:08.666869 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 198bde101e7b4eeeb8de58aebe208bb4 consensus state has no leader
I20260619 19:54:08.667258 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4ee47551aa224e8eb4ecb0fa3d80243b" } new_table_name: "default.Table_c397b4c315ec406f895f61a1249a8ef3" modify_external_catalogs: true
I20260619 19:54:08.667692 1994 ts_tablet_manager.cc:1950] T 9f6ec149e1ac475f8038b328dae4af2a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:08.668896 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 3 got 0
I20260619 19:54:08.670584 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3ae6164970ec4977a8c0c9fd24ab7275
I20260619 19:54:08.670562 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 180c3fd33d854a06a7cfd2f9671557a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.670426 2026 ts_tablet_manager.cc:1929] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.672039 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.661739 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 180c3fd33d854a06a7cfd2f9671557a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:08.632395 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42027d2587914413bb674025df6503c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.672390 2026 log.cc:1199] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/184d655694434b0bbfa178fcd3110405
I20260619 19:54:08.673302 2269 consensus_queue.cc:1048] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:08.672897 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_89a388cee2964d0a82df7dc583b3c8b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.674387 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89a388cee2964d0a82df7dc583b3c8b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.674425 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:08.677487 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f909ced98f04ff089efa555b29ebc90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.682327 1200 tablet_bootstrap.cc:492] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:08.682721 1200 ts_tablet_manager.cc:1403] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.286s user 0.006s sys 0.000s
I20260619 19:54:08.685889 1200 raft_consensus.cc:359] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.687899 1200 raft_consensus.cc:385] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.688795 1200 raft_consensus.cc:740] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.689579 1201 tablet_bootstrap.cc:492] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:08.689726 1201 ts_tablet_manager.cc:1403] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.053s user 0.000s sys 0.005s
I20260619 19:54:08.690229 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f4b47d0e7451d91add5a81330bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.690518 1201 raft_consensus.cc:359] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.690721 1201 raft_consensus.cc:385] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.690776 1201 raft_consensus.cc:740] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.691009 1201 consensus_queue.cc:260] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.691468 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da56cd05ea740eb949abb9bba60760a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.691623 1201 ts_tablet_manager.cc:1434] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:08.692405 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb556a60a9749a2889ad84db2294f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:08.697566 2026 ts_tablet_manager.cc:1950] T 184d655694434b0bbfa178fcd3110405 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:08.692848 720 leader_election.cc:304] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:08.699117 2516 raft_consensus.cc:2804] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:08.699266 2516 raft_consensus.cc:697] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:08.699558 2516 consensus_queue.cc:237] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:08.700416 720 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.700839 720 leader_election.cc:304] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:08.700909 2314 consensus_queue.cc:1048] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:08.701090 2634 raft_consensus.cc:2804] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:54:08.701736 2657 log.cc:927] Time spent T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260619 19:54:08.701814 2634 raft_consensus.cc:697] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:08.702054 2634 consensus_queue.cc:237] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:08.704921 889 consensus_meta.cc:287] T 5c6cc12c429f4857a67d77c697e6dc67 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 0.867s user 0.025s sys 0.001s
W20260619 19:54:08.705798 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b2e40a7328d42dd864703db24c1fa3c consensus state has no leader
I20260619 19:54:08.705925 531 master_service.cc:960] ReplaceTablet: received request to replace tablet d5ddb8412ad145dd85916bf5d756a9f0 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:08.706236 527 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_c752ae3fb15b43a19f8a402dc1557a49 [id=f1c35564785e48a6b6b465801f79ac2d] alter complete (version 2)
I20260619 19:54:08.707554 1200 consensus_queue.cc:260] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.710232 1200 ts_tablet_manager.cc:1434] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.027s user 0.002s sys 0.002s
I20260619 19:54:08.711655 884 tablet_service.cc:1558] Processing DeleteTablet for tablet d895be304fcf445e9a4d2d8242becdd5 with delete_type TABLET_DATA_DELETED (replaced by tablet 10c73b679e394f31b9e5d51681e06976) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:08.718346 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6d7f30c5a84106bebebc42eedee654" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:08.718550 780 raft_consensus.cc:3060] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.723645 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.727046 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2644646bf4a244ab9f25aabb2522df39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:08.727640 2638 tablet.cc:1724] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:08.727952 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2644646bf4a244ab9f25aabb2522df39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.729573 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_34c184c3d7184b60af86c17cf2708721" } modify_external_catalogs: true
I20260619 19:54:08.729781 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_34c184c3d7184b60af86c17cf2708721" } modify_external_catalogs: true
I20260619 19:54:08.734570 1208 tablet_bootstrap.cc:654] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.746999 2539 raft_consensus.cc:493] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.747239 2539 raft_consensus.cc:515] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.747928 2539 leader_election.cc:290] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.755321 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f33c2c00b414fbebf1965510e1e2b96" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:08.762506 1994 tablet_replica.cc:333] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:08.762805 1994 raft_consensus.cc:2243] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:08.763077 1994 pending_rounds.cc:70] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:08.763623 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9f6ec149e1ac475f8038b328dae4af2a (table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]) successfully deleted
I20260619 19:54:08.763121 1994 pending_rounds.cc:77] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657683050901504 op_type: NO_OP noop_request { }
I20260619 19:54:08.764456 1994 raft_consensus.cc:2889] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:08.764559 1994 raft_consensus.cc:2272] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.763586 1200 tablet_bootstrap.cc:492] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:08.766887 1200 tablet_bootstrap.cc:654] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.767774 1994 ts_tablet_manager.cc:1916] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.774502 1994 ts_tablet_manager.cc:1929] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.780108 1994 log.cc:1199] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:08.781044 1994 ts_tablet_manager.cc:1950] T cc57b42a97fa437b93842f7cd379dbb7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:08.781522 2539 raft_consensus.cc:493] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:08.781683 2539 raft_consensus.cc:515] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:08.782389 2539 leader_election.cc:290] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:08.784164 859 leader_election.cc:343] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:08.788081 780 raft_consensus.cc:2468] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:08.789384 1201 tablet_bootstrap.cc:492] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:08.789674 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 124) took 7515 ms. Trace:
I20260619 19:54:08.789765 2026 rpcz_store.cc:276] 0619 19:54:01.274574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.274614 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:08.545010 (+7270396us) ts_tablet_manager.cc:1151] Deleting tablet 184d655694434b0bbfa178fcd3110405
0619 19:54:08.545020 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.637715 (+ 92695us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.670285 (+ 32570us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.789653 (+119368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7221316}
I20260619 19:54:08.790089 2026 tablet_replica.cc:333] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:08.790174 2648 tablet.cc:1724] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:08.790292 2026 raft_consensus.cc:2243] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:08.790570 2026 raft_consensus.cc:2272] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.791152 2026 ts_tablet_manager.cc:1916] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.791184 1201 tablet_bootstrap.cc:654] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.795289 889 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 390) took 1084 ms. Trace:
I20260619 19:54:08.795379 889 rpcz_store.cc:276] 0619 19:54:07.710560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.710609 (+ 49us) service_pool.cc:224] Handling call
0619 19:54:07.834574 (+123965us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:07.834591 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:07.838303 (+ 3712us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.705304 (+867001us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:08.795270 (+ 89966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:08.796063 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 184d655694434b0bbfa178fcd3110405 (table default.Table_30ac9e6bf2a947009c67072b853bcf4e [id=88b02ca24c9f4dc6bf751de7bed9499c]) successfully deleted
I20260619 19:54:08.799613 2026 ts_tablet_manager.cc:1929] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.799844 2026 log.cc:1199] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/5f25c0378a6f4e9ea1a62d98f27778ee
I20260619 19:54:08.800280 2026 ts_tablet_manager.cc:1950] T 5f25c0378a6f4e9ea1a62d98f27778ee P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:08.801127 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 149) took 7483 ms. Trace:
I20260619 19:54:08.802100 2026 rpcz_store.cc:276] 0619 19:54:01.317379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.323723 (+ 6344us) service_pool.cc:224] Handling call
0619 19:54:08.790045 (+7466322us) ts_tablet_manager.cc:1151] Deleting tablet 5f25c0378a6f4e9ea1a62d98f27778ee
0619 19:54:08.790054 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.794555 (+ 4501us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.799558 (+ 5003us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.801105 (+ 1547us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7466047}
I20260619 19:54:08.803160 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 5f25c0378a6f4e9ea1a62d98f27778ee (table default.Table_8874e3261467434cb5316f5024d06ce7 [id=6acfde9eb89943c9b83cf58165e83ccb]) successfully deleted
I20260619 19:54:08.803640 2026 tablet_replica.cc:333] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:08.804217 2026 raft_consensus.cc:2243] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:08.804857 2026 raft_consensus.cc:2272] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.805852 2026 ts_tablet_manager.cc:1916] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.811796 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_869856a5e6e142f9ae4c72eacebc1090" } new_table_name: "default.Table_546a4ba14dd84089aec07383262b0fed" modify_external_catalogs: true
W20260619 19:54:08.813697 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cbfe0e049fd4b978d92145624e99a5a consensus state has no leader
W20260619 19:54:08.818706 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 117515us
I20260619 19:54:08.820089 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54b2e4f657245c2aa23d138968b3b0d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.820168 2633 tablet.cc:1724] T 5fcb1050f57246feb65f7e8948856c21 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.820284 780 raft_consensus.cc:2468] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:54:08.821660 2668 log.cc:927] Time spent T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260619 19:54:08.821832 2635 tablet.cc:1724] T bb547965fc7e4aa29d427b1acc7d6e51 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.826232 2632 tablet.cc:1724] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:08.834780 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet cc57b42a97fa437b93842f7cd379dbb7 (table default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]) successfully deleted
I20260619 19:54:08.835609 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b2a87fb0340e4c25894584473a100047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:08.835726 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ff09960283f5496a8b99428dbb23ed15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:08.836256 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff09960283f5496a8b99428dbb23ed15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.838707 1208 tablet_bootstrap.cc:492] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:08.838836 1208 ts_tablet_manager.cc:1403] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.181s user 0.003s sys 0.019s
W20260619 19:54:08.836256 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2a87fb0340e4c25894584473a100047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:08.839546 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.839741 780 raft_consensus.cc:2468] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:08.844674 720 consensus_peers.cc:597] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.845299 2632 tablet.cc:1724] T bb547965fc7e4aa29d427b1acc7d6e51 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.845834 2026 ts_tablet_manager.cc:1929] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.846709 2026 log.cc:1199] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d4771739543f4b4189b7d603f76325f0
I20260619 19:54:08.847323 2026 ts_tablet_manager.cc:1950] T d4771739543f4b4189b7d603f76325f0 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:08.851781 1208 raft_consensus.cc:359] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:08.852195 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2718b9619524430388f0760485d8e4be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2718b9619524430388f0760485d8e4be already in progress: creating tablet
I20260619 19:54:08.852734 1208 raft_consensus.cc:385] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.852795 1208 raft_consensus.cc:740] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.852969 1208 consensus_queue.cc:260] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.853434 1208 ts_tablet_manager.cc:1434] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260619 19:54:08.853708 1208 tablet_bootstrap.cc:492] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:08.854046 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]) successfully deleted
W20260619 19:54:08.854321 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 910cf00e57404f1097800e84a2070b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 910cf00e57404f1097800e84a2070b26 already in progress: creating tablet
W20260619 19:54:08.854540 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f305a99e3481419196532cb5c62c2500 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f305a99e3481419196532cb5c62c2500 already in progress: creating tablet
I20260619 19:54:08.855460 913 raft_consensus.cc:3060] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.855918 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:08.856647 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:08.857385 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:08.858090 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3354ae6dd46bd9c5414d4c4a720a1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:08.858721 858 consensus_peers.cc:597] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f32e1c7a27941ca9377901b19b32af3. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.858934 2632 tablet.cc:1724] T 5fcb1050f57246feb65f7e8948856c21 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.859522 858 leader_election.cc:304] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.859884 2539 raft_consensus.cc:2804] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.860028 2539 raft_consensus.cc:493] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.860090 2539 raft_consensus.cc:3060] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.862608 2539 raft_consensus.cc:515] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:08.864315 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 3be362aa28504b729801de35d869beac because the tablet was not found. No further retry: Not found: Tablet not found: 3be362aa28504b729801de35d869beac
I20260619 19:54:08.864703 858 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.865536 2548 raft_consensus.cc:2749] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:08.865532 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 180c3fd33d854a06a7cfd2f9671557a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 180c3fd33d854a06a7cfd2f9671557a7 already in progress: creating tablet
W20260619 19:54:08.866868 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 3ae6164970ec4977a8c0c9fd24ab7275 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae6164970ec4977a8c0c9fd24ab7275 already in progress: creating tablet
W20260619 19:54:08.868181 859 leader_election.cc:343] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3
I20260619 19:54:08.868402 2539 leader_election.cc:290] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.850221 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f8635b919a44a8a1e5fe48420ca4b7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.871377 780 raft_consensus.cc:2468] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:08.871918 1201 tablet_bootstrap.cc:492] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:08.871925 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8c3aef303b94d58aaa24917399ac240" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.872069 1201 ts_tablet_manager.cc:1403] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.083s user 0.001s sys 0.006s
I20260619 19:54:08.872901 1201 raft_consensus.cc:359] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.873127 1201 raft_consensus.cc:385] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.873199 1201 raft_consensus.cc:740] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.873454 1201 consensus_queue.cc:260] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.874061 1201 ts_tablet_manager.cc:1434] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:08.874393 1201 tablet_bootstrap.cc:492] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:08.851889 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f33c2c00b414fbebf1965510e1e2b96" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:08.875335 1973 ts_tablet_manager.cc:1929] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:08.875488 1973 log.cc:1199] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/950b8e74d12f46a68ba5eae3186c87a9
I20260619 19:54:08.875828 1973 ts_tablet_manager.cc:1950] T 950b8e74d12f46a68ba5eae3186c87a9 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:08.876097 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 288) took 3718 ms. Trace:
I20260619 19:54:08.876169 1973 rpcz_store.cc:276] 0619 19:54:05.157340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.157617 (+ 277us) service_pool.cc:224] Handling call
0619 19:54:08.622580 (+3464963us) ts_tablet_manager.cc:1151] Deleting tablet 950b8e74d12f46a68ba5eae3186c87a9
0619 19:54:08.622588 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.828583 (+205995us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.875278 (+ 46695us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.876083 (+ 805us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3464404}
I20260619 19:54:08.876515 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 295) took 3615 ms. Trace:
I20260619 19:54:08.876585 1973 rpcz_store.cc:276] 0619 19:54:05.261053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.262396 (+ 1343us) service_pool.cc:224] Handling call
0619 19:54:08.876410 (+3614014us) ts_tablet_manager.cc:1151] Deleting tablet 28a09107b11d480dba8c456fc8753ad1
0619 19:54:08.876419 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.876499 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3613829}
W20260619 19:54:08.876749 719 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.876853 1973 tablet_replica.cc:333] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:08.876869 719 leader_election.cc:304] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.876983 1201 tablet_bootstrap.cc:654] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.877018 1973 raft_consensus.cc:2243] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:08.877334 719 consensus_peers.cc:597] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.877861 719 leader_election.cc:304] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.878103 2634 raft_consensus.cc:2749] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:08.877084 2516 raft_consensus.cc:2706] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260619 19:54:08.878854 1973 raft_consensus.cc:2272] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.878629 719 leader_election.cc:304] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.879586 2516 raft_consensus.cc:2804] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.879662 2516 raft_consensus.cc:493] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.879726 2516 raft_consensus.cc:3060] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.881668 1208 tablet_bootstrap.cc:654] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.884444 1973 ts_tablet_manager.cc:1916] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.890730 1201 tablet_bootstrap.cc:492] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:08.891013 1201 ts_tablet_manager.cc:1403] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.004s
I20260619 19:54:08.891964 1201 raft_consensus.cc:359] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.892140 1201 raft_consensus.cc:385] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.892194 1201 raft_consensus.cc:740] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.892385 1201 consensus_queue.cc:260] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.892833 1201 ts_tablet_manager.cc:1434] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:08.893163 1201 tablet_bootstrap.cc:492] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:08.901382 2516 raft_consensus.cc:515] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.902182 2516 leader_election.cc:290] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:08.889518 1200 tablet_bootstrap.cc:492] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:08.910029 1200 ts_tablet_manager.cc:1403] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.147s user 0.007s sys 0.002s
I20260619 19:54:08.912585 719 leader_election.cc:304] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.911042 1200 raft_consensus.cc:359] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.913277 1200 raft_consensus.cc:385] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.913362 2516 raft_consensus.cc:2749] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:08.913429 1200 raft_consensus.cc:740] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:08.913784 719 leader_election.cc:343] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.913836 1200 consensus_queue.cc:260] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:08.914752 719 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.914933 1200 ts_tablet_manager.cc:1434] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260619 19:54:08.915231 1200 tablet_bootstrap.cc:492] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:08.916306 1200 tablet_bootstrap.cc:654] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:08.917065 719 leader_election.cc:304] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.917887 2516 raft_consensus.cc:2804] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:08.918097 2516 raft_consensus.cc:697] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:08.918390 2516 consensus_queue.cc:237] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.918900 1973 ts_tablet_manager.cc:1929] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:08.919013 1973 log.cc:1199] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:08.919337 1973 ts_tablet_manager.cc:1950] T 90b8468df4a449d088f47b3b150ce54a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:08.920823 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 296) took 3659 ms. Trace:
I20260619 19:54:08.921123 1973 rpcz_store.cc:276] 0619 19:54:05.261173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.262813 (+ 1640us) service_pool.cc:224] Handling call
0619 19:54:08.876796 (+3613983us) ts_tablet_manager.cc:1151] Deleting tablet 90b8468df4a449d088f47b3b150ce54a
0619 19:54:08.876804 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.883849 (+ 7045us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x6160000c5854. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1e0f23 00007eff4e52c933 00007eff510efae7 00007eff51122bb4 00007eff511035d0 00007eff5110335d 0000000000aa681c 00007eff411809ff 00007eff41183d1b 00007eff41183b98
0619 19:54:08.904488 (+ 20639us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.918849 (+ 14361us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.920710 (+ 1861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3907840,"tablet-delete.queue_time_us":3613821}
I20260619 19:54:08.927002 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 294) took 3666 ms. Trace:
I20260619 19:54:08.927145 1973 rpcz_store.cc:276] 0619 19:54:05.260928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.397683 (+136755us) service_pool.cc:224] Handling call
0619 19:54:08.922233 (+3524550us) ts_tablet_manager.cc:1151] Deleting tablet 1b18a61d955e4929998b90c6c8fa844e
0619 19:54:08.926852 (+ 4619us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.926974 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3524121}
I20260619 19:54:08.927601 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 303) took 3173 ms. Trace:
I20260619 19:54:08.927712 1973 rpcz_store.cc:276] 0619 19:54:05.753722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.753774 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:08.927417 (+3173643us) ts_tablet_manager.cc:1151] Deleting tablet 774938222588473e90c513232c82aece
0619 19:54:08.927429 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.927582 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173420}
I20260619 19:54:08.928020 1973 tablet_replica.cc:333] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:08.928236 1973 raft_consensus.cc:2243] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:08.928490 1973 raft_consensus.cc:2272] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.929116 1973 ts_tablet_manager.cc:1916] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:08.931694 719 leader_election.cc:343] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.932226 2665 consensus_queue.cc:1048] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:08.932960 2633 tablet.cc:1724] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.937166 2633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:56684 (request call id 382) took 1260 ms. Trace:
I20260619 19:54:08.937263 2633 rpcz_store.cc:276] 0619 19:54:07.677026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.677083 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:07.680724 (+ 3641us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x61800000ed18. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff41130654 00007eff4112fb96 00007eff54f9a21d 00007eff54f9a1bc 00007eff510f4ba4 00007eff510f4e0a 00007eff51075d2c 00007eff5102a21f 00007eff5102847c 00007eff4aecc366
0619 19:54:08.937147 (+1256423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:07.681017 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:54:07.681095 (+ 78us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:54:07.681104 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0619 19:54:07.681109 (+ 5us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:54:07.681141 (+ 32us) alter_schema_op.cc:128] START. Timestamp: 1781898847681083
0619 19:54:07.681144 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:07.681285 (+ 141us) log.cc:844] Serialized 173 byte log entry
0619 19:54:08.932671 (+1251386us) op_driver.cc:464] REPLICATION: finished
0619 19:54:08.932937 (+ 266us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:08.933347 (+ 410us) log.cc:844] Serialized 5 byte log entry
0619 19:54:08.936770 (+ 3423us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.937063 (+ 293us) log.cc:844] Serialized 14 byte log entry
0619 19:54:08.937103 (+ 40us) alter_schema_op.cc:73] Released schema lock
0619 19:54:08.937108 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"spinlock_wait_cycles":3381632,"child_traces":[["op",{"apply.queue_time_us":177,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":9581,"prepare.run_wall_time_us":114816,"raft.queue_time_us":126,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":1251490,"thread_start_us":114313,"threads_started":2,"wal-append.queue_time_us":42494,"wal-append.run_cpu_time_us":485,"wal-append.run_wall_time_us":1000530}]]}
W20260619 19:54:08.938138 719 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.938246 719 leader_election.cc:304] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.938473 2314 raft_consensus.cc:2749] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:08.938964 719 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:08.939486 719 consensus_peers.cc:597] T ed9d1bd98764451990e7e8e1b6fbcb0b P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:08.939677 719 leader_election.cc:343] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:08.939762 719 leader_election.cc:304] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.941926 2665 raft_consensus.cc:2749] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:08.942135 2665 consensus_queue.cc:1048] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:08.947356 1208 tablet_bootstrap.cc:492] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:08.947546 1208 ts_tablet_manager.cc:1403] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.094s user 0.006s sys 0.005s
I20260619 19:54:08.948300 1208 raft_consensus.cc:359] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.948632 1208 raft_consensus.cc:385] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.948729 1208 raft_consensus.cc:740] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.948938 1208 consensus_queue.cc:260] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.949462 1208 ts_tablet_manager.cc:1434] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:08.957501 1973 ts_tablet_manager.cc:1929] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:08.958141 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 150) took 7640 ms. Trace:
W20260619 19:54:08.966739 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 101386us
W20260619 19:54:08.968573 858 leader_election.cc:343] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 1202fe45d0964d368989f969e95f880d
I20260619 19:54:08.968847 1200 tablet_bootstrap.cc:492] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:08.968914 858 leader_election.cc:304] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.969139 1200 ts_tablet_manager.cc:1403] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.001s
I20260619 19:54:08.969385 2548 raft_consensus.cc:2749] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:08.969762 858 leader_election.cc:304] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.970316 2548 raft_consensus.cc:2804] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:08.970373 2548 raft_consensus.cc:493] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:08.970199 1200 raft_consensus.cc:359] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.970423 2548 raft_consensus.cc:3060] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:08.970451 1200 raft_consensus.cc:385] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:08.970533 1200 raft_consensus.cc:740] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:08.970932 1200 consensus_queue.cc:260] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.971820 1200 ts_tablet_manager.cc:1434] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:54:08.972937 2548 raft_consensus.cc:515] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:08.974308 859 leader_election.cc:343] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:08.974573 2548 leader_election.cc:290] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.974903 858 leader_election.cc:343] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:54:08.975518 858 leader_election.cc:304] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.958976 2026 rpcz_store.cc:276] 0619 19:54:01.317480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.324016 (+ 6536us) service_pool.cc:224] Handling call
0619 19:54:08.803591 (+7479575us) ts_tablet_manager.cc:1151] Deleting tablet d4771739543f4b4189b7d603f76325f0
0619 19:54:08.803601 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.810010 (+ 6409us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.845767 (+ 35757us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.958113 (+112346us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7478835}
I20260619 19:54:08.976331 2548 raft_consensus.cc:2749] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:08.976765 858 consensus_peers.cc:597] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe14a1f35cf14ca480221ee412c087da. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:08.978161 858 leader_election.cc:304] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.978361 2026 tablet_replica.cc:333] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:08.978938 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26355bc6b5c147a88c14a9f053b4e1f3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:08.979506 918 raft_consensus.cc:2393] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:08.979991 2026 raft_consensus.cc:2243] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:08.980811 2548 raft_consensus.cc:2804] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:08.980949 2548 raft_consensus.cc:493] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:08.981066 2548 raft_consensus.cc:3060] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:08.983716 2548 raft_consensus.cc:515] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:08.984777 2548 leader_election.cc:290] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:08.985631 859 leader_election.cc:343] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 221cc85629ca41e9ad71adfe0beb392a
I20260619 19:54:08.986820 1200 tablet_bootstrap.cc:492] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:08.991571 2026 raft_consensus.cc:2272] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:08.992190 2026 ts_tablet_manager.cc:1916] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:08.992710 2615 raft_consensus.cc:493] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:08.992833 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 983faf8557814093bc427291711f3fce
I20260619 19:54:08.992844 2615 raft_consensus.cc:515] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:08.993439 2615 leader_election.cc:290] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:08.994518 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d4771739543f4b4189b7d603f76325f0 (table default.Table_5a7d4266ae434f74a819ed18281e9d27 [id=3a754ff578a54df5b52465401b44899f]) successfully deleted
I20260619 19:54:08.994781 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 950b8e74d12f46a68ba5eae3186c87a9 (table default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]) successfully deleted
I20260619 19:54:08.996975 1201 tablet_bootstrap.cc:654] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:08.992630 858 leader_election.cc:343] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: b7adec89ed984837a8cf3544679ca617
I20260619 19:54:08.994066 2637 tablet.cc:1724] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:08.994115 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6ad82f0c94e27b2eb4dbf185fab66" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:08.999923 996 leader_election.cc:343] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.002939 2637 tablet.cc:1724] T 5fcb1050f57246feb65f7e8948856c21 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:09.003440 858 leader_election.cc:304] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.009644 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 9e08673df04a45b69e65f13a517e906d (DEFAULT_TABLE table=default.Table_54977c57c4894a379cf160aba236e9e8 [id=66ecaf2b23994e908b2db3b58712b911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.010087 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e08673df04a45b69e65f13a517e906d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.010886 1200 tablet_bootstrap.cc:654] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:09.016510 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 28a09107b11d480dba8c456fc8753ad1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28a09107b11d480dba8c456fc8753ad1 already in progress: creating tablet
I20260619 19:54:09.017014 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 90b8468df4a449d088f47b3b150ce54a (table default.Table_9b463251c2ed4c56aeccc8c045d3dd06 [id=56ee4af476f74b9ab373fb2bfc1c315e]) successfully deleted
I20260619 19:54:09.021651 2548 raft_consensus.cc:2749] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:09.030718 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1b18a61d955e4929998b90c6c8fa844e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b18a61d955e4929998b90c6c8fa844e already in progress: creating tablet
W20260619 19:54:09.031056 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 774938222588473e90c513232c82aece because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774938222588473e90c513232c82aece already in progress: creating tablet
I20260619 19:54:09.033223 1034 tablet_service.cc:1511] Processing CreateTablet for tablet d4405af54e00410797faa4371f0215b2 (DEFAULT_TABLE table=default.Table_8080156f951b428fac94858452041919 [id=8eacb201ef624613b3411c329cc4dfce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.033669 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4405af54e00410797faa4371f0215b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.033716 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 983faf8557814093bc427291711f3fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.034003 884 tablet_service.cc:1511] Processing CreateTablet for tablet 9e08673df04a45b69e65f13a517e906d (DEFAULT_TABLE table=default.Table_54977c57c4894a379cf160aba236e9e8 [id=66ecaf2b23994e908b2db3b58712b911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.034355 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e08673df04a45b69e65f13a517e906d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.039674 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f87a9d76b99f4dce864cf3b75b3062e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.047887 858 leader_election.cc:343] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fbc952b283d94035be1f86f3b90382b6
I20260619 19:54:09.048178 858 leader_election.cc:304] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:09.048527 858 raft_consensus.cc:2686] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:54:09.049823 858 leader_election.cc:343] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 82d2dd6eedd24f44a6a17aceb20e62bb
I20260619 19:54:09.050076 858 leader_election.cc:304] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.050354 2548 raft_consensus.cc:2749] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:09.051153 858 leader_election.cc:304] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.051447 2548 raft_consensus.cc:2804] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:09.051548 2548 raft_consensus.cc:493] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:09.051720 2548 raft_consensus.cc:3060] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:09.052791 2677 raft_consensus.cc:493] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:09.052985 2677 raft_consensus.cc:515] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:09.053570 526 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 3 got 0
I20260619 19:54:09.053853 2677 leader_election.cc:290] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:09.054306 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf] alter complete (version 3)
I20260619 19:54:09.055956 2548 raft_consensus.cc:515] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
W20260619 19:54:09.057037 859 leader_election.cc:343] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 5bae5be1340f4158a0b243415e232ae5
W20260619 19:54:09.057376 859 leader_election.cc:343] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:09.057986 2548 leader_election.cc:290] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:09.058132 2677 consensus_queue.cc:1048] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:09.058650 858 leader_election.cc:304] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.058858 2677 raft_consensus.cc:2749] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:09.058915 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f87a9d76b99f4dce864cf3b75b3062e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.059202 858 leader_election.cc:304] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:08.958644 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 3be362aa28504b729801de35d869beac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.958779 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 180c3fd33d854a06a7cfd2f9671557a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:08.959236 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:08.968250 720 leader_election.cc:343] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3
W20260619 19:54:09.061147 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 92903.3us
I20260619 19:54:09.061271 1973 log.cc:1199] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:08.993963 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6ad82f0c94e27b2eb4dbf185fab66" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:09.061798 1973 ts_tablet_manager.cc:1950] T 79f8635b919a44a8a1e5fe48420ca4b7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:09.061890 785 raft_consensus.cc:2468] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:08.998297 1208 tablet_bootstrap.cc:492] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:09.064554 1208 tablet_bootstrap.cc:654] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.064898 2026 ts_tablet_manager.cc:1929] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.065004 2026 log.cc:1199] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fbc952b283d94035be1f86f3b90382b6
I20260619 19:54:09.037840 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26355bc6b5c147a88c14a9f053b4e1f3" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:09.065302 2026 ts_tablet_manager.cc:1950] T fbc952b283d94035be1f86f3b90382b6 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:09.065416 777 raft_consensus.cc:2393] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:09.038220 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 983faf8557814093bc427291711f3fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.038661 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9e08673df04a45b69e65f13a517e906d (DEFAULT_TABLE table=default.Table_54977c57c4894a379cf160aba236e9e8 [id=66ecaf2b23994e908b2db3b58712b911]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.066049 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e08673df04a45b69e65f13a517e906d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.066489 996 leader_election.cc:304] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:09.067098 2615 raft_consensus.cc:2804] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:09.067242 2615 raft_consensus.cc:493] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:09.067330 2615 raft_consensus.cc:3060] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.070472 2615 raft_consensus.cc:515] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.039121 749 tablet_service.cc:1511] Processing CreateTablet for tablet d4405af54e00410797faa4371f0215b2 (DEFAULT_TABLE table=default.Table_8080156f951b428fac94858452041919 [id=8eacb201ef624613b3411c329cc4dfce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.071523 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4405af54e00410797faa4371f0215b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.072847 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6ad82f0c94e27b2eb4dbf185fab66" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:09.073046 777 raft_consensus.cc:3060] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.076504 777 raft_consensus.cc:2468] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:09.077064 2615 leader_election.cc:290] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.077394 996 leader_election.cc:304] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:09.088272 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9bbb285ac65b4d1f976f736071ea68cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.091501 884 tablet_service.cc:1511] Processing CreateTablet for tablet d4405af54e00410797faa4371f0215b2 (DEFAULT_TABLE table=default.Table_8080156f951b428fac94858452041919 [id=8eacb201ef624613b3411c329cc4dfce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.091711 2691 raft_consensus.cc:2804] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:09.092347 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4405af54e00410797faa4371f0215b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.092690 2691 raft_consensus.cc:697] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:09.093029 2691 consensus_queue.cc:237] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.095017 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 309) took 3340 ms. Trace:
I20260619 19:54:09.095975 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d5ddb8412ad145dd85916bf5d756a9f0
I20260619 19:54:09.096201 2677 raft_consensus.cc:2749] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.096685 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 0f3a48eabb574be3bc6883cf555b657f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:09.097194 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f9584ecbe09048ff96f36ffc361d09b7" } modify_external_catalogs: true
I20260619 19:54:09.099165 1973 rpcz_store.cc:276] 0619 19:54:05.754184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.763187 (+ 9003us) service_pool.cc:224] Handling call
0619 19:54:08.927980 (+3164793us) ts_tablet_manager.cc:1151] Deleting tablet 79f8635b919a44a8a1e5fe48420ca4b7
0619 19:54:08.927988 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.954516 (+ 26528us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:08.957440 (+ 2924us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.094991 (+137551us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3164623}
I20260619 19:54:09.099769 1973 tablet_replica.cc:333] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:09.099946 889 tablet_service.cc:1558] Processing DeleteTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 with delete_type TABLET_DATA_DELETED (replaced by tablet f9d9e816e001403a820caca4916f8824) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.100540 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f9584ecbe09048ff96f36ffc361d09b7" } modify_external_catalogs: true
I20260619 19:54:09.100641 1973 raft_consensus.cc:2243] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.100831 1973 raft_consensus.cc:2272] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.101395 1973 ts_tablet_manager.cc:1916] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:09.102242 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28fc6b68c1584bb2bcc27a63cf0df0ba consensus state has no leader
I20260619 19:54:09.104779 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3197bcf4217d49889e1beb721a00a0df" } new_table_name: "default.Table_97f0e0bd83a94191a3339611d258d716" modify_external_catalogs: true
I20260619 19:54:09.105873 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 904e20649a5f4c49a93bb084c1d3bb9a
I20260619 19:54:09.108631 531 catalog_manager.cc:6784] ReplaceTablet: tablet d5ddb8412ad145dd85916bf5d756a9f0 deleted and replaced by tablet f9d9e816e001403a820caca4916f8824
I20260619 19:54:09.107401 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_a3f0b91866884789b9a1ddc76a59ca8f [id=8de7c14aec0549bfa81434211594c5eb] alter complete (version 2)
I20260619 19:54:09.110299 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 151) took 7792 ms. Trace:
I20260619 19:54:09.110471 2026 rpcz_store.cc:276] 0619 19:54:01.317582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.324772 (+ 7190us) service_pool.cc:224] Handling call
0619 19:54:08.976190 (+7651418us) ts_tablet_manager.cc:1151] Deleting tablet fbc952b283d94035be1f86f3b90382b6
0619 19:54:08.978319 (+ 2129us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:08.998171 (+ 19852us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.064830 (+ 66659us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.110276 (+ 45446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11338,"tablet-delete.queue_time_us":7651123}
I20260619 19:54:09.112493 2026 tablet_replica.cc:333] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:09.112887 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e8b0363f7f4a4634977b3e2f64ec2386" } modify_external_catalogs: true
I20260619 19:54:09.113111 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_674e1047a5ad4fe2a56f104962de4b06" } new_table_name: "default.Table_0258778fee574c1a9ed68d07e46694f4" modify_external_catalogs: true
I20260619 19:54:09.113204 2026 raft_consensus.cc:2243] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.113350 2026 raft_consensus.cc:2272] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.113865 2026 ts_tablet_manager.cc:1916] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.115401 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 904e20649a5f4c49a93bb084c1d3bb9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:09.115835 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bbb285ac65b4d1f976f736071ea68cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.118520 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fbc952b283d94035be1f86f3b90382b6 (table default.Table_03e300273881446b96748d3f1700e660 [id=54877119611f4e15a110f1c502001db6]) successfully deleted
I20260619 19:54:09.117949 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6ad82f0c94e27b2eb4dbf185fab66" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:09.119335 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e8b0363f7f4a4634977b3e2f64ec2386" } modify_external_catalogs: true
I20260619 19:54:09.134450 889 tablet_service.cc:1511] Processing CreateTablet for tablet 8c74c898beb54b52999e1c52434b16cf (DEFAULT_TABLE table=default.Table_c83114cdb88a48a79cc3c49817a51222 [id=23257820be9b4accb8186d743292e5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.134954 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c74c898beb54b52999e1c52434b16cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.135041 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d78c9341be6f497b822f0d52c9a63534" } modify_external_catalogs: true
I20260619 19:54:09.135622 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d78c9341be6f497b822f0d52c9a63534" } modify_external_catalogs: true
I20260619 19:54:09.137018 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.137676 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.144116 719 leader_election.cc:304] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.144438 2516 raft_consensus.cc:2749] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260619 19:54:09.151249 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 112234us
I20260619 19:54:09.152181 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 983faf8557814093bc427291711f3fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.157382 1994 tablet_replica.cc:333] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:09.157509 896 tablet_service.cc:1511] Processing CreateTablet for tablet 226b636ca31f40138488d4fc2c85358a (DEFAULT_TABLE table=default.Table_f7830d1bf3d24690974e40ce41686a3a [id=3d75c1f28fe549f19c1db86cf9fec44a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.157714 1994 raft_consensus.cc:2243] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.157984 1994 raft_consensus.cc:2272] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.158715 1994 ts_tablet_manager.cc:1916] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.168285 2615 raft_consensus.cc:493] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.168582 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.168869 2615 raft_consensus.cc:515] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.169584 2615 leader_election.cc:290] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.170272 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 8c74c898beb54b52999e1c52434b16cf (DEFAULT_TABLE table=default.Table_c83114cdb88a48a79cc3c49817a51222 [id=23257820be9b4accb8186d743292e5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.178747 1973 ts_tablet_manager.cc:1929] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:09.179399 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c74c898beb54b52999e1c52434b16cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.179975 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226b636ca31f40138488d4fc2c85358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.172039 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 with delete_type TABLET_DATA_DELETED (replaced by tablet f9d9e816e001403a820caca4916f8824) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.172286 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 904e20649a5f4c49a93bb084c1d3bb9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.172461 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet cc57b42a97fa437b93842f7cd379dbb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:09.172472 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 90418.2us
I20260619 19:54:09.172916 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 226b636ca31f40138488d4fc2c85358a (DEFAULT_TABLE table=default.Table_f7830d1bf3d24690974e40ce41686a3a [id=3d75c1f28fe549f19c1db86cf9fec44a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.181257 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226b636ca31f40138488d4fc2c85358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.183215 2269 raft_consensus.cc:493] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:09.183378 2269 raft_consensus.cc:515] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:09.184051 2269 leader_election.cc:290] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:09.184571 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b88dd7d19514e83857e2c6108291b9f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:09.185228 996 leader_election.cc:343] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:09.186146 859 leader_election.cc:343] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 7fb8df8d8ac047bfa6ab7a6b533e38fc
W20260619 19:54:09.186705 996 leader_election.cc:343] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.189345 858 leader_election.cc:304] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.190048 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_ec6d85adf799497db51a92f71faf281a [id=0206e06d5e5f4829aecf4be95ceea42d]) successfully deleted
I20260619 19:54:09.190589 2269 raft_consensus.cc:2749] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.178925 1973 log.cc:1199] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fcaeebaaa93c479bafff14d312d526ec
I20260619 19:54:09.194610 1973 ts_tablet_manager.cc:1950] T fcaeebaaa93c479bafff14d312d526ec P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:09.184187 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b88dd7d19514e83857e2c6108291b9f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:09.197232 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54b2e4f657245c2aa23d138968b3b0d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:09.197441 777 raft_consensus.cc:3060] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.201342 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221cc85629ca41e9ad71adfe0beb392a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:09.201624 785 raft_consensus.cc:3060] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:09.205627 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0f3a48eabb574be3bc6883cf555b657f
W20260619 19:54:09.205778 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55404d15d42244c6b42272143c44ff9c consensus state has no leader
I20260619 19:54:09.206216 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8d50f1b1ec814e8d85b077e1eb08a18c" } new_table_name: "default.Table_83d2ac6790e3427896025cdac0782895" modify_external_catalogs: true
I20260619 19:54:09.206605 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ac2d419a6e5d466e97df971b31640519
W20260619 19:54:09.207762 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d77de42bb514452a8dc6a4a71289dc59 consensus state has no leader
I20260619 19:54:09.207808 531 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet b0707120be7f43cc9dad817bb61ede9e
I20260619 19:54:09.208102 531 master_service.cc:960] ReplaceTablet: received request to replace tablet a54231986cca44258942dbc3373870b2 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:09.208261 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3a3dfe74f3c24eef96314e4728415493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.208768 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e2103c40b6764802b83ec0dd628505e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.210108 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4987fd27300444088d5b028d1285b62b" } new_table_name: "default.Table_1ecc1b0d512443f3b3ece618b052d7a9" modify_external_catalogs: true
I20260619 19:54:09.213307 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_61c5a25012404c098fa35b67fe3de51c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.221545 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 67faf5d554074ab3bdf79075f649f4e0
I20260619 19:54:09.221624 1023 tablet_service.cc:1511] Processing CreateTablet for tablet c72c51c230b644f2b000bd9fb1098c44 (DEFAULT_TABLE table=default.Table_59b60a002f8f410484eb04cb5925bb66 [id=1924c57fcd8945c08dd7a825499d785e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.222236 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c51c230b644f2b000bd9fb1098c44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:09.222545 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a3dfe74f3c24eef96314e4728415493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:09.223843 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2103c40b6764802b83ec0dd628505e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.224372 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 313) took 3415 ms. Trace:
I20260619 19:54:09.224472 1973 rpcz_store.cc:276] 0619 19:54:05.809109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.809154 (+ 45us) service_pool.cc:224] Handling call
0619 19:54:09.099715 (+3290561us) ts_tablet_manager.cc:1151] Deleting tablet fcaeebaaa93c479bafff14d312d526ec
0619 19:54:09.099727 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.174638 (+ 74911us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.178665 (+ 4027us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.224348 (+ 45683us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289235}
I20260619 19:54:09.224931 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 321) took 3273 ms. Trace:
I20260619 19:54:09.225001 1973 rpcz_store.cc:276] 0619 19:54:05.951544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.951612 (+ 68us) service_pool.cc:224] Handling call
0619 19:54:09.224800 (+3273188us) ts_tablet_manager.cc:1151] Deleting tablet 788550efad2f4dbc917131cff1e76f09
0619 19:54:09.224809 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.224913 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3272955}
I20260619 19:54:09.225324 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 322) took 3273 ms. Trace:
I20260619 19:54:09.225392 1973 rpcz_store.cc:276] 0619 19:54:05.951646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.951761 (+ 115us) service_pool.cc:224] Handling call
0619 19:54:09.225216 (+3273455us) ts_tablet_manager.cc:1151] Deleting tablet a54231986cca44258942dbc3373870b2
0619 19:54:09.225223 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.225310 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3228719}
I20260619 19:54:09.225636 1973 tablet_replica.cc:333] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:09.226547 530 master_service.cc:960] ReplaceTablet: received request to replace tablet fb6bc52ee1fa4ac8967f937e59b4550c from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:09.227239 526 master_service.cc:960] ReplaceTablet: received request to replace tablet b546831050f84a91b8e4df5b96b1be14 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:09.227522 524 catalog_manager.cc:6784] ReplaceTablet: tablet 0f3a48eabb574be3bc6883cf555b657f deleted and replaced by tablet 3c842fad1b6b42e9ae959560e466bc98
I20260619 19:54:09.228250 2026 ts_tablet_manager.cc:1929] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.228382 2026 log.cc:1199] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/550297c4d14f4d679d11fded97b671ae
I20260619 19:54:09.228698 2026 ts_tablet_manager.cc:1950] T 550297c4d14f4d679d11fded97b671ae P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:09.228811 996 leader_election.cc:343] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.228935 996 leader_election.cc:304] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:09.229015 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 125) took 7953 ms. Trace:
I20260619 19:54:09.229163 2694 raft_consensus.cc:2749] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.229084 2026 rpcz_store.cc:276] 0619 19:54:01.275378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.275434 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:09.111085 (+7835651us) ts_tablet_manager.cc:1151] Deleting tablet 550297c4d14f4d679d11fded97b671ae
0619 19:54:09.111095 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.179332 (+ 68237us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.228169 (+ 48837us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.228997 (+ 828us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7785884}
W20260619 19:54:09.229379 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61c5a25012404c098fa35b67fe3de51c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.229486 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 129) took 7931 ms. Trace:
I20260619 19:54:09.229555 2026 rpcz_store.cc:276] 0619 19:54:01.298268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.298335 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:09.229375 (+7931040us) ts_tablet_manager.cc:1151] Deleting tablet 40e1b92467a44737bfabb6ec1c924ea1
0619 19:54:09.229384 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.229460 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7903296}
I20260619 19:54:09.229799 2026 tablet_replica.cc:333] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:09.229981 2026 raft_consensus.cc:2243] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.230146 2026 raft_consensus.cc:2272] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.230686 2026 ts_tablet_manager.cc:1916] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.231045 777 raft_consensus.cc:2468] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:09.234175 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 550297c4d14f4d679d11fded97b671ae (table default.Table_38a961b0cc2946c7b79e57cd66fbe323 [id=99ef9345e27d4380b7312b1cc8dc8b8e]) successfully deleted
I20260619 19:54:09.234493 896 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2d419a6e5d466e97df971b31640519 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:09.235077 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 40e1b92467a44737bfabb6ec1c924ea1 because the tablet was not found. No further retry: Not found: Tablet not found: 40e1b92467a44737bfabb6ec1c924ea1
I20260619 19:54:09.235330 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 67faf5d554074ab3bdf79075f649f4e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.235733 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f3a48eabb574be3bc6883cf555b657f with delete_type TABLET_DATA_DELETED (replaced by tablet 3c842fad1b6b42e9ae959560e466bc98) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.237596 896 tablet_service.cc:1511] Processing CreateTablet for tablet c72c51c230b644f2b000bd9fb1098c44 (DEFAULT_TABLE table=default.Table_59b60a002f8f410484eb04cb5925bb66 [id=1924c57fcd8945c08dd7a825499d785e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.234396 529 catalog_manager.cc:5696] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:09.239321 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7283055752d94a8d8dea3cf8ca00d333"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.239411 884 tablet_service.cc:1511] Processing CreateTablet for tablet f5057229e0d04eafb501356ad8f649ba (DEFAULT_TABLE table=default.Table_5e80cab5977d47aeba48ad866fdf975a [id=0f8d0e29ff394315bfcd655661f33189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.238948 529 catalog_manager.cc:5696] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:09.239925 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
W20260619 19:54:09.240083 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7283055752d94a8d8dea3cf8ca00d333 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.240823 529 catalog_manager.cc:5696] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:09.178889 1994 ts_tablet_manager.cc:1929] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:09.242517 1994 log.cc:1199] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/983faf8557814093bc427291711f3fce
I20260619 19:54:09.243072 1994 ts_tablet_manager.cc:1950] T 983faf8557814093bc427291711f3fce P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:09.244156 2269 raft_consensus.cc:493] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.244287 2269 raft_consensus.cc:515] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.244971 2269 leader_election.cc:290] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:09.245426 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f3a48eabb574be3bc6883cf555b657f with delete_type TABLET_DATA_DELETED (replaced by tablet 3c842fad1b6b42e9ae959560e466bc98) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.245648 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 67faf5d554074ab3bdf79075f649f4e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.246136 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd9525ba72d45b089442a6e6a73cc74 (DEFAULT_TABLE table=default.Table_97bf32159dc444559df0fc5c5cfd2452 [id=c0024d5fce51418bb11fb94787df09ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.246145 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f5057229e0d04eafb501356ad8f649ba (DEFAULT_TABLE table=default.Table_5e80cab5977d47aeba48ad866fdf975a [id=0f8d0e29ff394315bfcd655661f33189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.246519 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2d419a6e5d466e97df971b31640519 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.246567 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd9525ba72d45b089442a6e6a73cc74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:09.246656 859 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:09.246734 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5057229e0d04eafb501356ad8f649ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.251422 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_621d668c6fc94dd3a19c02f225892fe2" } modify_external_catalogs: true
I20260619 19:54:09.251672 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_621d668c6fc94dd3a19c02f225892fe2" } modify_external_catalogs: true
I20260619 19:54:09.258072 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 with delete_type TABLET_DATA_DELETED (replaced by tablet f9d9e816e001403a820caca4916f8824) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.258685 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8c74c898beb54b52999e1c52434b16cf (DEFAULT_TABLE table=default.Table_c83114cdb88a48a79cc3c49817a51222 [id=23257820be9b4accb8186d743292e5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.259049 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c74c898beb54b52999e1c52434b16cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.265020 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 904e20649a5f4c49a93bb084c1d3bb9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.265278 746 tablet_service.cc:1511] Processing CreateTablet for tablet 226b636ca31f40138488d4fc2c85358a (DEFAULT_TABLE table=default.Table_f7830d1bf3d24690974e40ce41686a3a [id=3d75c1f28fe549f19c1db86cf9fec44a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.265731 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226b636ca31f40138488d4fc2c85358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.269618 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c51c230b644f2b000bd9fb1098c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.270117 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5057229e0d04eafb501356ad8f649ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.270079 785 raft_consensus.cc:2468] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 2.
I20260619 19:54:09.270197 1973 raft_consensus.cc:2243] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.270553 1973 raft_consensus.cc:2272] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.271123 1973 ts_tablet_manager.cc:1916] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.277359 2026 ts_tablet_manager.cc:1929] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.283819 2026 log.cc:1199] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/68746ca7888e4af891238f79dcfdde10
I20260619 19:54:09.284165 2026 ts_tablet_manager.cc:1950] T 68746ca7888e4af891238f79dcfdde10 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:09.284228 1994 tablet_replica.cc:333] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:09.284514 1994 raft_consensus.cc:2243] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.284770 1994 raft_consensus.cc:2272] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.285348 1994 ts_tablet_manager.cc:1916] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.286576 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]) successfully deleted
I20260619 19:54:09.290555 2637 tablet.cc:1724] T bb547965fc7e4aa29d427b1acc7d6e51 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:09.291844 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b57f64f97cdc493ea48e08d897bfc982 consensus state has no leader
I20260619 19:54:09.293426 746 tablet_service.cc:1511] Processing CreateTablet for tablet c72c51c230b644f2b000bd9fb1098c44 (DEFAULT_TABLE table=default.Table_59b60a002f8f410484eb04cb5925bb66 [id=1924c57fcd8945c08dd7a825499d785e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.294194 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f238923ba00645f989b04e383fbcb760"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.294788 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_af2f1c9e09b845669ba83b6327f8bea4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.295047 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f3a48eabb574be3bc6883cf555b657f with delete_type TABLET_DATA_DELETED (replaced by tablet 3c842fad1b6b42e9ae959560e466bc98) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:09.295594 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af2f1c9e09b845669ba83b6327f8bea4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:09.297670 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f238923ba00645f989b04e383fbcb760 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.312374 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ccaf614a02d2417bb6703630eabddabe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.313218 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccaf614a02d2417bb6703630eabddabe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.314204 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_40536a5e373e47c9b8768101493707a2" } new_table_name: "default.Table_dbf85bbf3e0944f0a1fa9d9ff7257b8a" modify_external_catalogs: true
I20260619 19:54:09.320188 896 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd9525ba72d45b089442a6e6a73cc74 (DEFAULT_TABLE table=default.Table_97bf32159dc444559df0fc5c5cfd2452 [id=c0024d5fce51418bb11fb94787df09ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.320637 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd9525ba72d45b089442a6e6a73cc74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.321170 884 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe5f6be6bf445509ab6a3bac320d525 (DEFAULT_TABLE table=default.Table_ea0c90c0f0554b60a2b9e8e37c4fe43e [id=5cdede2bf74d4d10b65658fb09db5abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.321587 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe5f6be6bf445509ab6a3bac320d525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.329035 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe5f6be6bf445509ab6a3bac320d525 (DEFAULT_TABLE table=default.Table_ea0c90c0f0554b60a2b9e8e37c4fe43e [id=5cdede2bf74d4d10b65658fb09db5abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.329484 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe5f6be6bf445509ab6a3bac320d525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.329936 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2d419a6e5d466e97df971b31640519 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.330282 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 67faf5d554074ab3bdf79075f649f4e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.330837 761 tablet_service.cc:1511] Processing CreateTablet for tablet f5057229e0d04eafb501356ad8f649ba (DEFAULT_TABLE table=default.Table_5e80cab5977d47aeba48ad866fdf975a [id=0f8d0e29ff394315bfcd655661f33189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.331445 749 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd9525ba72d45b089442a6e6a73cc74 (DEFAULT_TABLE table=default.Table_97bf32159dc444559df0fc5c5cfd2452 [id=c0024d5fce51418bb11fb94787df09ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.332015 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]) successfully deleted
I20260619 19:54:09.332191 747 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe5f6be6bf445509ab6a3bac320d525 (DEFAULT_TABLE table=default.Table_ea0c90c0f0554b60a2b9e8e37c4fe43e [id=5cdede2bf74d4d10b65658fb09db5abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.332548 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 0a8c49f78e984e1ebd0c4e79a457447c (DEFAULT_TABLE table=default.Table_6163515494404bd0aeba25314d70b905 [id=37b4ba906a864b0183964d0a888fd542]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:09.332778 858 leader_election.cc:343] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 5bae5be1340f4158a0b243415e232ae5
I20260619 19:54:09.332892 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c49f78e984e1ebd0c4e79a457447c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.332895 858 leader_election.cc:304] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.333527 2548 raft_consensus.cc:2749] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:09.335456 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 132) took 8036 ms. Trace:
I20260619 19:54:09.335547 2026 rpcz_store.cc:276] 0619 19:54:01.298987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.299193 (+ 206us) service_pool.cc:224] Handling call
0619 19:54:09.229754 (+7930561us) ts_tablet_manager.cc:1151] Deleting tablet 68746ca7888e4af891238f79dcfdde10
0619 19:54:09.229763 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.269533 (+ 39770us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.277301 (+ 7768us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.335440 (+ 58139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7903620}
I20260619 19:54:09.335850 2026 tablet_replica.cc:333] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:09.336016 2026 raft_consensus.cc:2243] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.336151 2026 raft_consensus.cc:2272] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.336674 2026 ts_tablet_manager.cc:1916] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.337808 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 68746ca7888e4af891238f79dcfdde10 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]) successfully deleted
I20260619 19:54:09.356976 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd9525ba72d45b089442a6e6a73cc74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.357204 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5057229e0d04eafb501356ad8f649ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.357503 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe5f6be6bf445509ab6a3bac320d525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.360260 884 tablet_service.cc:1511] Processing CreateTablet for tablet 0a8c49f78e984e1ebd0c4e79a457447c (DEFAULT_TABLE table=default.Table_6163515494404bd0aeba25314d70b905 [id=37b4ba906a864b0183964d0a888fd542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.361413 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72c51c230b644f2b000bd9fb1098c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.366497 1201 tablet_bootstrap.cc:492] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.366654 1201 ts_tablet_manager.cc:1403] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.474s user 0.007s sys 0.000s
I20260619 19:54:09.366852 1208 tablet_bootstrap.cc:492] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:09.366984 1208 ts_tablet_manager.cc:1403] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.369s user 0.003s sys 0.013s
I20260619 19:54:09.356980 1973 ts_tablet_manager.cc:1929] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:09.367532 1973 log.cc:1199] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/221cc85629ca41e9ad71adfe0beb392a
I20260619 19:54:09.367666 1208 raft_consensus.cc:359] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.367931 1208 raft_consensus.cc:385] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.368037 1208 raft_consensus.cc:740] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.368048 1201 raft_consensus.cc:359] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.368224 1201 raft_consensus.cc:385] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.368278 1201 raft_consensus.cc:740] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.368533 1201 consensus_queue.cc:260] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.368611 1208 consensus_queue.cc:260] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.369051 1201 ts_tablet_manager.cc:1434] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:09.369336 1201 tablet_bootstrap.cc:492] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.369717 1208 ts_tablet_manager.cc:1434] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:09.370296 1973 ts_tablet_manager.cc:1950] T 221cc85629ca41e9ad71adfe0beb392a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:09.372890 1201 tablet_bootstrap.cc:654] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:09.373983 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 788550efad2f4dbc917131cff1e76f09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 788550efad2f4dbc917131cff1e76f09 already in progress: creating tablet
I20260619 19:54:09.374035 858 leader_election.cc:304] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:09.374332 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a54231986cca44258942dbc3373870b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a54231986cca44258942dbc3373870b2 already in progress: creating tablet
W20260619 19:54:09.374440 858 leader_election.cc:343] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:09.374529 858 leader_election.cc:304] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:09.375005 858 leader_election.cc:343] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:54:09.375221 2539 raft_consensus.cc:2804] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:09.375311 2539 raft_consensus.cc:697] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:09.375537 2539 consensus_queue.cc:237] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.376456 2509 raft_consensus.cc:2749] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260619 19:54:09.375108 858 leader_election.cc:304] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:09.377494 858 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:09.377578 858 leader_election.cc:304] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.377839 858 leader_election.cc:304] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.378208 2548 raft_consensus.cc:2749] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:09.378332 2548 raft_consensus.cc:2749] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.378418 2548 raft_consensus.cc:2804] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:09.378492 2548 raft_consensus.cc:697] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:09.378721 2548 consensus_queue.cc:237] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:09.382448 858 consensus_peers.cc:597] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcaeebaaa93c479bafff14d312d526ec. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:09.391250 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0a8c49f78e984e1ebd0c4e79a457447c (DEFAULT_TABLE table=default.Table_6163515494404bd0aeba25314d70b905 [id=37b4ba906a864b0183964d0a888fd542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.398531 2509 raft_consensus.cc:493] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:09.398703 2509 raft_consensus.cc:515] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:09.399335 2509 leader_election.cc:290] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:09.400532 859 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:09.406239 1201 tablet_bootstrap.cc:492] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.406406 1201 ts_tablet_manager.cc:1403] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20260619 19:54:09.407097 1201 raft_consensus.cc:359] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.407289 1201 raft_consensus.cc:385] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.407351 1201 raft_consensus.cc:740] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.412003 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c49f78e984e1ebd0c4e79a457447c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.412040 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:09.412258 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]). Expected version 3 got 0
I20260619 19:54:09.415750 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:09.421355 2692 raft_consensus.cc:493] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.421787 2692 raft_consensus.cc:515] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.424173 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc11c632b514118856ea4c11b431142" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:09.424542 785 raft_consensus.cc:2468] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:09.425333 996 leader_election.cc:304] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:09.425623 2694 raft_consensus.cc:493] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.425745 2694 raft_consensus.cc:515] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.426342 2694 leader_election.cc:290] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.426646 2694 raft_consensus.cc:2804] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:09.426715 2694 raft_consensus.cc:493] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:09.426772 2694 raft_consensus.cc:3060] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.431849 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fb6bc52ee1fa4ac8967f937e59b4550c
I20260619 19:54:09.432495 530 catalog_manager.cc:6784] ReplaceTablet: tablet fb6bc52ee1fa4ac8967f937e59b4550c deleted and replaced by tablet 0476b1447f984f548d06e71cdda6a875
I20260619 19:54:09.433029 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5916dd401c144d7f9c23431c595e9ba8" } modify_external_catalogs: true
I20260619 19:54:09.433275 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5916dd401c144d7f9c23431c595e9ba8" } modify_external_catalogs: true
I20260619 19:54:09.434211 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098d5bd070b54889905539f1fa1a47e6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:09.434825 2539 raft_consensus.cc:493] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:09.434850 996 leader_election.cc:343] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.434973 2539 raft_consensus.cc:515] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.436584 2539 leader_election.cc:290] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:09.436667 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_48480bf0e6404c51870932c9cb33ad23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.437165 859 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 90b8468df4a449d088f47b3b150ce54a
W20260619 19:54:09.437398 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48480bf0e6404c51870932c9cb33ad23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.437593 1201 consensus_queue.cc:260] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.438190 1201 ts_tablet_manager.cc:1434] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260619 19:54:09.438508 1201 tablet_bootstrap.cc:492] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.439415 896 tablet_service.cc:1558] Processing DeleteTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c with delete_type TABLET_DATA_DELETED (replaced by tablet 0476b1447f984f548d06e71cdda6a875) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.440040 1201 tablet_bootstrap.cc:654] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.440719 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098d5bd070b54889905539f1fa1a47e6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:09.440940 785 raft_consensus.cc:2468] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:09.441440 996 leader_election.cc:304] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:09.441962 2615 raft_consensus.cc:2804] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:09.442049 2615 raft_consensus.cc:493] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:09.442119 2615 raft_consensus.cc:3060] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.443222 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c with delete_type TABLET_DATA_DELETED (replaced by tablet 0476b1447f984f548d06e71cdda6a875) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.447664 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 325) took 3095 ms. Trace:
I20260619 19:54:09.447902 2539 raft_consensus.cc:493] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:09.447791 1973 rpcz_store.cc:276] 0619 19:54:06.352146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.352219 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:09.225593 (+2873374us) ts_tablet_manager.cc:1151] Deleting tablet 221cc85629ca41e9ad71adfe0beb392a
0619 19:54:09.225602 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.270431 (+ 44829us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x6160000e5654. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1e07e0 00007eff4e52c933 00007eff510efae7 00007eff51122bb4 00007eff511035d0 00007eff5110335d 0000000000aa681c 00007eff411809ff 00007eff41183d1b 00007eff41183b98
0619 19:54:09.274389 (+ 3958us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.356923 (+ 82534us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.447643 (+ 90720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102052224,"tablet-delete.queue_time_us":2873152}
I20260619 19:54:09.448130 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c49f78e984e1ebd0c4e79a457447c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:09.448146 1973 tablet_replica.cc:333] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:09.448084 2539 raft_consensus.cc:515] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:09.448319 1973 raft_consensus.cc:2243] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:09.448645 1973 raft_consensus.cc:2272] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:09.449501 859 leader_election.cc:343] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d97025f1e0634720bc68d0a6196bd20b
I20260619 19:54:09.449236 2539 leader_election.cc:290] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:09.449786 1973 ts_tablet_manager.cc:1916] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.450009 2539 raft_consensus.cc:493] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.450124 2539 raft_consensus.cc:515] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.451270 2026 ts_tablet_manager.cc:1929] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.451361 2026 log.cc:1199] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/74949d09466f42e2852389e10192989d
I20260619 19:54:09.451373 2539 leader_election.cc:290] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:09.451362 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:09.451584 1055 raft_consensus.cc:2393] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:09.451689 2026 ts_tablet_manager.cc:1950] T 74949d09466f42e2852389e10192989d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:09.466310 2694 raft_consensus.cc:515] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.467396 2694 leader_election.cc:290] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.467856 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc11c632b514118856ea4c11b431142" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:09.471325 996 leader_election.cc:343] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.471688 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc11c632b514118856ea4c11b431142" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:09.471921 785 raft_consensus.cc:3060] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.472687 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 130) took 8174 ms. Trace:
I20260619 19:54:09.472802 2026 rpcz_store.cc:276] 0619 19:54:01.298725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.299080 (+ 355us) service_pool.cc:224] Handling call
0619 19:54:09.335808 (+8036728us) ts_tablet_manager.cc:1151] Deleting tablet 74949d09466f42e2852389e10192989d
0619 19:54:09.335816 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.353332 (+ 17516us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.451216 (+ 97884us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.472662 (+ 21446us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8009629}
I20260619 19:54:09.473412 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 74949d09466f42e2852389e10192989d (table default.Table_6331efa968674c528aa9785a2ee9deb9 [id=fcf00dfcc0374847883336aee0a57d34]) successfully deleted
I20260619 19:54:09.473775 2026 tablet_replica.cc:333] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:09.473981 2026 raft_consensus.cc:2243] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:09.474367 2026 raft_consensus.cc:2272] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.475184 2026 ts_tablet_manager.cc:1916] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.481456 2539 raft_consensus.cc:493] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:09.481644 2539 raft_consensus.cc:515] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.482661 2539 leader_election.cc:290] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:09.483839 859 leader_election.cc:343] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:09.493296 2692 leader_election.cc:290] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.493736 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc11c632b514118856ea4c11b431142" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:09.494621 1200 tablet_bootstrap.cc:492] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:09.494776 1200 ts_tablet_manager.cc:1403] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.509s user 0.004s sys 0.002s
W20260619 19:54:09.495702 996 leader_election.cc:343] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.503878 1208 tablet_bootstrap.cc:492] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:09.496534 1200 raft_consensus.cc:359] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.512718 1200 raft_consensus.cc:385] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.512828 1200 raft_consensus.cc:740] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.513238 1200 consensus_queue.cc:260] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.516222 2539 raft_consensus.cc:493] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:09.516386 2539 raft_consensus.cc:515] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:09.518086 859 leader_election.cc:343] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:09.518244 2539 leader_election.cc:290] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:09.521855 2708 tablet.cc:1724] T 08ef46cfced54742832fd3c01f952a9d P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:09.524032 2709 tablet.cc:1724] T 08ef46cfced54742832fd3c01f952a9d P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:09.533633 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_94d5b0a1504044b7a1934b5c726b29d4 [id=96dda797fa474e119e765b5d9946bfb7]) successfully deleted
I20260619 19:54:09.538322 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a9c96d9c034a4a8a4d05d8518ebcec" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:09.540050 761 tablet_service.cc:1558] Processing DeleteTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c with delete_type TABLET_DATA_DELETED (replaced by tablet 0476b1447f984f548d06e71cdda6a875) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.543330 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a5d67c87b793425982fdfaddadd3b827" } new_table_name: "default.Table_84d6e7a18d774747831d92c19462ca03" modify_external_catalogs: true
I20260619 19:54:09.545145 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_87768bcb7d2347faa2a8624f28911b02" } modify_external_catalogs: true
I20260619 19:54:09.545341 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_87768bcb7d2347faa2a8624f28911b02" } modify_external_catalogs: true
I20260619 19:54:09.548148 2615 raft_consensus.cc:515] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.548885 2615 leader_election.cc:290] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.549779 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098d5bd070b54889905539f1fa1a47e6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:09.550257 1200 ts_tablet_manager.cc:1434] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.055s user 0.003s sys 0.000s
W20260619 19:54:09.550988 996 leader_election.cc:343] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.552398 1200 tablet_bootstrap.cc:492] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:09.562934 1994 ts_tablet_manager.cc:1929] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.563529 1994 log.cc:1199] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/4b88dd7d19514e83857e2c6108291b9f
I20260619 19:54:09.564109 1994 ts_tablet_manager.cc:1950] T 4b88dd7d19514e83857e2c6108291b9f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:09.564550 785 raft_consensus.cc:2468] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:09.565119 996 leader_election.cc:304] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:09.565620 2615 raft_consensus.cc:2804] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:09.565752 2615 raft_consensus.cc:697] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:09.566004 2615 consensus_queue.cc:237] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.552117 2314 raft_consensus.cc:493] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.573266 1201 tablet_bootstrap.cc:492] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.573246 2314 raft_consensus.cc:515] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.573477 1201 ts_tablet_manager.cc:1403] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.135s user 0.009s sys 0.001s
I20260619 19:54:09.574009 2314 leader_election.cc:290] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.574288 1201 raft_consensus.cc:359] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.574450 1201 raft_consensus.cc:385] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.574498 1201 raft_consensus.cc:740] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.574707 1201 consensus_queue.cc:260] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.575081 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e48a3e5c1642f6b12adb0033f74404" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:09.575219 1201 ts_tablet_manager.cc:1434] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:09.575495 1201 tablet_bootstrap.cc:492] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.576970 1201 tablet_bootstrap.cc:654] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.585740 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098d5bd070b54889905539f1fa1a47e6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:09.585968 777 raft_consensus.cc:3060] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:09.591709 720 leader_election.cc:343] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.593674 2548 raft_consensus.cc:493] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.593848 2548 raft_consensus.cc:515] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:09.594457 2548 leader_election.cc:290] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:09.594805 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0e0855e579384853b163816bd5b2efd0" } new_table_name: "default.Table_49c0a24d1ebf46639a117f9eb1d2ffeb" modify_external_catalogs: true
I20260619 19:54:09.598971 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:09.599236 1059 raft_consensus.cc:2393] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:09.601320 2314 consensus_queue.cc:1048] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:09.607225 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee] alter complete (version 3)
I20260619 19:54:09.607069 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4c45ac855591404682937e604638af24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.608376 523 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_d05b8e456c3d4318ae7e18b74c902408 [id=f6eb09cc59154cc7946ae43dc9e8a277] alter complete (version 2)
W20260619 19:54:09.608743 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c45ac855591404682937e604638af24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.609171 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:09.609987 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7e3b1916ed824eccaf051b9832b14459"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.610517 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e3b1916ed824eccaf051b9832b14459 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.611663 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff07e4afabc4e21a74ed0aa68c9026f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:09.612284 884 tablet_service.cc:1558] Processing DeleteTablet for tablet dff07e4afabc4e21a74ed0aa68c9026f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.612373 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1755ba072da64e428c5dece315b1543b" } modify_external_catalogs: true
I20260619 19:54:09.612556 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1755ba072da64e428c5dece315b1543b" } modify_external_catalogs: true
I20260619 19:54:09.612650 1208 tablet_bootstrap.cc:654] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.613557 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d2156cf3d7664ffc9b4b3f47fa750226
I20260619 19:54:09.614336 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1da1f33c963f4f9dbddc94cb16006622" } modify_external_catalogs: true
I20260619 19:54:09.614521 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1da1f33c963f4f9dbddc94cb16006622" } modify_external_catalogs: true
I20260619 19:54:09.615262 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet dff07e4afabc4e21a74ed0aa68c9026f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.615778 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet d2156cf3d7664ffc9b4b3f47fa750226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.616262 1200 tablet_bootstrap.cc:654] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:09.607060 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0168c82ece6e4ce683265229a5d4c6ea consensus state has no leader
I20260619 19:54:09.617818 884 tablet_service.cc:1558] Processing DeleteTablet for tablet d2156cf3d7664ffc9b4b3f47fa750226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.619472 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c8c43c1f76624e4d8d4429389c71c3e7" } new_table_name: "default.Table_2d95c0dbf62a4090832ccec6293c0ec4" modify_external_catalogs: true
I20260619 19:54:09.621446 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e48a3e5c1642f6b12adb0033f74404" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:09.621837 2637 tablet.cc:1724] T 08ef46cfced54742832fd3c01f952a9d P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:09.623116 761 tablet_service.cc:1558] Processing DeleteTablet for tablet dff07e4afabc4e21a74ed0aa68c9026f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.623215 747 tablet_service.cc:1558] Processing DeleteTablet for tablet d2156cf3d7664ffc9b4b3f47fa750226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:09.623795 858 leader_election.cc:343] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:09.623916 858 leader_election.cc:304] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:09.624290 858 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:09.624380 858 leader_election.cc:304] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:09.624729 858 leader_election.cc:343] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d97025f1e0634720bc68d0a6196bd20b
I20260619 19:54:09.624809 858 leader_election.cc:304] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.625149 858 leader_election.cc:304] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.625810 2269 raft_consensus.cc:2749] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:54:09.626075 2677 raft_consensus.cc:2749] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.626197 2509 raft_consensus.cc:2749] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:09.626330 2539 raft_consensus.cc:3060] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:09.630746 517 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet d77de42bb514452a8dc6a4a71289dc59 consensus state has no leader
W20260619 19:54:09.633466 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a39b06bad874a5d8c945c27c3552d43 consensus state has no leader
I20260619 19:54:09.633787 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 7d1b35a09aad46039677eb3d800b0051 from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:09.635010 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce5569cf131d418db24aa0a36869ea69 consensus state has no leader
I20260619 19:54:09.635385 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ff09960283f5496a8b99428dbb23ed15" } new_table_name: "default.Table_018b2daa63104a909f9b61710c43d93d" modify_external_catalogs: true
I20260619 19:54:09.646670 777 raft_consensus.cc:2468] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:09.648887 1973 ts_tablet_manager.cc:1929] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:09.649017 1973 log.cc:1199] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/991c877feeae43c580d9471c25c4424c
I20260619 19:54:09.649391 1973 ts_tablet_manager.cc:1950] T 991c877feeae43c580d9471c25c4424c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:09.650425 996 leader_election.cc:304] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:09.650867 2615 raft_consensus.cc:2804] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:09.651120 2615 raft_consensus.cc:697] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:09.651448 2615 consensus_queue.cc:237] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.655802 2026 ts_tablet_manager.cc:1929] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260619 19:54:09.655992 2026 log.cc:1199] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/1bc12bcf50074b46860899a82dc0b46e
I20260619 19:54:09.656399 2026 ts_tablet_manager.cc:1950] T 1bc12bcf50074b46860899a82dc0b46e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:09.657603 1994 tablet_replica.cc:333] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:09.657829 1994 raft_consensus.cc:2243] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.657987 1994 raft_consensus.cc:2272] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.658583 1994 ts_tablet_manager.cc:1916] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.666507 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 4b88dd7d19514e83857e2c6108291b9f (table default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]) successfully deleted
W20260619 19:54:09.666864 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 904e20649a5f4c49a93bb084c1d3bb9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 904e20649a5f4c49a93bb084c1d3bb9a already in progress: creating tablet
W20260619 19:54:09.667076 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cc57b42a97fa437b93842f7cd379dbb7 because the tablet was not found. No further retry: Not found: Tablet not found: cc57b42a97fa437b93842f7cd379dbb7
W20260619 19:54:09.667347 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d5ddb8412ad145dd85916bf5d756a9f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5ddb8412ad145dd85916bf5d756a9f0 already in progress: creating tablet
W20260619 19:54:09.667570 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 67faf5d554074ab3bdf79075f649f4e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67faf5d554074ab3bdf79075f649f4e0 already in progress: creating tablet
W20260619 19:54:09.667793 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ac2d419a6e5d466e97df971b31640519 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac2d419a6e5d466e97df971b31640519 already in progress: creating tablet
W20260619 19:54:09.668053 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0f3a48eabb574be3bc6883cf555b657f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f3a48eabb574be3bc6883cf555b657f already in progress: creating tablet
W20260619 19:54:09.668278 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fb6bc52ee1fa4ac8967f937e59b4550c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb6bc52ee1fa4ac8967f937e59b4550c already in progress: creating tablet
W20260619 19:54:09.669234 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 43749.5us
W20260619 19:54:09.669468 858 leader_election.cc:343] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:09.669589 858 leader_election.cc:304] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.674436 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 326) took 3321 ms. Trace:
I20260619 19:54:09.674566 1973 rpcz_store.cc:276] 0619 19:54:06.352565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.352609 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:09.448102 (+3095493us) ts_tablet_manager.cc:1151] Deleting tablet 991c877feeae43c580d9471c25c4424c
0619 19:54:09.448111 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.546345 (+ 98234us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.646426 (+100081us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.674409 (+ 27983us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095347}
I20260619 19:54:09.675031 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 327) took 3322 ms. Trace:
I20260619 19:54:09.675194 1973 rpcz_store.cc:276] 0619 19:54:06.352864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.352905 (+ 41us) service_pool.cc:224] Handling call
0619 19:54:09.674889 (+3321984us) ts_tablet_manager.cc:1151] Deleting tablet e055ee491a784c58a95c7780ed1dee6c
0619 19:54:09.674898 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.675017 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3321851}
I20260619 19:54:09.675531 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 328) took 3322 ms. Trace:
I20260619 19:54:09.675611 1973 rpcz_store.cc:276] 0619 19:54:06.353141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.353181 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:09.675439 (+3322258us) ts_tablet_manager.cc:1151] Deleting tablet 5d772e0bd2d4420f836fa14ca2dadb24
0619 19:54:09.675450 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.675513 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3322142}
I20260619 19:54:09.675968 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 323) took 3326 ms. Trace:
I20260619 19:54:09.676044 1973 rpcz_store.cc:276] 0619 19:54:06.349176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.354953 (+ 5777us) service_pool.cc:224] Handling call
0619 19:54:09.675842 (+3320889us) ts_tablet_manager.cc:1151] Deleting tablet 7a0c189a1a614e0cbd0862291eb0962a
0619 19:54:09.675853 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.675951 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3320717}
I20260619 19:54:09.676443 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 329) took 3239 ms. Trace:
I20260619 19:54:09.676524 1973 rpcz_store.cc:276] 0619 19:54:06.438044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.438143 (+ 99us) service_pool.cc:224] Handling call
0619 19:54:09.676311 (+3238168us) ts_tablet_manager.cc:1151] Deleting tablet b289d3068d184d47b671617213aa512a
0619 19:54:09.676323 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.676425 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3237416}
I20260619 19:54:09.676915 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 330) took 3228 ms. Trace:
I20260619 19:54:09.676990 1973 rpcz_store.cc:276] 0619 19:54:06.448791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.448842 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:09.676778 (+3227936us) ts_tablet_manager.cc:1151] Deleting tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f
0619 19:54:09.676788 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.676896 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3227730}
I20260619 19:54:09.677392 1973 tablet_replica.cc:333] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:09.677655 1973 raft_consensus.cc:2243] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.677843 1973 raft_consensus.cc:2272] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.678553 1973 ts_tablet_manager.cc:1916] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.678776 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:09.680104 2539 raft_consensus.cc:2749] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:09.681586 720 consensus_peers.cc:597] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:09.681946 2677 raft_consensus.cc:2749] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:09.682675 858 leader_election.cc:343] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:09.682789 858 leader_election.cc:304] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.683318 858 leader_election.cc:304] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.685335 2539 raft_consensus.cc:2749] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:09.685534 2539 raft_consensus.cc:3060] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.689402 1201 tablet_bootstrap.cc:492] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.689553 1201 ts_tablet_manager.cc:1403] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.114s user 0.004s sys 0.002s
I20260619 19:54:09.690322 1201 raft_consensus.cc:359] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.690536 1201 raft_consensus.cc:385] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.690604 1201 raft_consensus.cc:740] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.690852 1201 consensus_queue.cc:260] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.691406 1201 ts_tablet_manager.cc:1434] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:09.691697 1201 tablet_bootstrap.cc:492] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.693482 1201 tablet_bootstrap.cc:654] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.704164 921 raft_consensus.cc:3060] T ed9d1bd98764451990e7e8e1b6fbcb0b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.704579 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]) successfully deleted
W20260619 19:54:09.705154 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e055ee491a784c58a95c7780ed1dee6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e055ee491a784c58a95c7780ed1dee6c already in progress: creating tablet
W20260619 19:54:09.713320 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5d772e0bd2d4420f836fa14ca2dadb24 because the tablet was not found. No further retry: Not found: Tablet not found: 5d772e0bd2d4420f836fa14ca2dadb24
W20260619 19:54:09.713987 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7a0c189a1a614e0cbd0862291eb0962a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a0c189a1a614e0cbd0862291eb0962a already in progress: creating tablet
W20260619 19:54:09.714625 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b289d3068d184d47b671617213aa512a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b289d3068d184d47b671617213aa512a already in progress: creating tablet
I20260619 19:54:09.714937 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
W20260619 19:54:09.715145 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f already in progress: creating tablet
W20260619 19:54:09.716831 719 leader_election.cc:343] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.717168 719 leader_election.cc:304] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:09.717744 2516 raft_consensus.cc:2749] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.719275 2516 consensus_queue.cc:1048] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:09.728578 1201 tablet_bootstrap.cc:492] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.728760 1201 ts_tablet_manager.cc:1403] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.000s
I20260619 19:54:09.729513 1201 raft_consensus.cc:359] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.729698 1201 raft_consensus.cc:385] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.729763 1201 raft_consensus.cc:740] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.729962 1201 consensus_queue.cc:260] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.730502 1201 ts_tablet_manager.cc:1434] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:09.743008 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_5e75d9e9320b476995a29d678ae6be45 [id=1a15a941edb54adab68b83f9c30a77f6] alter complete (version 2)
I20260619 19:54:09.745625 1201 tablet_bootstrap.cc:492] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.747088 1201 tablet_bootstrap.cc:654] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:09.751771 529 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 208) took 759 ms (client timeout 1000 ms). Trace:
W20260619 19:54:09.751945 529 rpcz_store.cc:269] 0619 19:54:08.992464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.040285 (+ 47821us) service_pool.cc:224] Handling call
0619 19:54:09.078399 (+ 38114us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:09.751692 (+673293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:09.392498 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:09.392608 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:09.392613 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:09.392616 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:09.392817 (+ 201us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:09.392826 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:09.392830 (+ 4us) tablet.cc:685] Acquiring locks for 3 operations
0619 19:54:09.392913 (+ 83us) tablet.cc:701] Row locks acquired
0619 19:54:09.392915 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:09.392945 (+ 30us) write_op.cc:270] Start()
0619 19:54:09.392971 (+ 26us) write_op.cc:276] Timestamp: P: 1781898849392885 usec, L: 0
0619 19:54:09.392974 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:09.394096 (+ 1122us) log.cc:844] Serialized 1293 byte log entry
0619 19:54:09.407654 (+ 13558us) op_driver.cc:464] REPLICATION: finished
0619 19:54:09.408442 (+ 788us) write_op.cc:301] APPLY: starting
0619 19:54:09.408454 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:09.408516 (+ 62us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:09.408541 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:09.408635 (+ 94us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:09.408661 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0619 19:54:09.408668 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:09.408736 (+ 68us) log.cc:844] Serialized 35 byte log entry
0619 19:54:09.408778 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:09.408792 (+ 14us) write_op.cc:454] Released schema lock
0619 19:54:09.408814 (+ 22us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:09.408881 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:09.408885 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:09.581223 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:09.581451 (+ 228us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:09.581457 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:09.581459 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:09.581679 (+ 220us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:09.581694 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:09.581701 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:09.581835 (+ 134us) tablet.cc:701] Row locks acquired
0619 19:54:09.581837 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:09.581916 (+ 79us) write_op.cc:270] Start()
0619 19:54:09.581984 (+ 68us) write_op.cc:276] Timestamp: P: 1781898849581883 usec, L: 0
0619 19:54:09.581988 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:09.582350 (+ 362us) log.cc:844] Serialized 356 byte log entry
0619 19:54:09.603888 (+ 21538us) op_driver.cc:464] REPLICATION: finished
0619 19:54:09.604777 (+ 889us) write_op.cc:301] APPLY: starting
0619 19:54:09.604788 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:09.604819 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:09.604863 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:09.604904 (+ 41us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:09.604927 (+ 23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:09.604934 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:09.604984 (+ 50us) log.cc:844] Serialized 23 byte log entry
0619 19:54:09.605019 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:09.605030 (+ 11us) write_op.cc:454] Released schema lock
0619 19:54:09.605035 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:09.605088 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:09.605091 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:09.727422 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:09.728376 (+ 954us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:09.728382 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:09.728385 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:09.729256 (+ 871us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:09.729272 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:09.729279 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:09.731041 (+ 1762us) tablet.cc:701] Row locks acquired
0619 19:54:09.731050 (+ 9us) write_op.cc:260] PREPARE: finished
0619 19:54:09.731397 (+ 347us) write_op.cc:270] Start()
0619 19:54:09.731857 (+ 460us) write_op.cc:276] Timestamp: P: 1781898849731218 usec, L: 0
0619 19:54:09.731863 (+ 6us) op_driver.cc:348] REPLICATION: starting
0619 19:54:09.733820 (+ 1957us) log.cc:844] Serialized 356 byte log entry
0619 19:54:09.741788 (+ 7968us) op_driver.cc:464] REPLICATION: finished
0619 19:54:09.742012 (+ 224us) write_op.cc:301] APPLY: starting
0619 19:54:09.742028 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:09.742072 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:09.742110 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:09.742157 (+ 47us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:09.742202 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:09.742213 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:09.742309 (+ 96us) log.cc:844] Serialized 23 byte log entry
0619 19:54:09.742372 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:09.742391 (+ 19us) write_op.cc:454] Released schema lock
0619 19:54:09.742397 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":26,"spinlock_wait_cycles":8590592,"child_traces":[["op",{"apply.queue_time_us":750,"apply.run_cpu_time_us":433,"apply.run_wall_time_us":433,"num_ops":3,"prepare.queue_time_us":147966,"prepare.run_cpu_time_us":774,"prepare.run_wall_time_us":1703,"replication_time_us":14656}],["op",{"apply.queue_time_us":860,"apply.run_cpu_time_us":306,"apply.run_wall_time_us":306,"num_ops":1,"prepare.queue_time_us":170640,"prepare.run_cpu_time_us":1040,"prepare.run_wall_time_us":1726,"replication_time_us":21881}],["op",{"apply.queue_time_us":166,"apply.run_cpu_time_us":453,"apply.run_wall_time_us":453,"num_ops":1,"prepare.queue_time_us":118869,"raft.queue_time_us":2376,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":344,"replication_time_us":9680}]]}
I20260619 19:54:09.762666 1201 tablet_bootstrap.cc:492] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.762814 1201 ts_tablet_manager.cc:1403] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260619 19:54:09.763541 1201 raft_consensus.cc:359] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.763708 1201 raft_consensus.cc:385] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.763751 1201 raft_consensus.cc:740] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.763862 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.763939 1201 consensus_queue.cc:260] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.764009 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:09.764410 1201 ts_tablet_manager.cc:1434] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:09.764694 1201 tablet_bootstrap.cc:492] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.766402 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 133) took 8467 ms. Trace:
I20260619 19:54:09.766465 2615 raft_consensus.cc:493] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:09.766494 2026 rpcz_store.cc:276] 0619 19:54:01.299086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.299261 (+ 175us) service_pool.cc:224] Handling call
0619 19:54:09.473720 (+8174459us) ts_tablet_manager.cc:1151] Deleting tablet 1bc12bcf50074b46860899a82dc0b46e
0619 19:54:09.473730 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.569232 (+ 95502us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.646597 (+ 77365us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.766384 (+119787us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8147486}
I20260619 19:54:09.766639 2615 raft_consensus.cc:515] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.766873 2026 tablet_replica.cc:333] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:09.767074 2026 raft_consensus.cc:2243] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:09.767275 2026 raft_consensus.cc:2272] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.767408 2615 leader_election.cc:290] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:09.767778 2026 ts_tablet_manager.cc:1916] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.768190 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc1a472e7aa49639212a41619eabff3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:09.768769 996 leader_election.cc:343] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.771335 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc1a472e7aa49639212a41619eabff3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:09.771989 996 leader_election.cc:343] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:09.772112 996 leader_election.cc:304] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:09.772099 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 1bc12bcf50074b46860899a82dc0b46e (table default.Table_6f48937efc8f41559b9dc1c81380c1cd [id=9d332d034c5d424f92ca51559775be6f]) successfully deleted
I20260619 19:54:09.772514 2615 raft_consensus.cc:2749] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.779119 2539 raft_consensus.cc:2749] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:09.787405 1201 tablet_bootstrap.cc:654] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.789523 913 raft_consensus.cc:3060] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:09.806841 1201 tablet_bootstrap.cc:492] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.807040 1201 ts_tablet_manager.cc:1403] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.002s
I20260619 19:54:09.807889 1201 raft_consensus.cc:359] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.808091 1201 raft_consensus.cc:385] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.808161 1201 raft_consensus.cc:740] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.808525 1201 consensus_queue.cc:260] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.809084 1201 ts_tablet_manager.cc:1434] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:09.824831 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9386bf7111e447c38a5bd2303dde8533"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.825321 1201 tablet_bootstrap.cc:492] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:09.825695 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9386bf7111e447c38a5bd2303dde8533 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.826797 1201 tablet_bootstrap.cc:654] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.834129 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 2c71f92f4e3040c09b67e287a19eea74 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:09.839643 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8765977339bb44a8b5b778228cb90c14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.840229 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8765977339bb44a8b5b778228cb90c14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.851429 1994 ts_tablet_manager.cc:1929] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.851691 1994 log.cc:1199] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:09.852186 1994 ts_tablet_manager.cc:1950] T dff07e4afabc4e21a74ed0aa68c9026f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:09.853276 761 tablet_service.cc:1558] Processing DeleteTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.853919 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.854826 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 74949d09466f42e2852389e10192989d with delete_type TABLET_DATA_DELETED (replaced by tablet 5482cf46c91d426484938c387b785d61) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.855680 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 991c877feeae43c580d9471c25c4424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.856303 761 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c6ad82f0c94e27b2eb4dbf185fab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.856823 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 90b8468df4a449d088f47b3b150ce54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.861346 1208 tablet_bootstrap.cc:492] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:09.862516 1200 tablet_bootstrap.cc:492] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:09.862879 1208 ts_tablet_manager.cc:1403] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.359s user 0.014s sys 0.022s
I20260619 19:54:09.863415 1200 ts_tablet_manager.cc:1403] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.311s user 0.008s sys 0.027s
I20260619 19:54:09.864619 1200 raft_consensus.cc:359] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.865619 1208 raft_consensus.cc:359] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.867197 1208 raft_consensus.cc:385] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.867324 1208 raft_consensus.cc:740] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.867662 1208 consensus_queue.cc:260] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.871227 1200 raft_consensus.cc:385] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.871518 1200 raft_consensus.cc:740] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.872457 2637 tablet.cc:1724] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:09.878031 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85f16c7a84e54c21b3f908540654bf58 has no consensus state
I20260619 19:54:09.882367 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_12085d30a49f41afa472ace4c90f658d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:09.883054 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12085d30a49f41afa472ace4c90f658d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.884650 1200 consensus_queue.cc:260] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.885659 1208 ts_tablet_manager.cc:1434] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260619 19:54:09.886754 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3091dd1a525a4f779c68b8b77afa5b26
I20260619 19:54:09.888559 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:09.889357 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:09.893497 719 consensus_peers.cc:597] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74949d09466f42e2852389e10192989d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:09.894112 2516 consensus_queue.cc:1048] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:09.895387 1208 tablet_bootstrap.cc:492] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:09.897262 1208 tablet_bootstrap.cc:654] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.903891 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:09.889379 1200 ts_tablet_manager.cc:1434] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260619 19:54:09.904765 1200 tablet_bootstrap.cc:492] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:09.905925 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b288e66d14164a5489605094411f072c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:09.906594 1200 tablet_bootstrap.cc:654] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:09.906616 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b288e66d14164a5489605094411f072c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:09.909958 1201 tablet_bootstrap.cc:492] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.910167 1201 ts_tablet_manager.cc:1403] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.009s
I20260619 19:54:09.910897 1201 raft_consensus.cc:359] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.911187 1201 raft_consensus.cc:385] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.911281 1201 raft_consensus.cc:740] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.911530 1201 consensus_queue.cc:260] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.912055 1201 ts_tablet_manager.cc:1434] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:09.912350 1201 tablet_bootstrap.cc:492] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.913807 1201 tablet_bootstrap.cc:654] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.915869 1208 tablet_bootstrap.cc:492] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:09.916088 1208 ts_tablet_manager.cc:1403] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20260619 19:54:09.916819 1208 raft_consensus.cc:359] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.917073 1208 raft_consensus.cc:385] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.917160 1208 raft_consensus.cc:740] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.917433 1208 consensus_queue.cc:260] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:09.925295 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cfdd40b76a6046b18d83dabc35268af3 consensus state has no leader
I20260619 19:54:09.926900 1208 ts_tablet_manager.cc:1434] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260619 19:54:09.927340 1208 tablet_bootstrap.cc:492] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:09.932327 1208 tablet_bootstrap.cc:654] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.932669 1200 tablet_bootstrap.cc:492] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:09.932883 1200 ts_tablet_manager.cc:1403] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260619 19:54:09.933820 1200 raft_consensus.cc:359] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.934094 1200 raft_consensus.cc:385] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.934188 1200 raft_consensus.cc:740] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.934489 1200 consensus_queue.cc:260] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.935098 1200 ts_tablet_manager.cc:1434] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:09.940562 1200 tablet_bootstrap.cc:492] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:09.942353 1200 tablet_bootstrap.cc:654] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.943490 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet dff07e4afabc4e21a74ed0aa68c9026f (table default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]) successfully deleted
W20260619 19:54:09.947621 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d2156cf3d7664ffc9b4b3f47fa750226 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2156cf3d7664ffc9b4b3f47fa750226 already in progress: creating tablet
I20260619 19:54:09.948391 2026 ts_tablet_manager.cc:1929] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:09.948529 2026 log.cc:1199] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/45c0ffb4629a46349ccfe473cc20cdfc
I20260619 19:54:09.948881 2026 ts_tablet_manager.cc:1950] T 45c0ffb4629a46349ccfe473cc20cdfc P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:09.954234 1201 tablet_bootstrap.cc:492] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.954392 1201 ts_tablet_manager.cc:1403] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
I20260619 19:54:09.955090 1201 raft_consensus.cc:359] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.955287 1201 raft_consensus.cc:385] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.955341 1201 raft_consensus.cc:740] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.955554 1201 consensus_queue.cc:260] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.956127 1201 ts_tablet_manager.cc:1434] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:09.956421 1201 tablet_bootstrap.cc:492] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.956776 1994 tablet_replica.cc:333] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:09.957079 1994 raft_consensus.cc:2243] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:09.958129 1201 tablet_bootstrap.cc:654] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.960501 1994 pending_rounds.cc:70] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:09.960574 1994 pending_rounds.cc:77] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657685896142848 op_type: NO_OP noop_request { }
I20260619 19:54:09.960671 1994 raft_consensus.cc:2889] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:09.960758 1994 raft_consensus.cc:2272] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:09.961767 1994 ts_tablet_manager.cc:1916] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:09.964614 1200 tablet_bootstrap.cc:492] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:09.964859 1200 ts_tablet_manager.cc:1403] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.002s
I20260619 19:54:09.965725 1200 raft_consensus.cc:359] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.966005 1200 raft_consensus.cc:385] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.966109 1200 raft_consensus.cc:740] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.966416 1200 consensus_queue.cc:260] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.968379 1200 ts_tablet_manager.cc:1434] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:09.970989 1201 tablet_bootstrap.cc:492] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:09.971522 1201 ts_tablet_manager.cc:1403] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260619 19:54:09.972630 1201 raft_consensus.cc:359] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.973896 1201 raft_consensus.cc:385] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.974092 1201 raft_consensus.cc:740] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:09.974434 1201 consensus_queue.cc:260] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.975391 1201 ts_tablet_manager.cc:1434] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:09.976238 1201 tablet_bootstrap.cc:492] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:09.978253 1201 tablet_bootstrap.cc:654] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.987339 1200 tablet_bootstrap.cc:492] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:09.991101 1200 tablet_bootstrap.cc:654] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:09.993407 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 06037415255f4b958222296f53e58622 (DEFAULT_TABLE table=default.Table_61c5a25012404c098fa35b67fe3de51c [id=9aa815ccd2154e3085a68236b18e7e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:09.993690 529 catalog_manager.cc:5696] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:09.994297 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:09.994640 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:09.995854 1208 tablet_bootstrap.cc:492] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:09.996047 1208 ts_tablet_manager.cc:1403] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.000s
I20260619 19:54:09.997226 1208 raft_consensus.cc:359] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:09.997421 1208 raft_consensus.cc:385] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:09.997474 1208 raft_consensus.cc:740] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.005390 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bc12bcf50074b46860899a82dc0b46e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:51 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.006757 528 master_service.cc:960] ReplaceTablet: received request to replace tablet f658e85be0c843f2b02e4567a80521c4 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:10.008272 1208 consensus_queue.cc:260] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.008839 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 46c2a94a4d794f2aa94b77885812831f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:10.009560 1208 ts_tablet_manager.cc:1434] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260619 19:54:10.014783 884 tablet_service.cc:1511] Processing CreateTablet for tablet 06037415255f4b958222296f53e58622 (DEFAULT_TABLE table=default.Table_61c5a25012404c098fa35b67fe3de51c [id=9aa815ccd2154e3085a68236b18e7e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.017866 1034 tablet_service.cc:1511] Processing CreateTablet for tablet e84dba59116149e5aeb65d79a4d2e5fc (DEFAULT_TABLE table=default.Table_e2103c40b6764802b83ec0dd628505e9 [id=86396b54993043a59c085e26816446b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.019546 896 tablet_service.cc:1511] Processing CreateTablet for tablet e84dba59116149e5aeb65d79a4d2e5fc (DEFAULT_TABLE table=default.Table_e2103c40b6764802b83ec0dd628505e9 [id=86396b54993043a59c085e26816446b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.020431 1037 tablet_service.cc:1511] Processing CreateTablet for tablet de6c34ec79d24bfe926f90b8067db558 (DEFAULT_TABLE table=default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6 [id=3c5b625ecbd947fba621b2633a58bbaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.022823 889 tablet_service.cc:1511] Processing CreateTablet for tablet de6c34ec79d24bfe926f90b8067db558 (DEFAULT_TABLE table=default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6 [id=3c5b625ecbd947fba621b2633a58bbaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.027866 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 85f16c7a84e54c21b3f908540654bf58 (DEFAULT_TABLE table=default.Table_018b2daa63104a909f9b61710c43d93d [id=06fc10407770459c8a1bf03e8c3c3a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.028245 749 tablet_service.cc:1511] Processing CreateTablet for tablet 85f16c7a84e54c21b3f908540654bf58 (DEFAULT_TABLE table=default.Table_018b2daa63104a909f9b61710c43d93d [id=06fc10407770459c8a1bf03e8c3c3a26]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:10.009533 720 consensus_peers.cc:597] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74949d09466f42e2852389e10192989d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:10.028644 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f16c7a84e54c21b3f908540654bf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.030324 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 00a0fdd293ef4794a77e1d13b29cdb1c (DEFAULT_TABLE table=default.Table_2f909ced98f04ff089efa555b29ebc90 [id=ceab13a9c32a4ff2b0104775901ff0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.030993 887 tablet_service.cc:1511] Processing CreateTablet for tablet 85f16c7a84e54c21b3f908540654bf58 (DEFAULT_TABLE table=default.Table_018b2daa63104a909f9b61710c43d93d [id=06fc10407770459c8a1bf03e8c3c3a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.015663 761 tablet_service.cc:1511] Processing CreateTablet for tablet 06037415255f4b958222296f53e58622 (DEFAULT_TABLE table=default.Table_61c5a25012404c098fa35b67fe3de51c [id=9aa815ccd2154e3085a68236b18e7e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.031502 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06037415255f4b958222296f53e58622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.031749 758 tablet_service.cc:1511] Processing CreateTablet for tablet 00a0fdd293ef4794a77e1d13b29cdb1c (DEFAULT_TABLE table=default.Table_2f909ced98f04ff089efa555b29ebc90 [id=ceab13a9c32a4ff2b0104775901ff0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.031863 897 tablet_service.cc:1511] Processing CreateTablet for tablet 00a0fdd293ef4794a77e1d13b29cdb1c (DEFAULT_TABLE table=default.Table_2f909ced98f04ff089efa555b29ebc90 [id=ceab13a9c32a4ff2b0104775901ff0ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.032146 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a0fdd293ef4794a77e1d13b29cdb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.034147 750 tablet_service.cc:1511] Processing CreateTablet for tablet b6be09bf87314a96a243ff2f726cfd2b (DEFAULT_TABLE table=default.Table_89a388cee2964d0a82df7dc583b3c8b3 [id=0ba4e7d4166d4373872f2bff5a3af438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.034547 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6be09bf87314a96a243ff2f726cfd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.018733 747 tablet_service.cc:1511] Processing CreateTablet for tablet e84dba59116149e5aeb65d79a4d2e5fc (DEFAULT_TABLE table=default.Table_e2103c40b6764802b83ec0dd628505e9 [id=86396b54993043a59c085e26816446b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.036140 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84dba59116149e5aeb65d79a4d2e5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.036947 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 131) took 8738 ms. Trace:
I20260619 19:54:10.037039 2026 rpcz_store.cc:276] 0619 19:54:01.298878 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.299425 (+ 547us) service_pool.cc:224] Handling call
0619 19:54:09.766826 (+8467401us) ts_tablet_manager.cc:1151] Deleting tablet 45c0ffb4629a46349ccfe473cc20cdfc
0619 19:54:09.766836 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:09.846306 (+ 79470us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:09.948296 (+101990us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.036923 (+ 88627us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8440542}
I20260619 19:54:10.037410 2026 tablet_replica.cc:333] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:10.020991 746 tablet_service.cc:1511] Processing CreateTablet for tablet de6c34ec79d24bfe926f90b8067db558 (DEFAULT_TABLE table=default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6 [id=3c5b625ecbd947fba621b2633a58bbaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.039606 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6c34ec79d24bfe926f90b8067db558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.044122 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b6be09bf87314a96a243ff2f726cfd2b (DEFAULT_TABLE table=default.Table_89a388cee2964d0a82df7dc583b3c8b3 [id=0ba4e7d4166d4373872f2bff5a3af438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.048197 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06037415255f4b958222296f53e58622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.048447 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6be09bf87314a96a243ff2f726cfd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.048549 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06037415255f4b958222296f53e58622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.048696 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6c34ec79d24bfe926f90b8067db558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.049036 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84dba59116149e5aeb65d79a4d2e5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.049470 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6c34ec79d24bfe926f90b8067db558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.049856 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f16c7a84e54c21b3f908540654bf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.050231 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a0fdd293ef4794a77e1d13b29cdb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.056322 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84dba59116149e5aeb65d79a4d2e5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.035823 1208 tablet_bootstrap.cc:492] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.062435 1208 tablet_bootstrap.cc:654] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.079756 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a0fdd293ef4794a77e1d13b29cdb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.080401 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f16c7a84e54c21b3f908540654bf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.083927 2026 raft_consensus.cc:2243] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:10.084403 2026 raft_consensus.cc:2272] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:10.085034 2026 ts_tablet_manager.cc:1916] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:10.089170 2539 raft_consensus.cc:493] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.090832 1201 tablet_bootstrap.cc:492] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:10.090960 1201 ts_tablet_manager.cc:1403] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.115s user 0.011s sys 0.003s
I20260619 19:54:10.091768 1201 raft_consensus.cc:359] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.091970 1201 raft_consensus.cc:385] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.092049 1201 raft_consensus.cc:740] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.092237 1201 consensus_queue.cc:260] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.092636 2715 raft_consensus.cc:493] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:10.092705 1201 ts_tablet_manager.cc:1434] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:10.092674 2539 raft_consensus.cc:515] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:10.092970 1201 tablet_bootstrap.cc:492] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:10.093377 2539 leader_election.cc:290] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:10.094650 859 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 76ffe451545c4af6821971384fce483e
I20260619 19:54:10.092748 2715 raft_consensus.cc:515] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:10.095269 2715 leader_election.cc:290] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:10.096321 859 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
W20260619 19:54:10.098356 858 leader_election.cc:343] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 76ffe451545c4af6821971384fce483e
I20260619 19:54:10.098505 858 leader_election.cc:304] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:10.104960 858 leader_election.cc:343] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:54:10.105113 858 leader_election.cc:304] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.105021 1201 tablet_bootstrap.cc:654] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.105628 2715 raft_consensus.cc:2749] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:54:10.105788 2715 raft_consensus.cc:2749] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:10.115499 2539 raft_consensus.cc:493] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.115662 2539 raft_consensus.cc:515] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:10.119333 859 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:10.123011 1200 tablet_bootstrap.cc:492] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.123265 1200 ts_tablet_manager.cc:1403] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.136s user 0.014s sys 0.027s
I20260619 19:54:10.124207 1200 raft_consensus.cc:359] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.124522 1200 raft_consensus.cc:385] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.124634 1200 raft_consensus.cc:740] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.125630 1200 consensus_queue.cc:260] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.126885 1200 ts_tablet_manager.cc:1434] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:10.129669 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 45c0ffb4629a46349ccfe473cc20cdfc (table default.Table_f2b7aed4e720476cb97127ea1b58db50 [id=0178c0c89c424890aeaa1e2bd32ed94e]) successfully deleted
I20260619 19:54:10.134143 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e886b4f784f4431e8bd1f7fc7421797f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.135751 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e886b4f784f4431e8bd1f7fc7421797f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.137063 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 983faf8557814093bc427291711f3fce from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:10.137248 1200 tablet_bootstrap.cc:492] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:10.137804 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d1ea5a845ac449f1a9f65e78d02e3bb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.138515 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1ea5a845ac449f1a9f65e78d02e3bb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.138960 1200 tablet_bootstrap.cc:654] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.139807 1994 ts_tablet_manager.cc:1929] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:10.139931 1994 log.cc:1199] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:54:10.140303 1994 ts_tablet_manager.cc:1950] T f6c6ad82f0c94e27b2eb4dbf185fab66 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:10.140230 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a05e5da51d674a85be7881fec2260738"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.140820 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a05e5da51d674a85be7881fec2260738 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.149626 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8530dfb740284ad08b498a696d17ef9c (DEFAULT_TABLE table=default.Table_41bf6e80789b46a3b057c38ee5d318d3 [id=e2817d6090db49778adb214a1482a094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.149655 758 tablet_service.cc:1511] Processing CreateTablet for tablet 78499eaa3d9645fba6abaec2b9eb49cc (DEFAULT_TABLE table=default.Table_dd8210ab7a3b44dfabe35847cb0edd27 [id=0f162d6ef6b74a47a3076c0b7aca8275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.150183 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78499eaa3d9645fba6abaec2b9eb49cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.150341 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8530dfb740284ad08b498a696d17ef9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.150462 2715 raft_consensus.cc:493] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:10.150615 2715 raft_consensus.cc:515] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:10.151084 2548 raft_consensus.cc:493] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:10.151470 749 tablet_service.cc:1511] Processing CreateTablet for tablet 8530dfb740284ad08b498a696d17ef9c (DEFAULT_TABLE table=default.Table_41bf6e80789b46a3b057c38ee5d318d3 [id=e2817d6090db49778adb214a1482a094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.151829 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8530dfb740284ad08b498a696d17ef9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.149626 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 78499eaa3d9645fba6abaec2b9eb49cc (DEFAULT_TABLE table=default.Table_dd8210ab7a3b44dfabe35847cb0edd27 [id=0f162d6ef6b74a47a3076c0b7aca8275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.154860 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78499eaa3d9645fba6abaec2b9eb49cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.157997 758 tablet_service.cc:1511] Processing CreateTablet for tablet 904dd2aac07347a5979f6607bbe5665f (DEFAULT_TABLE table=default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 [id=2413d4206e3e4b1c9b9ace3921450d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.158380 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dd2aac07347a5979f6607bbe5665f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.163770 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 904dd2aac07347a5979f6607bbe5665f (DEFAULT_TABLE table=default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 [id=2413d4206e3e4b1c9b9ace3921450d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.164229 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dd2aac07347a5979f6607bbe5665f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.164284 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 7d1b35a09aad46039677eb3d800b0051
I20260619 19:54:10.164839 527 catalog_manager.cc:6784] ReplaceTablet: tablet 7d1b35a09aad46039677eb3d800b0051 deleted and replaced by tablet a664b768f8b6449cb881767d4fd369ea
I20260619 19:54:10.171120 1200 tablet_bootstrap.cc:492] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.171294 1200 ts_tablet_manager.cc:1403] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.001s
I20260619 19:54:10.171947 1200 raft_consensus.cc:359] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.172145 1200 raft_consensus.cc:385] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.172197 1200 raft_consensus.cc:740] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.172559 1200 consensus_queue.cc:260] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.171088 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d1b35a09aad46039677eb3d800b0051 with delete_type TABLET_DATA_DELETED (replaced by tablet a664b768f8b6449cb881767d4fd369ea) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.174168 889 tablet_service.cc:1511] Processing CreateTablet for tablet b6be09bf87314a96a243ff2f726cfd2b (DEFAULT_TABLE table=default.Table_89a388cee2964d0a82df7dc583b3c8b3 [id=0ba4e7d4166d4373872f2bff5a3af438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.174618 897 tablet_service.cc:1511] Processing CreateTablet for tablet 78499eaa3d9645fba6abaec2b9eb49cc (DEFAULT_TABLE table=default.Table_dd8210ab7a3b44dfabe35847cb0edd27 [id=0f162d6ef6b74a47a3076c0b7aca8275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.174970 896 tablet_service.cc:1511] Processing CreateTablet for tablet 8530dfb740284ad08b498a696d17ef9c (DEFAULT_TABLE table=default.Table_41bf6e80789b46a3b057c38ee5d318d3 [id=e2817d6090db49778adb214a1482a094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.175038 1200 ts_tablet_manager.cc:1434] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260619 19:54:10.175338 1200 tablet_bootstrap.cc:492] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:10.176671 1200 tablet_bootstrap.cc:654] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.176944 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6be09bf87314a96a243ff2f726cfd2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.177513 859 consensus_peers.cc:597] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 221cc85629ca41e9ad71adfe0beb392a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:10.177724 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d1b35a09aad46039677eb3d800b0051 with delete_type TABLET_DATA_DELETED (replaced by tablet a664b768f8b6449cb881767d4fd369ea) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.178164 2715 leader_election.cc:290] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:10.179364 2539 leader_election.cc:290] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.180128 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d1b35a09aad46039677eb3d800b0051 with delete_type TABLET_DATA_DELETED (replaced by tablet a664b768f8b6449cb881767d4fd369ea) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.180624 1200 tablet_bootstrap.cc:492] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.180838 1200 ts_tablet_manager.cc:1403] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260619 19:54:10.181830 1200 raft_consensus.cc:359] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.182092 1200 raft_consensus.cc:385] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.182184 1200 raft_consensus.cc:740] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.182479 1200 consensus_queue.cc:260] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.183324 1200 ts_tablet_manager.cc:1434] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:10.151219 2548 raft_consensus.cc:515] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:10.184613 1200 tablet_bootstrap.cc:492] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:10.185156 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ac80d8fb9d874148bc8b0c508448804c
W20260619 19:54:10.186789 859 leader_election.cc:343] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fade40bf3e7145f29076821f091677bd
I20260619 19:54:10.186060 1200 tablet_bootstrap.cc:654] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.189291 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 766b8781524a4dcda809632e439af264 (DEFAULT_TABLE table=default.Table_e9d63130dc4e4f208012f0bff14d0489 [id=ec263a20b67c46e0a9ecf9b4ceaf90aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.189867 2527 raft_consensus.cc:493] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.189932 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b8781524a4dcda809632e439af264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.190018 2527 raft_consensus.cc:515] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:10.190272 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6ec149e1ac475f8038b328dae4af2a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.190639 2527 leader_election.cc:290] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:10.191706 720 leader_election.cc:343] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 997cd0b5a8d24b56a2d5b95ab877d95f
W20260619 19:54:10.192332 719 leader_election.cc:343] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 997cd0b5a8d24b56a2d5b95ab877d95f
I20260619 19:54:10.192448 719 leader_election.cc:304] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.192662 2527 raft_consensus.cc:2749] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:10.190812 858 leader_election.cc:343] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fade40bf3e7145f29076821f091677bd
I20260619 19:54:10.199851 858 leader_election.cc:304] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.205389 894 tablet_service.cc:1511] Processing CreateTablet for tablet 904dd2aac07347a5979f6607bbe5665f (DEFAULT_TABLE table=default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 [id=2413d4206e3e4b1c9b9ace3921450d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.208030 1200 tablet_bootstrap.cc:492] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.208178 1200 ts_tablet_manager.cc:1403] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260619 19:54:10.208637 758 tablet_service.cc:1511] Processing CreateTablet for tablet 766b8781524a4dcda809632e439af264 (DEFAULT_TABLE table=default.Table_e9d63130dc4e4f208012f0bff14d0489 [id=ec263a20b67c46e0a9ecf9b4ceaf90aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.208907 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ac80d8fb9d874148bc8b0c508448804c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.208863 1200 raft_consensus.cc:359] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.209024 1200 raft_consensus.cc:385] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.209055 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b8781524a4dcda809632e439af264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.209072 1200 raft_consensus.cc:740] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.209173 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet ac80d8fb9d874148bc8b0c508448804c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.209173 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c2c18e114f464defb0935468c8196b5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:10.209261 1200 consensus_queue.cc:260] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.209743 1200 ts_tablet_manager.cc:1434] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260619 19:54:10.209764 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c18e114f464defb0935468c8196b5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.210143 1200 tablet_bootstrap.cc:492] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:10.211568 1200 tablet_bootstrap.cc:654] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.212438 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3c842fad1b6b42e9ae959560e466bc98 (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:10.212478 858 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.212590 858 leader_election.cc:304] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.212754 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c842fad1b6b42e9ae959560e466bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.212757 2539 raft_consensus.cc:2749] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:10.213690 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ac80d8fb9d874148bc8b0c508448804c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.214073 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6920393f5922435bbf9c6a6a1a16dff2" } modify_external_catalogs: true
I20260619 19:54:10.214241 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6920393f5922435bbf9c6a6a1a16dff2" } modify_external_catalogs: true
I20260619 19:54:10.215041 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:10.218544 900 tablet_service.cc:1511] Processing CreateTablet for tablet 766b8781524a4dcda809632e439af264 (DEFAULT_TABLE table=default.Table_e9d63130dc4e4f208012f0bff14d0489 [id=ec263a20b67c46e0a9ecf9b4ceaf90aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.221316 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet bf175c80483346788a148b7277b9ca9d
I20260619 19:54:10.222241 2615 raft_consensus.cc:493] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.222388 2615 raft_consensus.cc:515] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.223021 2615 leader_election.cc:290] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.223713 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68788824224b426bb433b87763073bae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.219149 2548 leader_election.cc:290] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:10.223917 784 raft_consensus.cc:2468] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:10.224180 891 tablet_service.cc:1558] Processing DeleteTablet for tablet bf175c80483346788a148b7277b9ca9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.224460 2548 raft_consensus.cc:2749] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:10.224601 2548 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:10.224699 2548 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:10.225288 996 leader_election.cc:304] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:10.225338 859 leader_election.cc:343] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 33ee0b30259741cdb2fb0e3c815e6b17
I20260619 19:54:10.225769 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68788824224b426bb433b87763073bae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:10.225943 921 raft_consensus.cc:2468] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:10.226490 2615 raft_consensus.cc:2804] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.226577 2615 raft_consensus.cc:493] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.226651 2615 raft_consensus.cc:3060] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.226676 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet bf175c80483346788a148b7277b9ca9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.230321 2548 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:10.231236 749 tablet_service.cc:1558] Processing DeleteTablet for tablet bf175c80483346788a148b7277b9ca9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:10.231500 720 consensus_peers.cc:597] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 983faf8557814093bc427291711f3fce. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:10.232189 858 leader_election.cc:343] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 33ee0b30259741cdb2fb0e3c815e6b17
I20260619 19:54:10.232303 858 leader_election.cc:304] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.232313 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.234246 2548 raft_consensus.cc:2749] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:10.234426 859 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b57381b0a02141459dc582196d0c0095
I20260619 19:54:10.235118 2715 raft_consensus.cc:493] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.235245 2715 raft_consensus.cc:515] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.235698 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c0d72f12910c4e988c146acf69ec7224" } modify_external_catalogs: true
I20260619 19:54:10.235888 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c0d72f12910c4e988c146acf69ec7224" } modify_external_catalogs: true
I20260619 19:54:10.237967 1208 tablet_bootstrap.cc:492] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:10.238148 1208 ts_tablet_manager.cc:1403] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.202s user 0.002s sys 0.002s
I20260619 19:54:10.238879 1208 raft_consensus.cc:359] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.239185 1208 raft_consensus.cc:385] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.239295 1208 raft_consensus.cc:740] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.239578 1208 consensus_queue.cc:260] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.241873 2715 leader_election.cc:290] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.242151 1208 ts_tablet_manager.cc:1434] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260619 19:54:10.242502 1208 tablet_bootstrap.cc:492] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.244206 1208 tablet_bootstrap.cc:654] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.244609 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 46c2a94a4d794f2aa94b77885812831f
I20260619 19:54:10.245172 528 catalog_manager.cc:6784] ReplaceTablet: tablet 46c2a94a4d794f2aa94b77885812831f deleted and replaced by tablet e5783716513840e0a046b23d245b5700
I20260619 19:54:10.247515 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ec6d85adf799497db51a92f71faf281a" } new_table_name: "default.Table_0d1560157edb47baa3153f7a5b863967" modify_external_catalogs: true
I20260619 19:54:10.247700 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c2a94a4d794f2aa94b77885812831f with delete_type TABLET_DATA_DELETED (replaced by tablet e5783716513840e0a046b23d245b5700) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.252032 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:10.252235 1059 raft_consensus.cc:2468] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:10.252254 2615 raft_consensus.cc:515] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.253019 859 leader_election.cc:304] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.253454 2715 raft_consensus.cc:2804] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.253533 2715 raft_consensus.cc:493] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.253593 2715 raft_consensus.cc:3060] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.254369 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68788824224b426bb433b87763073bae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:10.254556 1994 tablet_replica.cc:333] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:10.254541 921 raft_consensus.cc:3060] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.254737 1994 raft_consensus.cc:2243] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:10.254935 1994 pending_rounds.cc:70] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:10.254971 1994 pending_rounds.cc:77] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657687825260544 op_type: NO_OP noop_request { }
I20260619 19:54:10.255057 1994 raft_consensus.cc:2889] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:10.255123 1994 raft_consensus.cc:2272] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:10.255110 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (table default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]) successfully deleted
I20260619 19:54:10.256023 1994 ts_tablet_manager.cc:1916] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:10.256515 1208 tablet_bootstrap.cc:492] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:10.256664 1208 ts_tablet_manager.cc:1403] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.002s
I20260619 19:54:10.257097 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c2a94a4d794f2aa94b77885812831f with delete_type TABLET_DATA_DELETED (replaced by tablet e5783716513840e0a046b23d245b5700) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.257335 1208 raft_consensus.cc:359] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.257570 1208 raft_consensus.cc:385] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.257658 1208 raft_consensus.cc:740] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.257879 1208 consensus_queue.cc:260] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.258541 1208 ts_tablet_manager.cc:1434] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:10.258720 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:10.258842 1208 tablet_bootstrap.cc:492] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.259047 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:10.259596 2615 leader_election.cc:290] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.260460 1208 tablet_bootstrap.cc:654] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.263576 1208 tablet_bootstrap.cc:492] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:10.263780 1208 ts_tablet_manager.cc:1403] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260619 19:54:10.264559 1208 raft_consensus.cc:359] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.264811 1208 raft_consensus.cc:385] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.264907 1208 raft_consensus.cc:740] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.264890 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:10.265139 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:10.265174 1208 consensus_queue.cc:260] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.265419 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:10.265609 524 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:10.266239 1208 ts_tablet_manager.cc:1434] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:10.266598 1208 tablet_bootstrap.cc:492] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.268678 1208 tablet_bootstrap.cc:654] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.269639 887 tablet_service.cc:1511] Processing CreateTablet for tablet 3c842fad1b6b42e9ae959560e466bc98 (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.274276 1201 tablet_bootstrap.cc:492] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:10.274482 1201 ts_tablet_manager.cc:1403] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.182s user 0.019s sys 0.001s
I20260619 19:54:10.275679 1201 raft_consensus.cc:359] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.276180 1201 raft_consensus.cc:385] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.276260 1201 raft_consensus.cc:740] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.276556 1201 consensus_queue.cc:260] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.276949 2677 raft_consensus.cc:493] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.277117 2677 raft_consensus.cc:515] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.277999 2677 leader_election.cc:290] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:10.279683 859 leader_election.cc:343] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4b88dd7d19514e83857e2c6108291b9f
I20260619 19:54:10.280251 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 3c842fad1b6b42e9ae959560e466bc98 (DEFAULT_TABLE table=default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.280676 1201 ts_tablet_manager.cc:1434] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260619 19:54:10.281286 1201 tablet_bootstrap.cc:492] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:10.286495 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ba983ec444a4494c8da46ab261fc713b (DEFAULT_TABLE table=default.Table_2644646bf4a244ab9f25aabb2522df39 [id=c3ebf62535434d20b61fd25885865236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.287550 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c2a94a4d794f2aa94b77885812831f with delete_type TABLET_DATA_DELETED (replaced by tablet e5783716513840e0a046b23d245b5700) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.287609 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68788824224b426bb433b87763073bae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:10.287791 784 raft_consensus.cc:3060] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.295054 2314 raft_consensus.cc:493] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.295256 2314 raft_consensus.cc:515] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.295933 2314 leader_election.cc:290] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.296559 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d663e07e37c74d3b97d09e5f020d2586" } new_table_name: "default.Table_842027b98aba4ab8a73af9bd27a5441e" modify_external_catalogs: true
I20260619 19:54:10.296993 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:10.297194 1059 raft_consensus.cc:2468] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:10.297379 884 tablet_service.cc:1511] Processing CreateTablet for tablet ba983ec444a4494c8da46ab261fc713b (DEFAULT_TABLE table=default.Table_2644646bf4a244ab9f25aabb2522df39 [id=c3ebf62535434d20b61fd25885865236]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.297649 720 leader_election.cc:304] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.297906 2527 raft_consensus.cc:2804] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.297978 2527 raft_consensus.cc:493] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.298039 2527 raft_consensus.cc:3060] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.300505 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 642e0199fd244f7e927bf7abf231327d (DEFAULT_TABLE table=default.Table_b2a87fb0340e4c25894584473a100047 [id=321abbfe34e841f3a207ecc624d80824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.301630 858 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.301707 2694 raft_consensus.cc:493] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.301903 2509 raft_consensus.cc:493] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.301868 2694 raft_consensus.cc:515] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.302019 2509 raft_consensus.cc:515] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.302693 2509 leader_election.cc:290] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.302690 2694 leader_election.cc:290] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.302827 2509 raft_consensus.cc:2749] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:10.304145 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3354ae6dd46bd9c5414d4c4a720a1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:10.304390 1059 raft_consensus.cc:2468] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:10.304991 859 leader_election.cc:304] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.307454 2509 raft_consensus.cc:2804] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.307602 2509 raft_consensus.cc:493] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.307689 2509 raft_consensus.cc:3060] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.309813 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.310869 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b88dd7d19514e83857e2c6108291b9f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.311033 2615 raft_consensus.cc:493] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.311256 2615 raft_consensus.cc:515] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.311496 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3354ae6dd46bd9c5414d4c4a720a1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.311671 777 raft_consensus.cc:2468] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:10.312131 2615 leader_election.cc:290] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.312520 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:10.313639 749 tablet_service.cc:1511] Processing CreateTablet for tablet ba983ec444a4494c8da46ab261fc713b (DEFAULT_TABLE table=default.Table_2644646bf4a244ab9f25aabb2522df39 [id=c3ebf62535434d20b61fd25885865236]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:10.314038 858 leader_election.cc:343] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.314155 858 leader_election.cc:304] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.314184 758 tablet_service.cc:1511] Processing CreateTablet for tablet 642e0199fd244f7e927bf7abf231327d (DEFAULT_TABLE table=default.Table_b2a87fb0340e4c25894584473a100047 [id=321abbfe34e841f3a207ecc624d80824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.314854 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3da787af0c3645428fe490e3179bb610" } new_table_name: "default.Table_b7a42a103d30476698c3e755195e4cdd" modify_external_catalogs: true
I20260619 19:54:10.315528 2269 raft_consensus.cc:2749] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:10.324844 891 tablet_service.cc:1511] Processing CreateTablet for tablet 642e0199fd244f7e927bf7abf231327d (DEFAULT_TABLE table=default.Table_b2a87fb0340e4c25894584473a100047 [id=321abbfe34e841f3a207ecc624d80824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.330176 761 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9e816e001403a820caca4916f8824 (DEFAULT_TABLE table=default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.325579 1201 tablet_bootstrap.cc:654] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.342373 892 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9e816e001403a820caca4916f8824 (DEFAULT_TABLE table=default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.343246 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642e0199fd244f7e927bf7abf231327d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.344554 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d9821562c6cb4b1c9d89b85a55bb94c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.345170 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9821562c6cb4b1c9d89b85a55bb94c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.346694 784 raft_consensus.cc:2468] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:10.346869 2516 raft_consensus.cc:493] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.347064 2516 raft_consensus.cc:515] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.347963 2516 leader_election.cc:290] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.348886 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8530dfb740284ad08b498a696d17ef9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.349177 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9e816e001403a820caca4916f8824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.349397 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78499eaa3d9645fba6abaec2b9eb49cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.349531 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 7afe86e5d9c341cbadc821203e603af6 (DEFAULT_TABLE table=default.Table_9bbb285ac65b4d1f976f736071ea68cd [id=4c5ef1bdb74f43cc85a7d46936177032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.349934 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b8781524a4dcda809632e439af264. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.350013 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 48524.9us
I20260619 19:54:10.350782 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba983ec444a4494c8da46ab261fc713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.352759 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_108b76c017514b1aabe28f50b0351398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.353364 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_108b76c017514b1aabe28f50b0351398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.354743 996 leader_election.cc:304] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.355046 2694 raft_consensus.cc:2804] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:10.355198 2694 raft_consensus.cc:697] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:10.355355 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904dd2aac07347a5979f6607bbe5665f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.355552 2694 consensus_queue.cc:237] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.355237 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c842fad1b6b42e9ae959560e466bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.358841 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:10.359270 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc1a472e7aa49639212a41619eabff3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:10.359447 1059 raft_consensus.cc:2468] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:10.360123 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:10.360502 996 leader_election.cc:343] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.361284 720 leader_election.cc:304] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.361605 2516 raft_consensus.cc:2804] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.361682 2516 raft_consensus.cc:493] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.361744 2516 raft_consensus.cc:3060] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.362329 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642e0199fd244f7e927bf7abf231327d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.363090 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c842fad1b6b42e9ae959560e466bc98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.363623 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba983ec444a4494c8da46ab261fc713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.364078 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 5e5c1ffd83c944ada87d59439b6a9cb3
I20260619 19:54:10.364851 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_48bc9c3ec6e24b32a9167c87711237f9" } new_table_name: "default.Table_370c9e1a3e67410cbb4fec543864ae95" modify_external_catalogs: true
I20260619 19:54:10.365687 1201 tablet_bootstrap.cc:492] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:10.365859 1201 ts_tablet_manager.cc:1403] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.001s
I20260619 19:54:10.367003 886 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.367239 1201 raft_consensus.cc:359] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.367475 1201 raft_consensus.cc:385] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.367547 1201 raft_consensus.cc:740] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.375751 2548 raft_consensus.cc:493] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.375936 2548 raft_consensus.cc:515] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:10.377950 859 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:10.378288 2548 leader_election.cc:290] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.384733 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c3c0937d5fea430da4dbdf9381157268
I20260619 19:54:10.386509 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet c3c0937d5fea430da4dbdf9381157268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.386783 886 tablet_service.cc:1558] Processing DeleteTablet for tablet c3c0937d5fea430da4dbdf9381157268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.388375 886 tablet_service.cc:1511] Processing CreateTablet for tablet 7afe86e5d9c341cbadc821203e603af6 (DEFAULT_TABLE table=default.Table_9bbb285ac65b4d1f976f736071ea68cd [id=4c5ef1bdb74f43cc85a7d46936177032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.388950 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afe86e5d9c341cbadc821203e603af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.389334 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.390110 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9dcb6cc8908f4c278d72bd81045ebfe5" } modify_external_catalogs: true
I20260619 19:54:10.390353 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9dcb6cc8908f4c278d72bd81045ebfe5" } modify_external_catalogs: true
I20260619 19:54:10.395411 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 027bdf3a047b43f3b9ae2b1a05602d80 (DEFAULT_TABLE table=default.Table_f87a9d76b99f4dce864cf3b75b3062e7 [id=08dfe7d4849645c2b940d6c116d5e44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.396307 898 tablet_service.cc:1511] Processing CreateTablet for tablet 027bdf3a047b43f3b9ae2b1a05602d80 (DEFAULT_TABLE table=default.Table_f87a9d76b99f4dce864cf3b75b3062e7 [id=08dfe7d4849645c2b940d6c116d5e44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.396763 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027bdf3a047b43f3b9ae2b1a05602d80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.397882 996 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.398586 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.398790 777 raft_consensus.cc:2468] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:10.399556 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.399734 784 raft_consensus.cc:2468] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:10.400146 2026 ts_tablet_manager.cc:1929] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:10.400252 2026 log.cc:1199] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/0f32e1c7a27941ca9377901b19b32af3
I20260619 19:54:10.400641 2026 ts_tablet_manager.cc:1950] T 0f32e1c7a27941ca9377901b19b32af3 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:10.402305 903 tablet_service.cc:1511] Processing CreateTablet for tablet 41489f9f8cb145728d38e111740d8c72 (DEFAULT_TABLE table=default.Table_5ffe2eed21c644c4b91c87f6abd8a9a7 [id=506bd37e691649febb2333791e323191]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.402704 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41489f9f8cb145728d38e111740d8c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.404050 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 41489f9f8cb145728d38e111740d8c72 (DEFAULT_TABLE table=default.Table_5ffe2eed21c644c4b91c87f6abd8a9a7 [id=506bd37e691649febb2333791e323191]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:10.405056 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 736aa49b4d984295a9aefb135b005e07 consensus state has no leader
I20260619 19:54:10.405428 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 9f33c2c00b414fbebf1965510e1e2b96 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:10.406391 1208 tablet_bootstrap.cc:492] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:10.407440 1208 ts_tablet_manager.cc:1403] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.141s user 0.036s sys 0.073s
I20260619 19:54:10.409487 1201 consensus_queue.cc:260] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.410414 996 leader_election.cc:304] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:10.411070 1201 ts_tablet_manager.cc:1434] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260619 19:54:10.411386 1201 tablet_bootstrap.cc:492] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:10.411574 2694 raft_consensus.cc:2804] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.411659 2694 raft_consensus.cc:493] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.411748 2694 raft_consensus.cc:3060] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.413295 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a089bafab345412f8bea4a849e584ea7 (DEFAULT_TABLE table=default.Table_3a3dfe74f3c24eef96314e4728415493 [id=6517ab192ea54a23aa75202bef9d9b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.413889 921 raft_consensus.cc:2468] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:10.414624 996 leader_election.cc:304] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:10.414754 1039 tablet_service.cc:1511] Processing CreateTablet for tablet f9d9e816e001403a820caca4916f8824 (DEFAULT_TABLE table=default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.415201 2744 raft_consensus.cc:2804] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.415362 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba983ec444a4494c8da46ab261fc713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.415522 2744 raft_consensus.cc:493] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.415607 2744 raft_consensus.cc:3060] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.415607 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9e816e001403a820caca4916f8824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.415802 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 642e0199fd244f7e927bf7abf231327d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.416018 1208 raft_consensus.cc:359] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.417338 1208 raft_consensus.cc:385] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.418318 1208 raft_consensus.cc:740] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.415055 888 tablet_service.cc:1511] Processing CreateTablet for tablet a089bafab345412f8bea4a849e584ea7 (DEFAULT_TABLE table=default.Table_3a3dfe74f3c24eef96314e4728415493 [id=6517ab192ea54a23aa75202bef9d9b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.420128 1208 consensus_queue.cc:260] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.425077 1208 ts_tablet_manager.cc:1434] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260619 19:54:10.426198 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 798c54ef8cde4020903153f72d6e3b1a (DEFAULT_TABLE table=default.Table_80b5f0844e274a0f9bf20c3ac5445137 [id=6279acbc1bfb47cebb600fa1982b26a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.427476 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_83d2ac6790e3427896025cdac0782895 [id=c128b2a4a40748dabd196e9703c43254] alter complete (version 1)
I20260619 19:54:10.427479 1208 tablet_bootstrap.cc:492] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.428274 885 tablet_service.cc:1511] Processing CreateTablet for tablet 798c54ef8cde4020903153f72d6e3b1a (DEFAULT_TABLE table=default.Table_80b5f0844e274a0f9bf20c3ac5445137 [id=6279acbc1bfb47cebb600fa1982b26a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.431643 524 master_service.cc:960] ReplaceTablet: received request to replace tablet ac55fd703e184730ab053e045b0f4e2c from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:10.432267 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.437028 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5ba1b89a3b684c4f9927a1cefb74588d" } new_table_name: "default.Table_247be2054e924a3885a4822bb5c4c2d3" modify_external_catalogs: true
I20260619 19:54:10.438097 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_babe01f83df8452898d81d45fe0855a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.438731 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_babe01f83df8452898d81d45fe0855a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.440932 2527 raft_consensus.cc:515] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.441627 1208 tablet_bootstrap.cc:654] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.444471 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798c54ef8cde4020903153f72d6e3b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.444396 2527 leader_election.cc:290] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.445683 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:10.445864 1059 raft_consensus.cc:3060] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.447284 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a089bafab345412f8bea4a849e584ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.449054 2694 raft_consensus.cc:515] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.452946 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afe86e5d9c341cbadc821203e603af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.453475 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027bdf3a047b43f3b9ae2b1a05602d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.453890 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41489f9f8cb145728d38e111740d8c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.455271 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a089bafab345412f8bea4a849e584ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.455529 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798c54ef8cde4020903153f72d6e3b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.455881 1994 ts_tablet_manager.cc:1929] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:10.456022 1994 log.cc:1199] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/8bc11c632b514118856ea4c11b431142
I20260619 19:54:10.456504 1994 ts_tablet_manager.cc:1950] T 8bc11c632b514118856ea4c11b431142 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:10.459255 2715 raft_consensus.cc:515] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.459712 913 raft_consensus.cc:2393] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
W20260619 19:54:10.460112 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d49b16f9b9e4b79ae0045c3f0542d23 consensus state has no leader
W20260619 19:54:10.460777 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97c85ec29991418796f1af65e0604323 consensus state has no leader
I20260619 19:54:10.461282 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:10.462256 2715 leader_election.cc:290] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.463788 785 raft_consensus.cc:2393] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:10.467679 2694 leader_election.cc:290] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:10.469244 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1d23b9d751c48ad858a35771b0ded61 consensus state has no leader
I20260619 19:54:10.470049 1201 tablet_bootstrap.cc:654] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.471684 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:10.471776 2694 raft_consensus.cc:493] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.471889 2694 raft_consensus.cc:515] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.472416 2694 leader_election.cc:290] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.472944 1208 tablet_bootstrap.cc:492] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:10.473150 1208 ts_tablet_manager.cc:1403] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.003s
I20260619 19:54:10.474356 1208 raft_consensus.cc:359] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.474646 1208 raft_consensus.cc:385] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.474730 1208 raft_consensus.cc:740] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.475097 1208 consensus_queue.cc:260] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.476225 1208 ts_tablet_manager.cc:1434] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:10.477442 1208 tablet_bootstrap.cc:492] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.484508 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d9e816e001403a820caca4916f8824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.487047 1208 tablet_bootstrap.cc:654] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.487953 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:10.488353 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.489081 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:10.489174 996 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.489301 784 raft_consensus.cc:3060] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:10.491809 996 leader_election.cc:343] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:10.493404 996 leader_election.cc:343] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.493916 996 leader_election.cc:304] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:10.495206 2694 raft_consensus.cc:2749] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:10.504926 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9a415c8fc09b47168de84f6fa673df9e" } modify_external_catalogs: true
I20260619 19:54:10.505218 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9a415c8fc09b47168de84f6fa673df9e" } modify_external_catalogs: true
I20260619 19:54:10.507042 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653" } modify_external_catalogs: true
I20260619 19:54:10.507284 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653" } modify_external_catalogs: true
I20260619 19:54:10.507488 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:10.507722 918 raft_consensus.cc:2393] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:10.508492 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2a582108ce724404a89ca7858fa45231"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:10.508833 2694 raft_consensus.cc:493] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.508978 2694 raft_consensus.cc:515] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:10.509095 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a582108ce724404a89ca7858fa45231 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.509366 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f7e6fcdbf0ac4e9e85a7672234a28ac7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:10.509483 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc1a472e7aa49639212a41619eabff3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:10.509878 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7e6fcdbf0ac4e9e85a7672234a28ac7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.510876 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a62ff56b27aa44c594c3e7438005ac8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.511404 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a62ff56b27aa44c594c3e7438005ac8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.511695 2694 leader_election.cc:290] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.512617 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:10.513743 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.513841 913 raft_consensus.cc:2468] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:10.513955 785 raft_consensus.cc:2468] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:10.516564 2269 raft_consensus.cc:493] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:10.516718 2269 raft_consensus.cc:515] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:10.516940 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8b2e40a7328d42dd864703db24c1fa3c
I20260619 19:54:10.517338 2269 leader_election.cc:290] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:10.519168 859 leader_election.cc:343] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:54:10.519600 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2e40a7328d42dd864703db24c1fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.520674 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:10.520920 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2e40a7328d42dd864703db24c1fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.521620 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 with delete_type TABLET_DATA_DELETED (replaced by tablet cf93b18ae6a44bdb876948d26c4ed087) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.522111 528 catalog_manager.cc:6784] ReplaceTablet: tablet 9f33c2c00b414fbebf1965510e1e2b96 deleted and replaced by tablet cf93b18ae6a44bdb876948d26c4ed087
I20260619 19:54:10.522590 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83452ce6b5b3479b98ea312db05dc651" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:10.522862 785 raft_consensus.cc:2393] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:10.523604 2269 raft_consensus.cc:493] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.523676 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 with delete_type TABLET_DATA_DELETED (replaced by tablet cf93b18ae6a44bdb876948d26c4ed087) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.523737 2269 raft_consensus.cc:515] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.523936 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8882bd0a559b4556aef7a3175c2707fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:10.524358 2269 leader_election.cc:290] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:10.524677 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8882bd0a559b4556aef7a3175c2707fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.527170 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3064bd01ced9429d82ce449e8afc4999" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:10.527379 1058 raft_consensus.cc:2468] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:10.507562 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc57b42a97fa437b93842f7cd379dbb7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:10.528153 859 leader_election.cc:304] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.529021 2269 raft_consensus.cc:2804] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.529137 2269 raft_consensus.cc:493] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.529217 2269 raft_consensus.cc:3060] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.531081 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_87f3089ec8fb4c7990ece82f72c17904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.532172 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87f3089ec8fb4c7990ece82f72c17904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.537415 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ac55fd703e184730ab053e045b0f4e2c
I20260619 19:54:10.538193 524 catalog_manager.cc:6784] ReplaceTablet: tablet ac55fd703e184730ab053e045b0f4e2c deleted and replaced by tablet d40a944dbc9d4164a0100811bbadc6b5
I20260619 19:54:10.541085 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ac55fd703e184730ab053e045b0f4e2c with delete_type TABLET_DATA_DELETED (replaced by tablet d40a944dbc9d4164a0100811bbadc6b5) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.543069 2516 raft_consensus.cc:515] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.543560 2509 raft_consensus.cc:515] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.544325 2509 leader_election.cc:290] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.542291 1200 tablet_bootstrap.cc:492] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.545321 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3354ae6dd46bd9c5414d4c4a720a1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:10.545107 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ac55fd703e184730ab053e045b0f4e2c with delete_type TABLET_DATA_DELETED (replaced by tablet d40a944dbc9d4164a0100811bbadc6b5) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.542857 1059 raft_consensus.cc:2468] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:10.545508 1058 raft_consensus.cc:3060] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.545608 1200 ts_tablet_manager.cc:1403] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.336s user 0.007s sys 0.000s
I20260619 19:54:10.547312 1994 tablet_replica.cc:333] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:10.547538 1994 raft_consensus.cc:2243] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:10.547729 1994 raft_consensus.cc:2272] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:10.548243 1994 ts_tablet_manager.cc:1916] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:10.550424 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 8bc11c632b514118856ea4c11b431142 (table default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087]) successfully deleted
I20260619 19:54:10.556063 1200 raft_consensus.cc:359] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.556460 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fcb37eed280c48e8931b6fc94f7600dd
I20260619 19:54:10.558157 902 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb37eed280c48e8931b6fc94f7600dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.559990 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5f0c69fbe322403aad471900afe7bea7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:10.560240 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ad28ce3b193d467594d095dd90fbe05a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.560719 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f0c69fbe322403aad471900afe7bea7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:10.560907 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad28ce3b193d467594d095dd90fbe05a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.559108 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb37eed280c48e8931b6fc94f7600dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.564183 1200 raft_consensus.cc:385] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.564270 1200 raft_consensus.cc:740] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.564885 1200 consensus_queue.cc:260] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.566668 1200 ts_tablet_manager.cc:1434] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.021s user 0.002s sys 0.001s
I20260619 19:54:10.566953 1200 tablet_bootstrap.cc:492] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:10.569017 1200 tablet_bootstrap.cc:654] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.569293 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_be833bdadf28404f9b58987bb4f6e229" } modify_external_catalogs: true
I20260619 19:54:10.569535 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_be833bdadf28404f9b58987bb4f6e229" } modify_external_catalogs: true
I20260619 19:54:10.577265 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 134) took 9278 ms. Trace:
I20260619 19:54:10.577384 2026 rpcz_store.cc:276] 0619 19:54:01.299251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.299353 (+ 102us) service_pool.cc:224] Handling call
0619 19:54:10.037350 (+8737997us) ts_tablet_manager.cc:1151] Deleting tablet 0f32e1c7a27941ca9377901b19b32af3
0619 19:54:10.037360 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:10.143375 (+106015us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.400092 (+256717us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.577222 (+177130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8711019}
I20260619 19:54:10.577757 2026 tablet_replica.cc:333] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:10.577970 2026 raft_consensus.cc:2243] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:10.578130 2026 raft_consensus.cc:2272] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:10.580471 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 0f32e1c7a27941ca9377901b19b32af3 (table default.Table_baef1a6b19f94884934f0c54a4dda5d0 [id=d69648d0cdb042a3a4e487ef0cf0088b]) successfully deleted
I20260619 19:54:10.581123 2026 ts_tablet_manager.cc:1916] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:10.585091 1973 ts_tablet_manager.cc:1929] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:10.585259 1973 log.cc:1199] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:10.585623 1973 ts_tablet_manager.cc:1950] T cc57b42a97fa437b93842f7cd379dbb7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:10.591071 996 leader_election.cc:304] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.595901 2715 raft_consensus.cc:493] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.596099 2715 raft_consensus.cc:515] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:10.597095 2715 leader_election.cc:290] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:10.598165 859 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:10.599038 2694 raft_consensus.cc:2804] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:10.599223 2694 raft_consensus.cc:493] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:10.599313 2694 raft_consensus.cc:3060] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.600721 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6" } modify_external_catalogs: true
I20260619 19:54:10.600956 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_17f5e2a517bc4eb5ad08be3a0b3532e6" } modify_external_catalogs: true
I20260619 19:54:10.610755 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_41bf6e80789b46a3b057c38ee5d318d3" } new_table_name: "default.Table_62785737f2b84311abc5b0ab6394b5e3" modify_external_catalogs: true
I20260619 19:54:10.614308 747 tablet_service.cc:1511] Processing CreateTablet for tablet 7afe86e5d9c341cbadc821203e603af6 (DEFAULT_TABLE table=default.Table_9bbb285ac65b4d1f976f736071ea68cd [id=4c5ef1bdb74f43cc85a7d46936177032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.546036 720 leader_election.cc:304] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.614755 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afe86e5d9c341cbadc821203e603af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.614887 763 tablet_service.cc:1511] Processing CreateTablet for tablet 027bdf3a047b43f3b9ae2b1a05602d80 (DEFAULT_TABLE table=default.Table_f87a9d76b99f4dce864cf3b75b3062e7 [id=08dfe7d4849645c2b940d6c116d5e44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.615232 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 027bdf3a047b43f3b9ae2b1a05602d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.615370 746 tablet_service.cc:1558] Processing DeleteTablet for tablet c3c0937d5fea430da4dbdf9381157268 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.615814 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.616015 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 with delete_type TABLET_DATA_DELETED (replaced by tablet cf93b18ae6a44bdb876948d26c4ed087) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.615978 746 tablet_service.cc:1511] Processing CreateTablet for tablet a089bafab345412f8bea4a849e584ea7 (DEFAULT_TABLE table=default.Table_3a3dfe74f3c24eef96314e4728415493 [id=6517ab192ea54a23aa75202bef9d9b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.616149 755 tablet_service.cc:1558] Processing DeleteTablet for tablet ac55fd703e184730ab053e045b0f4e2c with delete_type TABLET_DATA_DELETED (replaced by tablet d40a944dbc9d4164a0100811bbadc6b5) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.616284 751 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb37eed280c48e8931b6fc94f7600dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.616291 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a089bafab345412f8bea4a849e584ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.616397 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2e40a7328d42dd864703db24c1fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.616698 760 tablet_service.cc:1511] Processing CreateTablet for tablet 41489f9f8cb145728d38e111740d8c72 (DEFAULT_TABLE table=default.Table_5ffe2eed21c644c4b91c87f6abd8a9a7 [id=506bd37e691649febb2333791e323191]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.616907 2539 consensus_queue.cc:1048] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:10.617085 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41489f9f8cb145728d38e111740d8c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.618600 765 tablet_service.cc:1511] Processing CreateTablet for tablet 798c54ef8cde4020903153f72d6e3b1a (DEFAULT_TABLE table=default.Table_80b5f0844e274a0f9bf20c3ac5445137 [id=6279acbc1bfb47cebb600fa1982b26a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.618938 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798c54ef8cde4020903153f72d6e3b1a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.620697 858 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:54:10.620858 858 leader_election.cc:304] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.621377 2539 raft_consensus.cc:2749] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:10.623859 858 leader_election.cc:304] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.625715 2516 leader_election.cc:290] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.625998 2539 raft_consensus.cc:2749] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260619 19:54:10.626037 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 80032.9us
I20260619 19:54:10.626518 2314 raft_consensus.cc:2804] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:10.626614 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:10.627264 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc1a472e7aa49639212a41619eabff3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:10.627482 1056 raft_consensus.cc:3060] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:10.627790 858 leader_election.cc:343] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:54:10.627955 858 leader_election.cc:304] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:10.629637 2715 raft_consensus.cc:2749] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:10.631309 913 raft_consensus.cc:3060] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:10.637342 859 consensus_peers.cc:597] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c54b2e4f657245c2aa23d138968b3b0d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:10.638301 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 331) took 4189 ms. Trace:
I20260619 19:54:10.638412 1973 rpcz_store.cc:276] 0619 19:54:06.449180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.449222 (+ 42us) service_pool.cc:224] Handling call
0619 19:54:09.677335 (+3228113us) ts_tablet_manager.cc:1151] Deleting tablet cc57b42a97fa437b93842f7cd379dbb7
0619 19:54:09.677347 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:10.415190 (+737843us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.585003 (+169813us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.638277 (+ 53274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3227985}
I20260619 19:54:10.639249 2744 raft_consensus.cc:515] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.639945 2744 leader_election.cc:290] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.642449 532 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet ca6d7f30c5a84106bebebc42eedee654 (table default.Table_247be2054e924a3885a4822bb5c4c2d3 [id=cb0dfc15d9414ae3b63638e94c05c0a5]). Expected version 1 got 0
I20260619 19:54:10.642870 532 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]). Expected version 1 got 0
W20260619 19:54:10.644588 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet bf175c80483346788a148b7277b9ca9d (table default.Table_87768bcb7d2347faa2a8624f28911b02 [id=14dbea33ca974c8fa94e99d0d9f79272], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bf175c80483346788a148b7277b9ca9d consensus state has no leader
I20260619 19:54:10.646443 2269 raft_consensus.cc:515] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.646855 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:10.647189 2269 leader_election.cc:290] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:10.647921 996 leader_election.cc:343] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.648710 1200 tablet_bootstrap.cc:492] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.648837 1200 ts_tablet_manager.cc:1403] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.004s
I20260619 19:54:10.650110 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:10.650290 785 raft_consensus.cc:3060] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.651345 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 056f7982f51f45a78d2b9b0a0b50576e
W20260619 19:54:10.651453 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8530dfb740284ad08b498a696d17ef9c consensus state has no leader
I20260619 19:54:10.652776 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.657783 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 (DEFAULT_TABLE table=default.Table_c2c18e114f464defb0935468c8196b5f [id=6f0054806fe64c6d96acb3b1ee625069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.659469 1201 tablet_bootstrap.cc:492] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:10.659610 1201 ts_tablet_manager.cc:1403] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.248s user 0.009s sys 0.013s
I20260619 19:54:10.661702 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2a2b56003d449a91ad211c58fd69b8 (DEFAULT_TABLE table=default.Table_b288e66d14164a5489605094411f072c [id=ecb81e20d98a4769ada8a294a08cded0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.663542 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 69c954463212453797f98852b76c2d5f (DEFAULT_TABLE table=default.Table_12085d30a49f41afa472ace4c90f658d [id=86907ad38a7e47cd850693e106515d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.666894 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet de6c34ec79d24bfe926f90b8067db558
I20260619 19:54:10.669339 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 58c2959e96144fdf8f20c99ca7e4b415 (DEFAULT_TABLE table=default.Table_ccaf614a02d2417bb6703630eabddabe [id=83adeae74eec459a8d1a8d80bbb40547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.669883 1024 tablet_service.cc:1511] Processing CreateTablet for tablet f6ce69e12fd643ea88c26d941424c2ab (DEFAULT_TABLE table=default.Table_48480bf0e6404c51870932c9cb33ad23 [id=13f8faf01e3746c1862b9e36492a935a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.669950 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c8ee7b25f5724fe792e9348b66392518" } new_table_name: "default.Table_a38066af06d345a8a3689270a6962003" modify_external_catalogs: true
I20260619 19:54:10.670261 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet de6c34ec79d24bfe926f90b8067db558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:10.670707 1030 tablet_service.cc:1511] Processing CreateTablet for tablet a7cd9284ce9246319f768a50f977abc9 (DEFAULT_TABLE table=default.Table_f238923ba00645f989b04e383fbcb760 [id=72eba666076049a296810522df16bf2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.671885 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_064db418935f4a01a304fc26453b254e" } new_table_name: "default.Table_7b602f1b15fd49eeb03e86bae9c258c7" modify_external_catalogs: true
I20260619 19:54:10.674433 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a01a0515a2ae4fc2ae67f87cb4d0c6d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.674997 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a01a0515a2ae4fc2ae67f87cb4d0c6d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.677665 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bef2eb2eaa1d45b9adbea27f0269ac49 (DEFAULT_TABLE table=default.Table_4c45ac855591404682937e604638af24 [id=ea181ba3905049cc83c7c26bef1122a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.677953 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a664b768f8b6449cb881767d4fd369ea (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.677904 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_81f483b6dbf949ee904fdb2d85285759"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.678503 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81f483b6dbf949ee904fdb2d85285759 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.677626 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 12392839b79a43f0b444c754b04026b1 (DEFAULT_TABLE table=default.Table_9386bf7111e447c38a5bd2303dde8533 [id=cf0efd7e377a470f80571a394d5bf893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.682113 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d400ef98ca5d4aad95051cf2edab9f26 (DEFAULT_TABLE table=default.Table_af2f1c9e09b845669ba83b6327f8bea4 [id=8f4fb80196c34861a298f827f411bc0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.669339 1025 tablet_service.cc:1511] Processing CreateTablet for tablet cffd890a5f594a4b91cb2f5c3235fcad (DEFAULT_TABLE table=default.Table_7e3b1916ed824eccaf051b9832b14459 [id=1e5ee965670645dc8455e457691093bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.684018 1041 tablet_service.cc:1511] Processing CreateTablet for tablet bc2291967f0945efb7486079a93a6aad (DEFAULT_TABLE table=default.Table_e886b4f784f4431e8bd1f7fc7421797f [id=a5a9ed0985784c82a81dea4dbe558ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.688755 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e763c81e6e04a5c84aa92c7ad787054" } new_table_name: "default.Table_73fb804f16184152a67bef2cd29b53b0" modify_external_catalogs: true
I20260619 19:54:10.692283 901 tablet_service.cc:1511] Processing CreateTablet for tablet 12392839b79a43f0b444c754b04026b1 (DEFAULT_TABLE table=default.Table_9386bf7111e447c38a5bd2303dde8533 [id=cf0efd7e377a470f80571a394d5bf893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.692783 903 tablet_service.cc:1511] Processing CreateTablet for tablet bef2eb2eaa1d45b9adbea27f0269ac49 (DEFAULT_TABLE table=default.Table_4c45ac855591404682937e604638af24 [id=ea181ba3905049cc83c7c26bef1122a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.693043 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
W20260619 19:54:10.693396 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e65ca84182d40c280ec2b0555c0de86 consensus state has no leader
I20260619 19:54:10.693300 889 tablet_service.cc:1511] Processing CreateTablet for tablet d400ef98ca5d4aad95051cf2edab9f26 (DEFAULT_TABLE table=default.Table_af2f1c9e09b845669ba83b6327f8bea4 [id=8f4fb80196c34861a298f827f411bc0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.692349 902 tablet_service.cc:1511] Processing CreateTablet for tablet bc2291967f0945efb7486079a93a6aad (DEFAULT_TABLE table=default.Table_e886b4f784f4431e8bd1f7fc7421797f [id=a5a9ed0985784c82a81dea4dbe558ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.693814 899 tablet_service.cc:1511] Processing CreateTablet for tablet 7015d42f7b02426983bdffbd4f597a9f (DEFAULT_TABLE table=default.Table_8765977339bb44a8b5b778228cb90c14 [id=efc30fa2301e431ca3bbf5764529a0a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.694228 890 tablet_service.cc:1511] Processing CreateTablet for tablet de10e2325cfa4e2f84ada2e9072e4b2f (DEFAULT_TABLE table=default.Table_d1ea5a845ac449f1a9f65e78d02e3bb6 [id=1409ce655cc74128a5044700f39c36fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.694659 893 tablet_service.cc:1511] Processing CreateTablet for tablet 0476b1447f984f548d06e71cdda6a875 (DEFAULT_TABLE table=default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.695094 895 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6e77cdf999432fa7aec86e0bf1205f (DEFAULT_TABLE table=default.Table_a05e5da51d674a85be7881fec2260738 [id=73e1f0ecf27d4d0fb7a6c4c1726bc053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.696442 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet eb43742411444ecaa62f74fc729c7745
I20260619 19:54:10.696760 1201 raft_consensus.cc:359] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.696979 1201 raft_consensus.cc:385] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.697026 1201 raft_consensus.cc:740] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.697232 1201 consensus_queue.cc:260] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.697685 891 tablet_service.cc:1511] Processing CreateTablet for tablet a664b768f8b6449cb881767d4fd369ea (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.697963 2715 raft_consensus.cc:493] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.698079 2715 raft_consensus.cc:515] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.698866 2715 leader_election.cc:290] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.699187 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3064bd01ced9429d82ce449e8afc4999" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:10.699383 1055 raft_consensus.cc:3060] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:10.638876 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 332) took 4146 ms. Trace:
I20260619 19:54:10.701026 1973 rpcz_store.cc:276] 0619 19:54:06.492139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.492212 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:10.638750 (+4146538us) ts_tablet_manager.cc:1151] Deleting tablet b289d3068d184d47b671617213aa512a
0619 19:54:10.638761 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:10.638859 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4146291}
I20260619 19:54:10.701388 1973 tablet_replica.cc:333] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:10.701606 1973 raft_consensus.cc:2243] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:10.701803 1973 raft_consensus.cc:2272] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:10.702412 1973 ts_tablet_manager.cc:1916] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:10.703331 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:10.703713 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2291967f0945efb7486079a93a6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.703931 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d400ef98ca5d4aad95051cf2edab9f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.704383 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de10e2325cfa4e2f84ada2e9072e4b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.704789 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0476b1447f984f548d06e71cdda6a875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.705214 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7015d42f7b02426983bdffbd4f597a9f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.705348 859 leader_election.cc:343] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:10.705574 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12392839b79a43f0b444c754b04026b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.705747 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6e77cdf999432fa7aec86e0bf1205f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.706178 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef2eb2eaa1d45b9adbea27f0269ac49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.706660 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a664b768f8b6449cb881767d4fd369ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.707758 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:10.710882 897 tablet_service.cc:1511] Processing CreateTablet for tablet a7cd9284ce9246319f768a50f977abc9 (DEFAULT_TABLE table=default.Table_f238923ba00645f989b04e383fbcb760 [id=72eba666076049a296810522df16bf2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.711359 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cd9284ce9246319f768a50f977abc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.716722 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c0e601c022049fcb050f7b90b9f3a98 consensus state has no leader
I20260619 19:54:10.716928 892 tablet_service.cc:1511] Processing CreateTablet for tablet 58c2959e96144fdf8f20c99ca7e4b415 (DEFAULT_TABLE table=default.Table_ccaf614a02d2417bb6703630eabddabe [id=83adeae74eec459a8d1a8d80bbb40547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.717518 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c2959e96144fdf8f20c99ca7e4b415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.719019 1200 raft_consensus.cc:359] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.719321 1200 raft_consensus.cc:385] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.719432 1200 raft_consensus.cc:740] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.719753 1200 consensus_queue.cc:260] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.723497 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cdf577f46fe04a03b5ee265415239167" } modify_external_catalogs: true
I20260619 19:54:10.723843 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cdf577f46fe04a03b5ee265415239167" } modify_external_catalogs: true
I20260619 19:54:10.726979 1201 ts_tablet_manager.cc:1434] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.067s user 0.002s sys 0.000s
I20260619 19:54:10.727851 886 tablet_service.cc:1558] Processing DeleteTablet for tablet de6c34ec79d24bfe926f90b8067db558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.728678 886 tablet_service.cc:1558] Processing DeleteTablet for tablet eb43742411444ecaa62f74fc729c7745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.729251 900 tablet_service.cc:1511] Processing CreateTablet for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 (DEFAULT_TABLE table=default.Table_c2c18e114f464defb0935468c8196b5f [id=6f0054806fe64c6d96acb3b1ee625069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.734400 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.735234 1058 raft_consensus.cc:2468] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:10.735486 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01489233bc6f4f8a998fc8d2b8bf70a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.735764 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c954463212453797f98852b76c2d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.736294 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2a2b56003d449a91ad211c58fd69b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.736757 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c2959e96144fdf8f20c99ca7e4b415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.737234 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ce69e12fd643ea88c26d941424c2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.737577 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cd9284ce9246319f768a50f977abc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.740684 2744 consensus_queue.cc:1048] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:10.741223 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2291967f0945efb7486079a93a6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.741290 1200 ts_tablet_manager.cc:1434] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.092s user 0.003s sys 0.000s
I20260619 19:54:10.741360 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a664b768f8b6449cb881767d4fd369ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.741580 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffd890a5f594a4b91cb2f5c3235fcad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.734411 859 consensus_peers.cc:597] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:10.742738 859 leader_election.cc:304] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:10.743019 2509 raft_consensus.cc:2804] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:10.743147 2509 raft_consensus.cc:697] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:10.743387 2509 consensus_queue.cc:237] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.744694 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b1a301cf915e4323bf1cd7290e158617" } new_table_name: "default.Table_e47761965a9e4406ae801e08b9ba9dc1" modify_external_catalogs: true
I20260619 19:54:10.746302 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef2eb2eaa1d45b9adbea27f0269ac49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.747212 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2a2b56003d449a91ad211c58fd69b8 (DEFAULT_TABLE table=default.Table_b288e66d14164a5489605094411f072c [id=ecb81e20d98a4769ada8a294a08cded0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.747716 888 tablet_service.cc:1511] Processing CreateTablet for tablet cffd890a5f594a4b91cb2f5c3235fcad (DEFAULT_TABLE table=default.Table_7e3b1916ed824eccaf051b9832b14459 [id=1e5ee965670645dc8455e457691093bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.747807 1994 ts_tablet_manager.cc:1929] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:10.747931 1994 log.cc:1199] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/3091dd1a525a4f779c68b8b77afa5b26
I20260619 19:54:10.748682 1201 tablet_bootstrap.cc:492] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:10.749971 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d400ef98ca5d4aad95051cf2edab9f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.750342 1201 tablet_bootstrap.cc:654] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.750604 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12392839b79a43f0b444c754b04026b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.750945 898 tablet_service.cc:1511] Processing CreateTablet for tablet f6ce69e12fd643ea88c26d941424c2ab (DEFAULT_TABLE table=default.Table_48480bf0e6404c51870932c9cb33ad23 [id=13f8faf01e3746c1862b9e36492a935a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.755478 2509 raft_consensus.cc:493] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:10.755666 2509 raft_consensus.cc:515] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:10.755607 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cd25cf2ffebc4ffb8027a371385e324a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.756379 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd25cf2ffebc4ffb8027a371385e324a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.756479 2509 leader_election.cc:290] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.758491 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:10.760006 1994 ts_tablet_manager.cc:1950] T 3091dd1a525a4f779c68b8b77afa5b26 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:10.760577 885 tablet_service.cc:1511] Processing CreateTablet for tablet 69c954463212453797f98852b76c2d5f (DEFAULT_TABLE table=default.Table_12085d30a49f41afa472ace4c90f658d [id=86907ad38a7e47cd850693e106515d7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:10.763345 859 leader_election.cc:343] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 37393d7c16594032bf2a69abb0ab5931
I20260619 19:54:10.768159 1200 tablet_bootstrap.cc:492] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:10.768566 2509 raft_consensus.cc:493] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.770392 1200 tablet_bootstrap.cc:654] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.761078 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_aa310c6c62a340b3a2a9b00ddad42f22" } modify_external_catalogs: true
I20260619 19:54:10.771119 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_aa310c6c62a340b3a2a9b00ddad42f22" } modify_external_catalogs: true
W20260619 19:54:10.762619 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c322c38aae114a428f64a476a2ae9b5f consensus state has no leader
I20260619 19:54:10.764194 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e22e0f53008c4a96bf56b7f057f81cd5
I20260619 19:54:10.774257 884 tablet_service.cc:1558] Processing DeleteTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.795868 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_574918c06b8d48589440d492d563c2e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.796489 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_574918c06b8d48589440d492d563c2e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.797999 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d6d9aa396afe4b37a7ae9565c826ed56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.798619 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6d9aa396afe4b37a7ae9565c826ed56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.807041 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:10.808113 884 tablet_service.cc:1558] Processing DeleteTablet for tablet fde2b5d12ab7465791f26d214c2dc2f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:10.807868 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3a39ef823fad4fcbab83e42f2eae6c14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:10.810195 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_141d9f6d0fa641278b11c2de1b754daa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.811029 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_141d9f6d0fa641278b11c2de1b754daa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.811364 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f72aa268721148b1a73f7b43cb0b6d1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.811996 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f72aa268721148b1a73f7b43cb0b6d1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.813465 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_247580df801f4df0a325292361c8f7f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.813968 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_247580df801f4df0a325292361c8f7f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.816339 2509 raft_consensus.cc:515] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.817427 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2a2b56003d449a91ad211c58fd69b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:10.817660 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a39ef823fad4fcbab83e42f2eae6c14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:10.820426 859 leader_election.cc:343] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:54:10.823170 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f5fe12020ca44561aa32a5a495b17ded"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:10.824304 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5fe12020ca44561aa32a5a495b17ded in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:10.835759 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Bootstrap replaying log segment 1/1 (160.1K/170.6K this segment, stats: ops{read=360 overwritten=0 applied=359 ignored=0} inserts{seen=339 ignored=0} mutations{seen=401 ignored=0} orphaned_commits=0)
I20260619 19:54:10.841558 1056 raft_consensus.cc:2468] T 7dc1a472e7aa49639212a41619eabff3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:10.836197 2509 leader_election.cc:290] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:10.845026 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 7015d42f7b02426983bdffbd4f597a9f (DEFAULT_TABLE table=default.Table_8765977339bb44a8b5b778228cb90c14 [id=efc30fa2301e431ca3bbf5764529a0a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.845583 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7015d42f7b02426983bdffbd4f597a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.851955 884 tablet_service.cc:1511] Processing CreateTablet for tablet c002f14d206a4424b0d40bde34267033 (DEFAULT_TABLE table=default.Table_7283055752d94a8d8dea3cf8ca00d333 [id=686a2ce5270d4be582415ad56a28885d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.855268 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ab203fd14efa49c38a83e70eedd900f7" } modify_external_catalogs: true
I20260619 19:54:10.855530 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ab203fd14efa49c38a83e70eedd900f7" } modify_external_catalogs: true
I20260619 19:54:10.859768 896 tablet_service.cc:1511] Processing CreateTablet for tablet e5783716513840e0a046b23d245b5700 (DEFAULT_TABLE table=default.Table_4846baa998dc44a790af9fe0cc649f59 [id=bf3f5f5eeb5a4dd9a30db4ed053dbdac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.859732 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e02ea57361e747bc95c820d5eccb8964" } new_table_name: "default.Table_4a534d852e184f36a8e7ea2922979897" modify_external_catalogs: true
I20260619 19:54:10.862952 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c002f14d206a4424b0d40bde34267033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.863211 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01489233bc6f4f8a998fc8d2b8bf70a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.863714 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffd890a5f594a4b91cb2f5c3235fcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.869153 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a8589907aabb4c318987d6a86efc9a07" } modify_external_catalogs: true
I20260619 19:54:10.862879 2026 ts_tablet_manager.cc:1929] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:10.877497 2026 log.cc:1199] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/b7adec89ed984837a8cf3544679ca617
I20260619 19:54:10.878417 1208 tablet_bootstrap.cc:492] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:10.880170 1208 ts_tablet_manager.cc:1403] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.403s user 0.034s sys 0.051s
I20260619 19:54:10.892989 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a8589907aabb4c318987d6a86efc9a07" } modify_external_catalogs: true
I20260619 19:54:10.907256 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5783716513840e0a046b23d245b5700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.907824 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ce69e12fd643ea88c26d941424c2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.908536 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c954463212453797f98852b76c2d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.914033 2747 raft_consensus.cc:493] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.914312 2747 raft_consensus.cc:515] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.919866 2747 leader_election.cc:290] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.932169 2769 tablet.cc:1724] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:10.935199 1200 tablet_bootstrap.cc:492] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:10.937071 1200 ts_tablet_manager.cc:1403] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.169s user 0.003s sys 0.014s
I20260619 19:54:10.939249 2694 raft_consensus.cc:515] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.939930 1034 tablet_service.cc:1511] Processing CreateTablet for tablet de10e2325cfa4e2f84ada2e9072e4b2f (DEFAULT_TABLE table=default.Table_d1ea5a845ac449f1a9f65e78d02e3bb6 [id=1409ce655cc74128a5044700f39c36fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.939950 2694 leader_election.cc:290] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.940356 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de10e2325cfa4e2f84ada2e9072e4b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.949260 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 436) took 1061 ms. Trace:
I20260619 19:54:10.949385 1994 rpcz_store.cc:276] 0619 19:54:09.888112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.889300 (+ 1188us) service_pool.cc:224] Handling call
0619 19:54:10.547120 (+657820us) ts_tablet_manager.cc:1151] Deleting tablet 3091dd1a525a4f779c68b8b77afa5b26
0619 19:54:10.547147 (+ 27us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:10.640404 (+ 93257us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.747749 (+107345us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.949236 (+201487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":657610}
I20260619 19:54:10.950227 2314 raft_consensus.cc:697] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:10.950950 1994 tablet_replica.cc:333] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:10.951212 1994 raft_consensus.cc:2243] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:10.951752 1994 raft_consensus.cc:2272] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:10.952329 1994 ts_tablet_manager.cc:1916] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:10.954677 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0476b1447f984f548d06e71cdda6a875 (DEFAULT_TABLE table=default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:10.955444 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]) successfully deleted
W20260619 19:54:10.955765 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7d1b35a09aad46039677eb3d800b0051 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d1b35a09aad46039677eb3d800b0051 already in progress: creating tablet
W20260619 19:54:10.956043 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ac80d8fb9d874148bc8b0c508448804c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac80d8fb9d874148bc8b0c508448804c already in progress: creating tablet
W20260619 19:54:10.956259 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet bf175c80483346788a148b7277b9ca9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf175c80483346788a148b7277b9ca9d already in progress: creating tablet
W20260619 19:54:10.956453 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 46c2a94a4d794f2aa94b77885812831f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46c2a94a4d794f2aa94b77885812831f already in progress: creating tablet
I20260619 19:54:10.956403 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6e77cdf999432fa7aec86e0bf1205f (DEFAULT_TABLE table=default.Table_a05e5da51d674a85be7881fec2260738 [id=73e1f0ecf27d4d0fb7a6c4c1726bc053]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:10.956650 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c3c0937d5fea430da4dbdf9381157268 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3c0937d5fea430da4dbdf9381157268 already in progress: creating tablet
W20260619 19:54:10.956895 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e5c1ffd83c944ada87d59439b6a9cb3 already in progress: creating tablet
W20260619 19:54:10.957104 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8b2e40a7328d42dd864703db24c1fa3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2e40a7328d42dd864703db24c1fa3c already in progress: creating tablet
I20260619 19:54:10.960651 1201 tablet_bootstrap.cc:492] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:10.951114 1200 raft_consensus.cc:359] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.960897 1201 ts_tablet_manager.cc:1403] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.212s user 0.006s sys 0.013s
I20260619 19:54:10.961249 1200 raft_consensus.cc:385] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.963354 1201 raft_consensus.cc:359] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.962033 1200 raft_consensus.cc:740] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.963551 1201 raft_consensus.cc:385] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:10.963611 1201 raft_consensus.cc:740] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.963816 1201 consensus_queue.cc:260] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.965628 1200 consensus_queue.cc:260] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.969913 2314 consensus_queue.cc:237] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.975313 2747 raft_consensus.cc:493] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.975478 2747 raft_consensus.cc:515] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.975675 2694 raft_consensus.cc:493] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:10.975831 1208 raft_consensus.cc:359] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.975826 2694 raft_consensus.cc:515] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.975986 1208 raft_consensus.cc:385] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:54:10.975921 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 344343us
I20260619 19:54:10.976035 1208 raft_consensus.cc:740] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:10.976241 1208 consensus_queue.cc:260] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:10.976421 2694 leader_election.cc:290] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.977669 1201 ts_tablet_manager.cc:1434] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260619 19:54:10.978451 1201 tablet_bootstrap.cc:492] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:10.987995 1201 tablet_bootstrap.cc:654] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:10.991727 1208 ts_tablet_manager.cc:1434] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.107s user 0.002s sys 0.000s
I20260619 19:54:10.992641 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0476b1447f984f548d06e71cdda6a875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.993018 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6e77cdf999432fa7aec86e0bf1205f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:10.999487 2747 leader_election.cc:290] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:11.000025 1200 ts_tablet_manager.cc:1434] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.062s user 0.004s sys 0.000s
I20260619 19:54:11.007405 1200 tablet_bootstrap.cc:492] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:11.008843 2026 ts_tablet_manager.cc:1950] T b7adec89ed984837a8cf3544679ca617 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:11.011547 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e9d63130dc4e4f208012f0bff14d0489" } new_table_name: "default.Table_f3fbad77d4744a10aac60455a996adbf" modify_external_catalogs: true
I20260619 19:54:11.012225 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dbf85bbf3e0944f0a1fa9d9ff7257b8a" } modify_external_catalogs: true
I20260619 19:54:11.012399 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dbf85bbf3e0944f0a1fa9d9ff7257b8a" } modify_external_catalogs: true
I20260619 19:54:11.013181 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_964ffc6514a5430fbe8b02896e73a88d" } new_table_name: "default.Table_bd6b2d9609f54f4d9347e0b9ffd3ee7f" modify_external_catalogs: true
I20260619 19:54:11.013451 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_18b53a705e3848fdb3172af3e7f87b4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.013998 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18b53a705e3848fdb3172af3e7f87b4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.016049 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d816fde10a7643eaa2813e6bf58bd23b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.016806 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d816fde10a7643eaa2813e6bf58bd23b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:11.019444 1026 consensus_meta.cc:287] T 798c54ef8cde4020903153f72d6e3b1a P e78a44e2c8824fe7bce462e9d33f660c: Time spent flushing consensus metadata: real 0.538s user 0.004s sys 0.000s
W20260619 19:54:11.019572 1029 consensus_meta.cc:287] T a089bafab345412f8bea4a849e584ea7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent flushing consensus metadata: real 0.535s user 0.004s sys 0.000s
I20260619 19:54:11.020054 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b53b86c349a64aa58319ee1134c1b1de" } new_table_name: "default.Table_2b9e5fdc0bc14037a50752fb1870768e" modify_external_catalogs: true
I20260619 19:54:11.020231 1029 tablet_service.cc:1511] Processing CreateTablet for tablet c002f14d206a4424b0d40bde34267033 (DEFAULT_TABLE table=default.Table_7283055752d94a8d8dea3cf8ca00d333 [id=686a2ce5270d4be582415ad56a28885d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:11.020714 1023 consensus_meta.cc:287] T 41489f9f8cb145728d38e111740d8c72 P e78a44e2c8824fe7bce462e9d33f660c: Time spent flushing consensus metadata: real 0.543s user 0.005s sys 0.001s
W20260619 19:54:11.021042 1031 consensus_meta.cc:287] T 027bdf3a047b43f3b9ae2b1a05602d80 P e78a44e2c8824fe7bce462e9d33f660c: Time spent flushing consensus metadata: real 0.546s user 0.006s sys 0.000s
I20260619 19:54:11.015288 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_51eb31da347849a3a2e206fec7dbcee5" } new_table_name: "default.Table_de336ee9cc7e4ed98d1983f3a46ced3c" modify_external_catalogs: true
I20260619 19:54:11.021697 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet eb43742411444ecaa62f74fc729c7745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.021934 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.023820 1208 tablet_bootstrap.cc:492] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:10.983477 2527 raft_consensus.cc:493] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:11.024031 2527 raft_consensus.cc:515] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.024684 2527 leader_election.cc:290] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:10.995821 720 leader_election.cc:304] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.018832 785 raft_consensus.cc:2468] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:11.025746 1039 consensus_meta.cc:287] T f9d9e816e001403a820caca4916f8824 P e78a44e2c8824fe7bce462e9d33f660c: Time spent flushing consensus metadata: real 0.508s user 0.005s sys 0.000s
W20260619 19:54:11.019402 784 consensus_meta.cc:287] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent flushing consensus metadata: real 0.530s user 0.003s sys 0.000s
W20260619 19:54:11.022643 749 consensus_meta.cc:287] T ba983ec444a4494c8da46ab261fc713b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent flushing consensus metadata: real 0.600s user 0.004s sys 0.000s
I20260619 19:54:11.028825 784 raft_consensus.cc:2468] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:11.033015 1973 ts_tablet_manager.cc:1929] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:11.033236 1973 log.cc:1199] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/8522f562665540ce99490ab90e02d801
I20260619 19:54:11.035120 1208 tablet_bootstrap.cc:654] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:11.035616 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 087630689da0433ab876dcd3cd6bec0f
I20260619 19:54:11.038072 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c2c18e114f464defb0935468c8196b5f" } modify_external_catalogs: true
I20260619 19:54:11.038314 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c2c18e114f464defb0935468c8196b5f" } modify_external_catalogs: true
W20260619 19:54:11.039686 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca02c454eec840eb9289950b6da7b131 consensus state has no leader
I20260619 19:54:11.039718 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 268c752e60624f96b37b0afab2d994e3
W20260619 19:54:11.040858 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 766b8781524a4dcda809632e439af264 consensus state has no leader
W20260619 19:54:11.047057 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d44344339f34866bab486a5abf104e9 consensus state has no leader
I20260619 19:54:11.049548 1973 ts_tablet_manager.cc:1950] T 8522f562665540ce99490ab90e02d801 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:11.054028 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0e520375250b4b46ab3faccabdc1ceff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.054991 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d6723d78cce046409a3580a7092ac48f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.055709 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_22cad3dd8de14d32850b7781efde00fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.056020 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_61001685074b47918bcf2235c53aee59" } modify_external_catalogs: true
I20260619 19:54:11.056232 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_61001685074b47918bcf2235c53aee59" } modify_external_catalogs: true
I20260619 19:54:11.055075 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c453f79a82b94fc8b556c1272b0d609a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.052019 2527 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:11.058298 2527 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:11.059263 2527 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:11.052212 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 56426.7us
W20260619 19:54:11.060200 720 consensus_peers.cc:597] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:11.061367 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c453f79a82b94fc8b556c1272b0d609a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:11.062302 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22cad3dd8de14d32850b7781efde00fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.052372 2758 raft_consensus.cc:2804] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:54:11.063726 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e520375250b4b46ab3faccabdc1ceff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.063905 2758 raft_consensus.cc:697] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:11.064327 2758 consensus_queue.cc:237] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:11.066314 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6723d78cce046409a3580a7092ac48f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.069033 2677 raft_consensus.cc:493] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:11.069235 2677 raft_consensus.cc:515] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.070634 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f9e5a4dedd4c81901cb99fecff0919" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:11.070842 1058 raft_consensus.cc:2468] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:11.071333 859 leader_election.cc:304] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.071617 2509 raft_consensus.cc:2804] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:11.071691 2509 raft_consensus.cc:493] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:11.071758 2509 raft_consensus.cc:3060] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:11.080292 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6433bc9150946d5b0bb7900cc30ed42 consensus state has no leader
I20260619 19:54:11.092592 2677 leader_election.cc:290] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:11.093685 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 64497.3us
W20260619 19:54:11.094738 719 leader_election.cc:343] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.095994 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 335) took 4596 ms. Trace:
I20260619 19:54:11.096168 1973 rpcz_store.cc:276] 0619 19:54:06.499311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.499375 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:10.701330 (+4201955us) ts_tablet_manager.cc:1151] Deleting tablet 8522f562665540ce99490ab90e02d801
0619 19:54:10.701341 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.028391 (+327050us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.032939 (+ 4548us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.095976 (+ 63037us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4201766}
I20260619 19:54:11.096727 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 337) took 4304 ms. Trace:
I20260619 19:54:11.096925 1973 rpcz_store.cc:276] 0619 19:54:06.792471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.792592 (+ 121us) service_pool.cc:224] Handling call
0619 19:54:11.096603 (+4304011us) ts_tablet_manager.cc:1151] Deleting tablet ef509392f1b3472db598c8b414258932
0619 19:54:11.096614 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.096712 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4303787}
I20260619 19:54:11.112339 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7051f068984446bfafc44b43b2dd2bea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.113399 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e51a6ce3d9ea48d09b42531d3923a957"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.115576 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d06bac02341e4e018a34562340ec7d74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.116422 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f18be194dbaa4a64b422513b3ce34908"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.116925 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f18be194dbaa4a64b422513b3ce34908 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.114931 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3064bd01ced9429d82ce449e8afc4999" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.127220 784 raft_consensus.cc:2468] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:11.115180 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3354ae6dd46bd9c5414d4c4a720a1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:11.127524 785 raft_consensus.cc:3060] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.130383 785 raft_consensus.cc:2468] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:11.118816 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.131882 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 342) took 4223 ms. Trace:
I20260619 19:54:11.119886 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c6ad82f0c94e27b2eb4dbf185fab66" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.135617 779 raft_consensus.cc:2393] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
W20260619 19:54:11.135643 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7051f068984446bfafc44b43b2dd2bea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.118817 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3064bd01ced9429d82ce449e8afc4999" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:11.139686 778 raft_consensus.cc:3060] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:11.139966 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d06bac02341e4e018a34562340ec7d74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.140126 1973 rpcz_store.cc:276] 0619 19:54:06.908629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.908684 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:11.131801 (+4223117us) ts_tablet_manager.cc:1151] Deleting tablet e151dc97ad13456ba35708d50c9d7b26
0619 19:54:11.131812 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.131867 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4222819}
I20260619 19:54:11.140640 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 360) took 4196 ms. Trace:
I20260619 19:54:11.140722 1973 rpcz_store.cc:276] 0619 19:54:06.944278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.945108 (+ 830us) service_pool.cc:224] Handling call
0619 19:54:11.140476 (+4195368us) ts_tablet_manager.cc:1151] Deleting tablet 3f1e6d16452b4e568745f884cd13ebac
0619 19:54:11.140492 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.140619 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4195186}
W20260619 19:54:11.141346 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e51a6ce3d9ea48d09b42531d3923a957 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.142953 778 raft_consensus.cc:2468] T 3064bd01ced9429d82ce449e8afc4999 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:11.148739 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 268c752e60624f96b37b0afab2d994e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:11.148739 2762 log.cc:927] Time spent T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
I20260619 19:54:11.152370 1055 raft_consensus.cc:2468] T 3064bd01ced9429d82ce449e8afc4999 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:11.152405 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.152895 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.152977 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.153048 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.022115 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 68788824224b426bb433b87763073bae with delete_type TABLET_DATA_DELETED (replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.155568 859 leader_election.cc:304] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.155911 2715 raft_consensus.cc:2804] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:11.156039 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c002f14d206a4424b0d40bde34267033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.157620 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 087630689da0433ab876dcd3cd6bec0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.157792 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 268c752e60624f96b37b0afab2d994e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.158475 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet fde2b5d12ab7465791f26d214c2dc2f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.159934 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 087630689da0433ab876dcd3cd6bec0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.160174 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 135) took 9786 ms. Trace:
I20260619 19:54:11.141034 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 351) took 4198 ms. Trace:
I20260619 19:54:11.160269 1973 rpcz_store.cc:276] 0619 19:54:06.942467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.943193 (+ 726us) service_pool.cc:224] Handling call
0619 19:54:11.140927 (+4197734us) ts_tablet_manager.cc:1151] Deleting tablet e10612b432c64bb4be527cf7b6e86cf8
0619 19:54:11.140935 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.141006 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4189497}
I20260619 19:54:11.160672 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 353) took 4217 ms. Trace:
I20260619 19:54:11.160751 1973 rpcz_store.cc:276] 0619 19:54:06.942982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.943347 (+ 365us) service_pool.cc:224] Handling call
0619 19:54:11.160537 (+4217190us) ts_tablet_manager.cc:1151] Deleting tablet 789f44a51430454db30e41ad2dd2efb0
0619 19:54:11.160547 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.160653 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4209022}
I20260619 19:54:11.161406 1973 tablet_replica.cc:333] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:11.161586 1973 raft_consensus.cc:2243] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.161851 1973 raft_consensus.cc:2272] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.160276 2770 tablet.cc:1724] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:11.162154 2509 raft_consensus.cc:515] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.162397 1973 ts_tablet_manager.cc:1916] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.162025 2026 rpcz_store.cc:276] 0619 19:54:01.307534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.307598 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:10.577714 (+9270116us) ts_tablet_manager.cc:1151] Deleting tablet b7adec89ed984837a8cf3544679ca617
0619 19:54:10.577723 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:10.703542 (+125819us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:10.862755 (+159213us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.093791 (+231036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9251346}
I20260619 19:54:11.163498 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet b7adec89ed984837a8cf3544679ca617 (table default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]) successfully deleted
I20260619 19:54:11.163525 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f9e5a4dedd4c81901cb99fecff0919" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:11.163681 1056 raft_consensus.cc:3060] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.164069 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e5783716513840e0a046b23d245b5700 (DEFAULT_TABLE table=default.Table_4846baa998dc44a790af9fe0cc649f59 [id=bf3f5f5eeb5a4dd9a30db4ed053dbdac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.164372 2715 raft_consensus.cc:697] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:11.164528 1201 tablet_bootstrap.cc:492] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:11.165118 720 leader_election.cc:343] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4b88dd7d19514e83857e2c6108291b9f
I20260619 19:54:11.166806 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5783716513840e0a046b23d245b5700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.168023 1208 tablet_bootstrap.cc:492] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:11.168131 2509 leader_election.cc:290] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:11.168182 1208 ts_tablet_manager.cc:1403] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.145s user 0.012s sys 0.001s
I20260619 19:54:11.169647 1200 tablet_bootstrap.cc:654] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:11.171108 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f9e5a4dedd4c81901cb99fecff0919" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.171379 779 raft_consensus.cc:2468] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:11.173108 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2f9e5a4dedd4c81901cb99fecff0919" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:11.173305 779 raft_consensus.cc:3060] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.174862 2715 consensus_queue.cc:237] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.176743 779 raft_consensus.cc:2468] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:11.181211 1201 ts_tablet_manager.cc:1403] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.186s user 0.007s sys 0.008s
I20260619 19:54:11.182214 1201 raft_consensus.cc:359] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.182413 1201 raft_consensus.cc:385] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:11.182487 1201 raft_consensus.cc:740] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:11.182834 2026 tablet_replica.cc:333] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:11.182973 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71f92f4e3040c09b67e287a19eea74" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:11.183059 2026 raft_consensus.cc:2243] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:11.183192 1201 consensus_queue.cc:260] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.183370 2026 raft_consensus.cc:2272] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.183847 1201 ts_tablet_manager.cc:1434] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:54:11.183972 2026 ts_tablet_manager.cc:1916] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.184124 1201 tablet_bootstrap.cc:492] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:11.184154 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71f92f4e3040c09b67e287a19eea74" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.185899 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 6f2a8462edb54df2aa0343ecea6dd761 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:11.189069 1201 tablet_bootstrap.cc:654] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:11.189956 2509 raft_consensus.cc:493] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:11.190150 2509 raft_consensus.cc:515] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:11.190821 2509 leader_election.cc:290] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:11.191224 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:11.191879 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:11.192158 779 raft_consensus.cc:3060] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.196056 779 raft_consensus.cc:2468] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:11.197453 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e48a3e5c1642f6b12adb0033f74404" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.197654 783 raft_consensus.cc:2468] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
W20260619 19:54:11.199255 996 leader_election.cc:343] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.200021 996 leader_election.cc:304] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:11.199817 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e48a3e5c1642f6b12adb0033f74404" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:11.211778 1994 ts_tablet_manager.cc:1929] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:11.211882 1994 log.cc:1199] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9f33c2c00b414fbebf1965510e1e2b96
W20260619 19:54:11.212798 720 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b57381b0a02141459dc582196d0c0095
I20260619 19:54:11.213971 921 raft_consensus.cc:3060] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.214540 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f6e202e8fd4a7292774d5eb4c7266b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:11.214833 2509 raft_consensus.cc:493] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:11.214994 2509 raft_consensus.cc:515] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:11.211740 1056 raft_consensus.cc:2468] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:11.216635 859 leader_election.cc:304] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.222184 1208 raft_consensus.cc:359] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.222430 1208 raft_consensus.cc:385] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:11.230834 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet cc57b42a97fa437b93842f7cd379dbb7 (table default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]) successfully deleted
W20260619 19:54:11.231353 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b289d3068d184d47b671617213aa512a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b289d3068d184d47b671617213aa512a already in progress: creating tablet
W20260619 19:54:11.231640 858 consensus_peers.cc:597] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 221cc85629ca41e9ad71adfe0beb392a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:11.232196 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]) successfully deleted
W20260619 19:54:11.232401 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ef509392f1b3472db598c8b414258932 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef509392f1b3472db598c8b414258932 already in progress: creating tablet
W20260619 19:54:11.232611 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e151dc97ad13456ba35708d50c9d7b26 because the tablet was not found. No further retry: Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26
W20260619 19:54:11.232820 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 3f1e6d16452b4e568745f884cd13ebac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f1e6d16452b4e568745f884cd13ebac already in progress: creating tablet
W20260619 19:54:11.233006 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e10612b432c64bb4be527cf7b6e86cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e10612b432c64bb4be527cf7b6e86cf8 already in progress: creating tablet
W20260619 19:54:11.233194 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 789f44a51430454db30e41ad2dd2efb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 789f44a51430454db30e41ad2dd2efb0 already in progress: creating tablet
I20260619 19:54:11.234256 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f6e202e8fd4a7292774d5eb4c7266b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.238679 2747 raft_consensus.cc:2804] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:11.238852 2747 raft_consensus.cc:697] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:11.239173 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2a582108ce724404a89ca7858fa45231" } modify_external_catalogs: true
I20260619 19:54:11.239179 2747 consensus_queue.cc:237] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.239368 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2a582108ce724404a89ca7858fa45231" } modify_external_catalogs: true
I20260619 19:54:11.241863 1994 ts_tablet_manager.cc:1950] T 9f33c2c00b414fbebf1965510e1e2b96 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:11.242993 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]) successfully deleted
I20260619 19:54:11.243196 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3a39ef823fad4fcbab83e42f2eae6c14" } new_table_name: "default.Table_2ec9be1473054787a3dd12374aff1ab2" modify_external_catalogs: true
I20260619 19:54:11.244833 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_899273cda1db49d083179e31919b0526" } new_table_name: "default.Table_b1a2876c0b1d41ecac7d149c127dcead" modify_external_catalogs: true
I20260619 19:54:11.259228 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc1a472e7aa49639212a41619eabff3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:11.259656 858 leader_election.cc:343] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:11.260653 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b88dd7d19514e83857e2c6108291b9f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:11.260941 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:11.261678 859 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 950b8e74d12f46a68ba5eae3186c87a9
W20260619 19:54:11.262100 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 62082.3us
I20260619 19:54:11.263209 996 leader_election.cc:304] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:11.263571 1994 tablet_replica.cc:333] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:11.263984 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ac55fd703e184730ab053e045b0f4e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac55fd703e184730ab053e045b0f4e2c already in progress: creating tablet
W20260619 19:54:11.264338 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet fcb37eed280c48e8931b6fc94f7600dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcb37eed280c48e8931b6fc94f7600dd already in progress: creating tablet
W20260619 19:54:11.264519 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 056f7982f51f45a78d2b9b0a0b50576e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 056f7982f51f45a78d2b9b0a0b50576e already in progress: creating tablet
W20260619 19:54:11.264739 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet de6c34ec79d24bfe926f90b8067db558 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de6c34ec79d24bfe926f90b8067db558 already in progress: creating tablet
I20260619 19:54:11.263651 2747 raft_consensus.cc:2804] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:54:11.264959 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet eb43742411444ecaa62f74fc729c7745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb43742411444ecaa62f74fc729c7745 already in progress: creating tablet
I20260619 19:54:11.265028 2747 raft_consensus.cc:697] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:11.265363 2747 consensus_queue.cc:237] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.265592 2694 consensus_queue.cc:1048] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:11.266458 996 leader_election.cc:343] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.266698 996 leader_election.cc:304] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:11.267076 2694 raft_consensus.cc:2749] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:11.268160 996 leader_election.cc:304] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.268666 2694 raft_consensus.cc:2804] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:11.268800 2694 raft_consensus.cc:697] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:11.269097 2694 consensus_queue.cc:237] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:11.281026 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc912ab07b074d3d836fe53a0de54444 consensus state has no leader
I20260619 19:54:11.281481 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0761528dd12f4e449282247241577e72" } modify_external_catalogs: true
I20260619 19:54:11.281797 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0761528dd12f4e449282247241577e72" } modify_external_catalogs: true
I20260619 19:54:11.283035 1994 raft_consensus.cc:2243] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:11.284046 1994 pending_rounds.cc:70] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:11.284101 1994 pending_rounds.cc:77] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657694785470464 op_type: NO_OP noop_request { }
I20260619 19:54:11.284192 1994 raft_consensus.cc:2889] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:11.284271 1994 raft_consensus.cc:2272] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:11.285095 2795 consensus_queue.cc:1175] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e78a44e2c8824fe7bce462e9d33f660c" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
W20260619 19:54:11.285207 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be5237ff855741438165e20fa12576a5 has no consensus state
I20260619 19:54:11.285609 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b288e66d14164a5489605094411f072c" } new_table_name: "default.Table_2f18676481844db485c712680a0bf2e2" modify_external_catalogs: true
I20260619 19:54:11.288411 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 71d212a279754f2497ad4fc2a3c8b5c3
I20260619 19:54:11.289592 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1b9c1d7cb147402292e27bb7ca37bf1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.290352 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b9c1d7cb147402292e27bb7ca37bf1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:11.294104 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a2a2b56003d449a91ad211c58fd69b8 consensus state has no leader
I20260619 19:54:11.294679 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f7f8fcd03be04b6f9d979e221159d073"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.295496 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7f8fcd03be04b6f9d979e221159d073 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.300042 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a921ba7a73a1450db17d69d105fb7e54" } new_table_name: "default.Table_aca707b5ab0b4a5aa81637909810fae3" modify_external_catalogs: true
I20260619 19:54:11.303604 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]). Expected version 1 got 0
I20260619 19:54:11.304536 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_66674465fc2640b383f68327c9e1d710"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.304836 1994 ts_tablet_manager.cc:1916] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:11.305202 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66674465fc2640b383f68327c9e1d710 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.308142 1200 tablet_bootstrap.cc:492] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:11.308328 1200 ts_tablet_manager.cc:1403] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.301s user 0.002s sys 0.006s
I20260619 19:54:11.311590 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:11.311892 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:11.312179 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
W20260619 19:54:11.314621 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 140de873b1094bf4ac9fa29507722300 consensus state has no leader
I20260619 19:54:11.295277 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:11.314924 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 01489233bc6f4f8a998fc8d2b8bf70a6
I20260619 19:54:11.315579 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_86c52c50e5004c9495abc628722903b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.315987 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_435dbc445b134922a0c9ac422610b4e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.316643 858 leader_election.cc:304] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.316926 919 raft_consensus.cc:2468] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
W20260619 19:54:11.317051 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_435dbc445b134922a0c9ac422610b4e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.317152 918 raft_consensus.cc:2468] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:11.317967 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_88ebd05c9e0e449293d1245db9335476"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.316380 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0168c82ece6e4ce683265229a5d4c6ea
W20260619 19:54:11.319212 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88ebd05c9e0e449293d1245db9335476 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.316325 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e47761965a9e4406ae801e08b9ba9dc1" } new_table_name: "default.Table_4eb88930eea24fe5a377a3511584ecdd" modify_external_catalogs: true
W20260619 19:54:11.319806 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86c52c50e5004c9495abc628722903b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.321419 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 0168c82ece6e4ce683265229a5d4c6ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.321676 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.325027 529 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:11.325340 529 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:11.328998 2715 raft_consensus.cc:2804] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:11.309092 1200 raft_consensus.cc:359] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.329516 1200 raft_consensus.cc:385] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:11.333287 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 71fa4434f83f42d4abacceeb2e816c26
I20260619 19:54:11.334759 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 71fa4434f83f42d4abacceeb2e816c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.336026 1994 ts_tablet_manager.cc:1929] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:11.336333 1994 log.cc:1199] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:54:11.337862 1994 ts_tablet_manager.cc:1950] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:11.337930 2509 leader_election.cc:290] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:11.338987 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (table default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]) successfully deleted
I20260619 19:54:11.302428 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 71d212a279754f2497ad4fc2a3c8b5c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.327708 2783 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260619 19:54:11.351920 2758 raft_consensus.cc:493] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:11.352164 2758 raft_consensus.cc:515] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.352828 2758 leader_election.cc:290] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:11.354744 720 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:11.357463 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 123613c0cdc347f9844b52ec34c169aa (DEFAULT_TABLE table=default.Table_141d9f6d0fa641278b11c2de1b754daa [id=efd1cacdcba74be0bfe9db9f65d216ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.358990 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.359406 763 tablet_service.cc:1511] Processing CreateTablet for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 (DEFAULT_TABLE table=default.Table_c2c18e114f464defb0935468c8196b5f [id=6f0054806fe64c6d96acb3b1ee625069]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.359795 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01489233bc6f4f8a998fc8d2b8bf70a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.360034 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123613c0cdc347f9844b52ec34c169aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:11.356371 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 88396.9us
I20260619 19:54:11.362154 996 leader_election.cc:304] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.363444 1994 tablet_replica.cc:333] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:11.363432 760 tablet_service.cc:1511] Processing CreateTablet for tablet 69c954463212453797f98852b76c2d5f (DEFAULT_TABLE table=default.Table_12085d30a49f41afa472ace4c90f658d [id=86907ad38a7e47cd850693e106515d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.363683 1994 raft_consensus.cc:2243] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.363826 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c954463212453797f98852b76c2d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.363823 1994 raft_consensus.cc:2272] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.363869 761 tablet_service.cc:1511] Processing CreateTablet for tablet f6ce69e12fd643ea88c26d941424c2ab (DEFAULT_TABLE table=default.Table_48480bf0e6404c51870932c9cb33ad23 [id=13f8faf01e3746c1862b9e36492a935a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.364162 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ce69e12fd643ea88c26d941424c2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.364310 747 tablet_service.cc:1511] Processing CreateTablet for tablet cffd890a5f594a4b91cb2f5c3235fcad (DEFAULT_TABLE table=default.Table_7e3b1916ed824eccaf051b9832b14459 [id=1e5ee965670645dc8455e457691093bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.364363 1994 ts_tablet_manager.cc:1916] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.364614 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffd890a5f594a4b91cb2f5c3235fcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.368296 749 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2a2b56003d449a91ad211c58fd69b8 (DEFAULT_TABLE table=default.Table_b288e66d14164a5489605094411f072c [id=ecb81e20d98a4769ada8a294a08cded0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.368675 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2a2b56003d449a91ad211c58fd69b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.371728 761 tablet_service.cc:1558] Processing DeleteTablet for tablet de6c34ec79d24bfe926f90b8067db558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.375190 761 tablet_service.cc:1511] Processing CreateTablet for tablet 58c2959e96144fdf8f20c99ca7e4b415 (DEFAULT_TABLE table=default.Table_ccaf614a02d2417bb6703630eabddabe [id=83adeae74eec459a8d1a8d80bbb40547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.375980 765 tablet_service.cc:1511] Processing CreateTablet for tablet a7cd9284ce9246319f768a50f977abc9 (DEFAULT_TABLE table=default.Table_f238923ba00645f989b04e383fbcb760 [id=72eba666076049a296810522df16bf2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.376991 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:11.379755 758 tablet_service.cc:1511] Processing CreateTablet for tablet 12392839b79a43f0b444c754b04026b1 (DEFAULT_TABLE table=default.Table_9386bf7111e447c38a5bd2303dde8533 [id=cf0efd7e377a470f80571a394d5bf893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.380092 754 tablet_service.cc:1511] Processing CreateTablet for tablet d400ef98ca5d4aad95051cf2edab9f26 (DEFAULT_TABLE table=default.Table_af2f1c9e09b845669ba83b6327f8bea4 [id=8f4fb80196c34861a298f827f411bc0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.380236 746 tablet_service.cc:1511] Processing CreateTablet for tablet a664b768f8b6449cb881767d4fd369ea (DEFAULT_TABLE table=default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.380633 750 tablet_service.cc:1511] Processing CreateTablet for tablet bef2eb2eaa1d45b9adbea27f0269ac49 (DEFAULT_TABLE table=default.Table_4c45ac855591404682937e604638af24 [id=ea181ba3905049cc83c7c26bef1122a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.380781 751 tablet_service.cc:1511] Processing CreateTablet for tablet bc2291967f0945efb7486079a93a6aad (DEFAULT_TABLE table=default.Table_e886b4f784f4431e8bd1f7fc7421797f [id=a5a9ed0985784c82a81dea4dbe558ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.381091 755 tablet_service.cc:1511] Processing CreateTablet for tablet 7015d42f7b02426983bdffbd4f597a9f (DEFAULT_TABLE table=default.Table_8765977339bb44a8b5b778228cb90c14 [id=efc30fa2301e431ca3bbf5764529a0a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.381954 762 tablet_service.cc:1511] Processing CreateTablet for tablet de10e2325cfa4e2f84ada2e9072e4b2f (DEFAULT_TABLE table=default.Table_d1ea5a845ac449f1a9f65e78d02e3bb6 [id=1409ce655cc74128a5044700f39c36fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.382331 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c2959e96144fdf8f20c99ca7e4b415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.382789 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2291967f0945efb7486079a93a6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.389253 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7015d42f7b02426983bdffbd4f597a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.390128 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef2eb2eaa1d45b9adbea27f0269ac49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.391582 2026 ts_tablet_manager.cc:1929] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:11.391714 2026 log.cc:1199] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d29506dab4c84850ad79b8b7a0340987
I20260619 19:54:11.392063 2026 ts_tablet_manager.cc:1950] T d29506dab4c84850ad79b8b7a0340987 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:11.392400 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 136) took 10083 ms. Trace:
I20260619 19:54:11.392483 2026 rpcz_store.cc:276] 0619 19:54:01.308634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.308696 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:11.162778 (+9854082us) ts_tablet_manager.cc:1151] Deleting tablet d29506dab4c84850ad79b8b7a0340987
0619 19:54:11.173533 (+ 10755us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.192304 (+ 18771us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.391500 (+199196us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.392367 (+ 867us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9836369}
I20260619 19:54:11.392836 2026 tablet_replica.cc:333] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:11.393327 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de10e2325cfa4e2f84ada2e9072e4b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.395685 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a664b768f8b6449cb881767d4fd369ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.395953 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12392839b79a43f0b444c754b04026b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.396476 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cd9284ce9246319f768a50f977abc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.399369 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d400ef98ca5d4aad95051cf2edab9f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.423903 2784 raft_consensus.cc:2749] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:11.432387 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b9a8bded95054d3b9c2733a836619a28 (DEFAULT_TABLE table=default.Table_d6d9aa396afe4b37a7ae9565c826ed56 [id=7dc9416a143441038aca736d73b99fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.432902 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a8bded95054d3b9c2733a836619a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.434136 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_aa9ff8b3d180441e8598155135cb17f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.434728 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa9ff8b3d180441e8598155135cb17f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.437575 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_531872c50c2144e49bf65cf0832519b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:11.438023 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_fa04a3fc676f423db521f04052e2b148"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.438256 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_531872c50c2144e49bf65cf0832519b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:11.438558 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa04a3fc676f423db521f04052e2b148 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.439392 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5f46bc1a728a4da69e53ef6519b4e5a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.439877 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f46bc1a728a4da69e53ef6519b4e5a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.440915 2747 raft_consensus.cc:2804] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:11.441030 2747 raft_consensus.cc:493] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:11.440927 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 7641dc1e96f6422f88b176c345986179 (DEFAULT_TABLE table=default.Table_cd25cf2ffebc4ffb8027a371385e324a [id=a743b119bfbe42f2868b810e336e273f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.441100 2747 raft_consensus.cc:3060] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.441413 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7641dc1e96f6422f88b176c345986179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.443878 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6f2a8462edb54df2aa0343ecea6dd761
I20260619 19:54:11.444331 531 catalog_manager.cc:6784] ReplaceTablet: tablet 6f2a8462edb54df2aa0343ecea6dd761 deleted and replaced by tablet 595f3130e2554614be1bff275917981d
I20260619 19:54:11.445395 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2a8462edb54df2aa0343ecea6dd761 with delete_type TABLET_DATA_DELETED (replaced by tablet 595f3130e2554614be1bff275917981d) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.445783 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3bc715118743eb860295bc6779cda3 (DEFAULT_TABLE table=default.Table_a01a0515a2ae4fc2ae67f87cb4d0c6d5 [id=434a4e2175ee40df9fe6bee455e66309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.446158 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3bc715118743eb860295bc6779cda3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.448827 1036 tablet_service.cc:1511] Processing CreateTablet for tablet c85407a4d392498290eae64df5f85edf (DEFAULT_TABLE table=default.Table_8882bd0a559b4556aef7a3175c2707fd [id=12cbca71e40549d8acee11ce9823ff5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.449184 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85407a4d392498290eae64df5f85edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.450210 1973 ts_tablet_manager.cc:1929] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:11.450333 1973 log.cc:1199] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/4b22024a0c434f8e8d4a370dbfb9a4e2
I20260619 19:54:11.450727 1973 ts_tablet_manager.cc:1950] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:11.451380 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 67245.2us
I20260619 19:54:11.451454 1035 tablet_service.cc:1511] Processing CreateTablet for tablet a444ebd84bb340b1b1c0d695d8157d8a (DEFAULT_TABLE table=default.Table_5f0c69fbe322403aad471900afe7bea7 [id=6e849c410d764f00bc28f530dfeb905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.451800 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a444ebd84bb340b1b1c0d695d8157d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.459928 762 tablet_service.cc:1511] Processing CreateTablet for tablet 0476b1447f984f548d06e71cdda6a875 (DEFAULT_TABLE table=default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.460640 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0476b1447f984f548d06e71cdda6a875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.465342 2747 raft_consensus.cc:515] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.466168 2747 leader_election.cc:290] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:11.471272 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c322c38aae114a428f64a476a2ae9b5f consensus state has no leader
I20260619 19:54:11.472693 1994 ts_tablet_manager.cc:1929] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:11.472879 1994 log.cc:1199] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/2c71f92f4e3040c09b67e287a19eea74
I20260619 19:54:11.473242 1994 ts_tablet_manager.cc:1950] T 2c71f92f4e3040c09b67e287a19eea74 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:11.473909 1994 tablet_replica.cc:333] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:11.473879 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 2c71f92f4e3040c09b67e287a19eea74 (table default.Table_64d25d0d86ef4a70a981ebed6a29e834 [id=2269d802204a4c9189f2eda909734b08]) successfully deleted
I20260619 19:54:11.474174 1994 raft_consensus.cc:2243] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.474395 1994 raft_consensus.cc:2272] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:11.474390 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e22e0f53008c4a96bf56b7f057f81cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e22e0f53008c4a96bf56b7f057f81cd5 already in progress: creating tablet
I20260619 19:54:11.475019 1994 ts_tablet_manager.cc:1916] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.477355 754 tablet_service.cc:1558] Processing DeleteTablet for tablet eb43742411444ecaa62f74fc729c7745 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.478214 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.478710 754 tablet_service.cc:1558] Processing DeleteTablet for tablet fde2b5d12ab7465791f26d214c2dc2f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.479347 754 tablet_service.cc:1511] Processing CreateTablet for tablet c002f14d206a4424b0d40bde34267033 (DEFAULT_TABLE table=default.Table_7283055752d94a8d8dea3cf8ca00d333 [id=686a2ce5270d4be582415ad56a28885d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.479900 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c002f14d206a4424b0d40bde34267033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.489969 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0b95ccb115dc4f94b0db2f904eda5e2c" } new_table_name: "default.Table_47777facbac0455db73ae3e21ce363ea" modify_external_catalogs: true
I20260619 19:54:11.491560 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c752ae3fb15b43a19f8a402dc1557a49" } new_table_name: "default.Table_f5566dfcba0c4225b2a141d7bcb7d135" modify_external_catalogs: true
I20260619 19:54:11.493403 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4a534d852e184f36a8e7ea2922979897" } modify_external_catalogs: true
I20260619 19:54:11.493651 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4a534d852e184f36a8e7ea2922979897" } modify_external_catalogs: true
I20260619 19:54:11.499915 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_443e720ca25543829dd293413d08f95e" } new_table_name: "default.Table_2e742d603b764daa86e93b4018379875" modify_external_catalogs: true
W20260619 19:54:11.503227 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 141255us
W20260619 19:54:11.504940 996 leader_election.cc:343] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.511392 921 raft_consensus.cc:2468] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:11.512259 762 tablet_service.cc:1511] Processing CreateTablet for tablet 6e6e77cdf999432fa7aec86e0bf1205f (DEFAULT_TABLE table=default.Table_a05e5da51d674a85be7881fec2260738 [id=73e1f0ecf27d4d0fb7a6c4c1726bc053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.512771 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e6e77cdf999432fa7aec86e0bf1205f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.517243 2026 raft_consensus.cc:2243] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.518774 2026 raft_consensus.cc:2272] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.523761 2539 raft_consensus.cc:493] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
W20260619 19:54:11.523923 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 257308us
I20260619 19:54:11.527103 2769 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260619 19:54:11.534034 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e48a3e5c1642f6b12adb0033f74404" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:11.534233 779 raft_consensus.cc:3060] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.536993 779 raft_consensus.cc:2468] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:11.543257 996 leader_election.cc:343] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:11.544108 996 leader_election.cc:343] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.544922 2026 ts_tablet_manager.cc:1916] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.548594 1201 tablet_bootstrap.cc:492] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:11.549501 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 087630689da0433ab876dcd3cd6bec0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.549726 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 268c752e60624f96b37b0afab2d994e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.549891 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.550133 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 0168c82ece6e4ce683265229a5d4c6ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.550294 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 71fa4434f83f42d4abacceeb2e816c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.550352 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.550729 747 tablet_service.cc:1511] Processing CreateTablet for tablet 7641dc1e96f6422f88b176c345986179 (DEFAULT_TABLE table=default.Table_cd25cf2ffebc4ffb8027a371385e324a [id=a743b119bfbe42f2868b810e336e273f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.551254 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7641dc1e96f6422f88b176c345986179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.550305 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 71d212a279754f2497ad4fc2a3c8b5c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.551517 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 68788824224b426bb433b87763073bae with delete_type TABLET_DATA_DELETED (replaced by tablet 056f7982f51f45a78d2b9b0a0b50576e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.550726 750 tablet_service.cc:1511] Processing CreateTablet for tablet 123613c0cdc347f9844b52ec34c169aa (DEFAULT_TABLE table=default.Table_141d9f6d0fa641278b11c2de1b754daa [id=efd1cacdcba74be0bfe9db9f65d216ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.551971 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123613c0cdc347f9844b52ec34c169aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.550726 754 tablet_service.cc:1511] Processing CreateTablet for tablet e5783716513840e0a046b23d245b5700 (DEFAULT_TABLE table=default.Table_4846baa998dc44a790af9fe0cc649f59 [id=bf3f5f5eeb5a4dd9a30db4ed053dbdac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.553467 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5783716513840e0a046b23d245b5700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.555259 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.555667 746 tablet_service.cc:1511] Processing CreateTablet for tablet b9a8bded95054d3b9c2733a836619a28 (DEFAULT_TABLE table=default.Table_d6d9aa396afe4b37a7ae9565c826ed56 [id=7dc9416a143441038aca736d73b99fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.555958 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a8bded95054d3b9c2733a836619a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.547775 2539 raft_consensus.cc:515] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:11.567453 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2a8462edb54df2aa0343ecea6dd761 with delete_type TABLET_DATA_DELETED (replaced by tablet 595f3130e2554614be1bff275917981d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.567960 751 tablet_service.cc:1511] Processing CreateTablet for tablet a444ebd84bb340b1b1c0d695d8157d8a (DEFAULT_TABLE table=default.Table_5f0c69fbe322403aad471900afe7bea7 [id=6e849c410d764f00bc28f530dfeb905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.568360 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a444ebd84bb340b1b1c0d695d8157d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.571624 755 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3bc715118743eb860295bc6779cda3 (DEFAULT_TABLE table=default.Table_a01a0515a2ae4fc2ae67f87cb4d0c6d5 [id=434a4e2175ee40df9fe6bee455e66309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.571973 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3bc715118743eb860295bc6779cda3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:11.573050 859 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:11.575460 765 tablet_service.cc:1511] Processing CreateTablet for tablet c85407a4d392498290eae64df5f85edf (DEFAULT_TABLE table=default.Table_8882bd0a559b4556aef7a3175c2707fd [id=12cbca71e40549d8acee11ce9823ff5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.575536 2539 leader_election.cc:290] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:11.575886 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85407a4d392498290eae64df5f85edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.576246 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 0168c82ece6e4ce683265229a5d4c6ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.576462 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 71fa4434f83f42d4abacceeb2e816c26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.576886 896 tablet_service.cc:1511] Processing CreateTablet for tablet 123613c0cdc347f9844b52ec34c169aa (DEFAULT_TABLE table=default.Table_141d9f6d0fa641278b11c2de1b754daa [id=efd1cacdcba74be0bfe9db9f65d216ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.577307 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123613c0cdc347f9844b52ec34c169aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.577469 892 tablet_service.cc:1511] Processing CreateTablet for tablet b9a8bded95054d3b9c2733a836619a28 (DEFAULT_TABLE table=default.Table_d6d9aa396afe4b37a7ae9565c826ed56 [id=7dc9416a143441038aca736d73b99fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.577838 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a8bded95054d3b9c2733a836619a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.578748 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2a8462edb54df2aa0343ecea6dd761 with delete_type TABLET_DATA_DELETED (replaced by tablet 595f3130e2554614be1bff275917981d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.580406 1201 ts_tablet_manager.cc:1403] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.365s user 0.011s sys 0.012s
I20260619 19:54:11.588053 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8c10ee4d02fa48fdb10e3e5110f85cad
I20260619 19:54:11.589389 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 71d212a279754f2497ad4fc2a3c8b5c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.589798 2802 raft_consensus.cc:493] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:11.589805 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c10ee4d02fa48fdb10e3e5110f85cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.590052 2715 raft_consensus.cc:697] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:11.591446 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.593102 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5df77d322daf403ba382436b5192ca95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.593921 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5df77d322daf403ba382436b5192ca95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.598199 1994 ts_tablet_manager.cc:1929] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:11.599059 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 367163us
W20260619 19:54:11.600139 858 leader_election.cc:343] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 37393d7c16594032bf2a69abb0ab5931
I20260619 19:54:11.600425 858 leader_election.cc:304] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.601171 532 master_service.cc:960] ReplaceTablet: received request to replace tablet 1ded605c2edc4c2fb138d07dea4a14b4 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:11.602063 2539 raft_consensus.cc:2749] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:11.603036 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3bc715118743eb860295bc6779cda3 (DEFAULT_TABLE table=default.Table_a01a0515a2ae4fc2ae67f87cb4d0c6d5 [id=434a4e2175ee40df9fe6bee455e66309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.603149 1994 log.cc:1199] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b8e3354ae6dd46bd9c5414d4c4a720a1
I20260619 19:54:11.603468 1994 ts_tablet_manager.cc:1950] T b8e3354ae6dd46bd9c5414d4c4a720a1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:11.603468 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6ec149e1ac475f8038b328dae4af2a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:11.604341 859 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:11.604563 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b8e3354ae6dd46bd9c5414d4c4a720a1 (table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]) successfully deleted
I20260619 19:54:11.607523 2802 raft_consensus.cc:515] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.608218 2802 leader_election.cc:290] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:11.608415 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c10ee4d02fa48fdb10e3e5110f85cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.608551 885 tablet_service.cc:1511] Processing CreateTablet for tablet a444ebd84bb340b1b1c0d695d8157d8a (DEFAULT_TABLE table=default.Table_5f0c69fbe322403aad471900afe7bea7 [id=6e849c410d764f00bc28f530dfeb905c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.609416 919 raft_consensus.cc:2468] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:11.609658 888 tablet_service.cc:1511] Processing CreateTablet for tablet 7641dc1e96f6422f88b176c345986179 (DEFAULT_TABLE table=default.Table_cd25cf2ffebc4ffb8027a371385e324a [id=a743b119bfbe42f2868b810e336e273f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.610114 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3bc715118743eb860295bc6779cda3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.611335 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a444ebd84bb340b1b1c0d695d8157d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.612005 1994 tablet_replica.cc:333] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:11.612200 1994 raft_consensus.cc:2243] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.612334 1994 raft_consensus.cc:2272] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:11.606827 858 consensus_peers.cc:597] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8522f562665540ce99490ab90e02d801. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:11.613227 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:11.614248 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7641dc1e96f6422f88b176c345986179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.614976 1201 raft_consensus.cc:359] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.615187 1201 raft_consensus.cc:385] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:11.615252 1201 raft_consensus.cc:740] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:11.615444 1201 consensus_queue.cc:260] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.615970 1201 ts_tablet_manager.cc:1434] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.035s user 0.001s sys 0.000s
I20260619 19:54:11.616256 1201 tablet_bootstrap.cc:492] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:11.619549 1994 ts_tablet_manager.cc:1916] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:11.621811 858 leader_election.cc:343] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.622953 858 leader_election.cc:304] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.624426 2802 raft_consensus.cc:2749] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:11.626081 898 tablet_service.cc:1511] Processing CreateTablet for tablet c85407a4d392498290eae64df5f85edf (DEFAULT_TABLE table=default.Table_8882bd0a559b4556aef7a3175c2707fd [id=12cbca71e40549d8acee11ce9823ff5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.626619 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85407a4d392498290eae64df5f85edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.626345 858 leader_election.cc:304] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.627653 2802 raft_consensus.cc:3060] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.631028 2802 raft_consensus.cc:2749] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:11.635728 2026 ts_tablet_manager.cc:1929] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260619 19:54:11.636904 2026 log.cc:1199] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/4e2f73871161488dbad7a19fc9e20b9c
I20260619 19:54:11.637238 1994 ts_tablet_manager.cc:1929] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:11.637549 2026 ts_tablet_manager.cc:1950] T 4e2f73871161488dbad7a19fc9e20b9c P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:11.637995 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 137) took 10326 ms. Trace:
I20260619 19:54:11.638154 2026 rpcz_store.cc:276] 0619 19:54:01.311976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.312055 (+ 79us) service_pool.cc:224] Handling call
0619 19:54:11.392771 (+10080716us) ts_tablet_manager.cc:1151] Deleting tablet 4e2f73871161488dbad7a19fc9e20b9c
0619 19:54:11.392782 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.625785 (+233003us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.635650 (+ 9865us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.637957 (+ 2307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125597,"tablet-delete.queue_time_us":10066323}
I20260619 19:54:11.638767 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 4e2f73871161488dbad7a19fc9e20b9c (table default.Table_a146cb8bcd694f8482d04dcd9b0ac13c [id=f73253a802944e92a24b1e8bbe5a5231]) successfully deleted
I20260619 19:54:11.639308 2026 tablet_replica.cc:333] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:11.642057 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 71fa4434f83f42d4abacceeb2e816c26 (DEFAULT_TABLE table=default.Table_2a582108ce724404a89ca7858fa45231 [id=0babdd7742b04e1cbd4e5c7e9f2d81dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.643635 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 78e2c3b30d98438f853538b8ce1ee39a (DEFAULT_TABLE table=default.Table_d9821562c6cb4b1c9d89b85a55bb94c8 [id=a60d23e8cc134adbaad0c231c40c9c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.645713 1994 log.cc:1199] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:11.645861 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fa4434f83f42d4abacceeb2e816c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.646075 1994 ts_tablet_manager.cc:1950] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:11.646560 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 766b8781524a4dcda809632e439af264 (table default.Table_f3fbad77d4744a10aac60455a996adbf [id=ec263a20b67c46e0a9ecf9b4ceaf90aa], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 766b8781524a4dcda809632e439af264 consensus state has no leader
I20260619 19:54:11.647074 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 10f6e202e8fd4a7292774d5eb4c7266b (table default.Table_6d1f0f1124cb46138d7584cfd183ea34 [id=8eaf4a5b0ebb448bbb0fdd09953c2bd3]) successfully deleted
I20260619 19:54:11.647563 1994 tablet_replica.cc:333] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:11.647748 1994 raft_consensus.cc:2243] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:11.648058 1994 pending_rounds.cc:70] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:11.648111 1994 pending_rounds.cc:77] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657691059318784 op_type: NO_OP noop_request { }
I20260619 19:54:11.648201 1994 raft_consensus.cc:2889] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:11.648272 1994 raft_consensus.cc:2272] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:11.648332 719 leader_election.cc:343] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.648797 1994 ts_tablet_manager.cc:1916] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.649628 719 leader_election.cc:304] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.649853 2314 raft_consensus.cc:2804] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:11.649912 2314 raft_consensus.cc:493] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:11.649967 2314 raft_consensus.cc:3060] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.651362 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e2c3b30d98438f853538b8ce1ee39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.653041 2314 raft_consensus.cc:515] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.653681 2314 leader_election.cc:290] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:11.451078 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 347) took 4510 ms. Trace:
I20260619 19:54:11.654107 1973 rpcz_store.cc:276] 0619 19:54:06.940580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.940626 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:11.161363 (+4220737us) ts_tablet_manager.cc:1151] Deleting tablet 4b22024a0c434f8e8d4a370dbfb9a4e2
0619 19:54:11.161372 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.447153 (+285781us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.450126 (+ 2973us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.451058 (+ 932us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4181734}
I20260619 19:54:11.654825 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 361) took 4383 ms. Trace:
I20260619 19:54:11.654947 1994 ts_tablet_manager.cc:1929] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:11.654898 1973 rpcz_store.cc:276] 0619 19:54:07.271807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.271859 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:11.654428 (+4382569us) ts_tablet_manager.cc:1151] Deleting tablet 9a4c335fc5ca4885b5482c6b749f76f9
0619 19:54:11.654440 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.654805 (+ 365us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4379982}
I20260619 19:54:11.655053 1994 log.cc:1199] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/68788824224b426bb433b87763073bae
I20260619 19:54:11.655234 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 362) took 4382 ms. Trace:
I20260619 19:54:11.655305 1973 rpcz_store.cc:276] 0619 19:54:07.272462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.311160 (+ 38698us) service_pool.cc:224] Handling call
0619 19:54:11.655158 (+4343998us) ts_tablet_manager.cc:1151] Deleting tablet 1202fe45d0964d368989f969e95f880d
0619 19:54:11.655166 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.655220 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4343734}
I20260619 19:54:11.655550 1973 tablet_replica.cc:333] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:11.655754 1973 raft_consensus.cc:2243] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.655887 1973 raft_consensus.cc:2272] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.656392 1973 ts_tablet_manager.cc:1916] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:11.656550 720 leader_election.cc:343] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4b88dd7d19514e83857e2c6108291b9f
I20260619 19:54:11.659682 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a66ca1d30e274d2281b507485193b9b0" } new_table_name: "default.Table_5dc79a861e64497eb82be82378600794" modify_external_catalogs: true
I20260619 19:54:11.671366 2026 raft_consensus.cc:2243] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.671707 2026 raft_consensus.cc:2272] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.672338 2026 ts_tablet_manager.cc:1916] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.673231 1994 ts_tablet_manager.cc:1950] T 68788824224b426bb433b87763073bae P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:11.673345 858 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 950b8e74d12f46a68ba5eae3186c87a9
I20260619 19:54:11.673636 858 leader_election.cc:304] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.674044 2797 raft_consensus.cc:2749] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:11.674806 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 68788824224b426bb433b87763073bae (table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]) successfully deleted
I20260619 19:54:11.643463 898 tablet_service.cc:1511] Processing CreateTablet for tablet 71fa4434f83f42d4abacceeb2e816c26 (DEFAULT_TABLE table=default.Table_2a582108ce724404a89ca7858fa45231 [id=0babdd7742b04e1cbd4e5c7e9f2d81dd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:11.675695 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 087630689da0433ab876dcd3cd6bec0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 087630689da0433ab876dcd3cd6bec0f already in progress: creating tablet
I20260619 19:54:11.676062 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fa4434f83f42d4abacceeb2e816c26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:11.676826 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 268c752e60624f96b37b0afab2d994e3 because the tablet was not found. No further retry: Not found: Tablet not found: 268c752e60624f96b37b0afab2d994e3
I20260619 19:54:11.678479 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 95f7527ee18540cea3d835e8988e6c5f (DEFAULT_TABLE table=default.Table_a62ff56b27aa44c594c3e7438005ac8f [id=79e41ad9b08e4941b9235a03a7402e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.678521 891 tablet_service.cc:1511] Processing CreateTablet for tablet 78e2c3b30d98438f853538b8ce1ee39a (DEFAULT_TABLE table=default.Table_d9821562c6cb4b1c9d89b85a55bb94c8 [id=a60d23e8cc134adbaad0c231c40c9c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.678933 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f7527ee18540cea3d835e8988e6c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.678972 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e2c3b30d98438f853538b8ce1ee39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.662117 1201 tablet_bootstrap.cc:654] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:11.666299 2715 consensus_queue.cc:237] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.680302 719 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.680680 2314 raft_consensus.cc:2804] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:11.680770 2314 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:11.680860 2314 raft_consensus.cc:3060] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:11.544282 996 leader_election.cc:304] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:11.683183 996 raft_consensus.cc:2686] T 10f6e202e8fd4a7292774d5eb4c7266b P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:11.685175 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_af2f1c9e09b845669ba83b6327f8bea4" } modify_external_catalogs: true
I20260619 19:54:11.685423 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_af2f1c9e09b845669ba83b6327f8bea4" } modify_external_catalogs: true
I20260619 19:54:11.685392 1994 tablet_replica.cc:333] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:11.689473 1994 raft_consensus.cc:2243] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:11.689802 1994 raft_consensus.cc:2272] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.690526 1994 ts_tablet_manager.cc:1916] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:11.687041 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 142927us
I20260619 19:54:11.691807 2808 tablet.cc:1724] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:11.699746 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6cc0e4d20ac744bbb5c762479e4e1f47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:11.700476 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cc0e4d20ac744bbb5c762479e4e1f47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:11.702353 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4b57592fb6a44808bcc5312ccbae5c03" } modify_external_catalogs: true
I20260619 19:54:11.702617 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4b57592fb6a44808bcc5312ccbae5c03" } modify_external_catalogs: true
I20260619 19:54:11.707093 996 leader_election.cc:304] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.707719 2694 raft_consensus.cc:2804] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:11.707829 2694 raft_consensus.cc:697] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:11.708019 2694 consensus_queue.cc:237] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.717054 1029 tablet_service.cc:1511] Processing CreateTablet for tablet cf93b18ae6a44bdb876948d26c4ed087 (DEFAULT_TABLE table=default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.717594 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf93b18ae6a44bdb876948d26c4ed087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.723850 2769 tablet.cc:1724] T 098d5bd070b54889905539f1fa1a47e6 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:11.724887 2314 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:11.725594 2314 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:11.726271 2797 raft_consensus.cc:493] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:11.726796 1994 ts_tablet_manager.cc:1929] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:11.726889 1994 log.cc:1199] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:11.727620 1994 ts_tablet_manager.cc:1950] T fde2b5d12ab7465791f26d214c2dc2f5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:11.727667 720 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b57381b0a02141459dc582196d0c0095
I20260619 19:54:11.727681 2801 raft_consensus.cc:493] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:11.728889 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf]) successfully deleted
W20260619 19:54:11.729969 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0168c82ece6e4ce683265229a5d4c6ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0168c82ece6e4ce683265229a5d4c6ea already in progress: creating tablet
W20260619 19:54:11.730810 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01489233bc6f4f8a998fc8d2b8bf70a6 already in progress: creating tablet
W20260619 19:54:11.731531 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 71fa4434f83f42d4abacceeb2e816c26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71fa4434f83f42d4abacceeb2e816c26 already in progress: creating tablet
I20260619 19:54:11.731889 1994 tablet_replica.cc:333] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:11.732182 1994 raft_consensus.cc:2243] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.732395 1994 raft_consensus.cc:2272] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.733105 1994 ts_tablet_manager.cc:1916] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.727643 2797 raft_consensus.cc:515] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.736896 2797 leader_election.cc:290] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:11.737089 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e48a3e5c1642f6b12adb0033f74404" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:11.737272 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 420dc94a60d34deb9124fe83f5c46416 (DEFAULT_TABLE table=default.Table_574918c06b8d48589440d492d563c2e7 [id=74815300845f45dcb4ee74561f9ad65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.738644 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 39706a77fb3a40afbaa9b0436d4eaa28 (DEFAULT_TABLE table=default.Table_87f3089ec8fb4c7990ece82f72c17904 [id=655b7cf8202e4202b360ace2ae3e4d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.739398 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 90feb11ad7c447babcae31a6fc94d8de (DEFAULT_TABLE table=default.Table_108b76c017514b1aabe28f50b0351398 [id=f5b441c246034329952c26e9043c1552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.739507 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:11.739722 1053 raft_consensus.cc:2468] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:11.740662 2769 tablet.cc:1724] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:11.743337 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 47615.3us
I20260619 19:54:11.743989 719 leader_election.cc:304] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.744778 859 leader_election.cc:304] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.744851 2527 raft_consensus.cc:2804] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:11.744946 2527 raft_consensus.cc:493] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:11.745021 2527 raft_consensus.cc:3060] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.745127 2269 raft_consensus.cc:2804] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:11.745210 2269 raft_consensus.cc:493] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:11.745283 2269 raft_consensus.cc:3060] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.746591 885 tablet_service.cc:1511] Processing CreateTablet for tablet cf93b18ae6a44bdb876948d26c4ed087 (DEFAULT_TABLE table=default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.747342 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (table default.Table_d911a0e8835847cb9ccf9d5d192872fe [id=57b57ad63a674bf08da4cf6d7bcd1b4e]) successfully deleted
W20260619 19:54:11.747717 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9a4c335fc5ca4885b5482c6b749f76f9 because the tablet was not found. No further retry: Not found: Tablet not found: 9a4c335fc5ca4885b5482c6b749f76f9
W20260619 19:54:11.747958 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1202fe45d0964d368989f969e95f880d because the tablet was not found. No further retry: Not found: Tablet not found: 1202fe45d0964d368989f969e95f880d
I20260619 19:54:11.737618 2801 raft_consensus.cc:515] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:11.750419 2801 leader_election.cc:290] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:11.753379 2269 raft_consensus.cc:515] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.754503 2269 leader_election.cc:290] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:11.754791 896 tablet_service.cc:1511] Processing CreateTablet for tablet 95f7527ee18540cea3d835e8988e6c5f (DEFAULT_TABLE table=default.Table_a62ff56b27aa44c594c3e7438005ac8f [id=79e41ad9b08e4941b9235a03a7402e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.756469 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:11.756683 1058 raft_consensus.cc:3060] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.761361 1058 raft_consensus.cc:2468] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:11.765058 888 tablet_service.cc:1511] Processing CreateTablet for tablet 420dc94a60d34deb9124fe83f5c46416 (DEFAULT_TABLE table=default.Table_574918c06b8d48589440d492d563c2e7 [id=74815300845f45dcb4ee74561f9ad65f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:11.765949 859 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:11.767731 2527 raft_consensus.cc:515] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.768451 2527 leader_election.cc:290] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:11.769378 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf93b18ae6a44bdb876948d26c4ed087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.769565 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420dc94a60d34deb9124fe83f5c46416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.769774 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39706a77fb3a40afbaa9b0436d4eaa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.770153 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90feb11ad7c447babcae31a6fc94d8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.770292 859 leader_election.cc:304] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:11.771344 720 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:11.772001 884 tablet_service.cc:1511] Processing CreateTablet for tablet 90feb11ad7c447babcae31a6fc94d8de (DEFAULT_TABLE table=default.Table_108b76c017514b1aabe28f50b0351398 [id=f5b441c246034329952c26e9043c1552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.772992 892 tablet_service.cc:1511] Processing CreateTablet for tablet 39706a77fb3a40afbaa9b0436d4eaa28 (DEFAULT_TABLE table=default.Table_87f3089ec8fb4c7990ece82f72c17904 [id=655b7cf8202e4202b360ace2ae3e4d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.773499 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57381b0a02141459dc582196d0c0095" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:11.773694 919 raft_consensus.cc:3060] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:54:11.780182 996 leader_election.cc:343] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.781144 1035 tablet_service.cc:1511] Processing CreateTablet for tablet d88ba4ee21f84d869cd33c9f6896efdf (DEFAULT_TABLE table=default.Table_81f483b6dbf949ee904fdb2d85285759 [id=8c2069f7b4bc4cb1bc7d7b494da6a434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.781585 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88ba4ee21f84d869cd33c9f6896efdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.782583 1034 tablet_service.cc:1511] Processing CreateTablet for tablet d40a944dbc9d4164a0100811bbadc6b5 (DEFAULT_TABLE table=default.Table_841448a18d3d49318e834d44004ae04e [id=4033fdba72c749f69ab79c3f6f695af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.782718 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 0999af971ba94bb8b3d6fcb7f0800692 (DEFAULT_TABLE table=default.Table_babe01f83df8452898d81d45fe0855a8 [id=9ed88383855a471493f6d9a3918f17f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.782966 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40a944dbc9d4164a0100811bbadc6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.783229 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0999af971ba94bb8b3d6fcb7f0800692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.787873 1973 ts_tablet_manager.cc:1929] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:11.788182 1973 log.cc:1199] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/997cd0b5a8d24b56a2d5b95ab877d95f
I20260619 19:54:11.788524 1973 ts_tablet_manager.cc:1950] T 997cd0b5a8d24b56a2d5b95ab877d95f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:11.788955 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 363) took 4476 ms. Trace:
I20260619 19:54:11.789044 1973 rpcz_store.cc:276] 0619 19:54:07.312169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.312218 (+ 49us) service_pool.cc:224] Handling call
0619 19:54:11.655495 (+4343277us) ts_tablet_manager.cc:1151] Deleting tablet 997cd0b5a8d24b56a2d5b95ab877d95f
0619 19:54:11.655503 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.717870 (+ 62367us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.787772 (+ 69902us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.788932 (+ 1160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4343133}
I20260619 19:54:11.789417 1973 tablet_replica.cc:333] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:11.804656 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.804992 776 raft_consensus.cc:2393] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:11.805524 919 raft_consensus.cc:2468] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
I20260619 19:54:11.807113 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f7527ee18540cea3d835e8988e6c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.807329 1994 ts_tablet_manager.cc:1929] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:11.810978 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Bootstrap replayed 1/1 log segments. Stats: ops{read=383 overwritten=0 applied=379 ignored=0} inserts{seen=358 ignored=0} mutations{seen=424 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260619 19:54:11.817660 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90feb11ad7c447babcae31a6fc94d8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.818810 2269 raft_consensus.cc:2804] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:11.820181 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b88dd7d19514e83857e2c6108291b9f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:11.821420 1973 raft_consensus.cc:2243] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.821919 1973 raft_consensus.cc:2272] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.822726 1973 ts_tablet_manager.cc:1916] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.823066 2783 tablet.cc:1724] T 098d5bd070b54889905539f1fa1a47e6 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:11.824371 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39706a77fb3a40afbaa9b0436d4eaa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.827510 897 tablet_service.cc:1511] Processing CreateTablet for tablet cbaea1da54fc4c4d803b9beffa7023e1 (DEFAULT_TABLE table=default.Table_f7e6fcdbf0ac4e9e85a7672234a28ac7 [id=fdd7ff78be9a4c1cbadfc5d5a98482af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.828570 899 tablet_service.cc:1511] Processing CreateTablet for tablet d88ba4ee21f84d869cd33c9f6896efdf (DEFAULT_TABLE table=default.Table_81f483b6dbf949ee904fdb2d85285759 [id=8c2069f7b4bc4cb1bc7d7b494da6a434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.829684 900 tablet_service.cc:1511] Processing CreateTablet for tablet d40a944dbc9d4164a0100811bbadc6b5 (DEFAULT_TABLE table=default.Table_841448a18d3d49318e834d44004ae04e [id=4033fdba72c749f69ab79c3f6f695af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.831884 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.832295 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420dc94a60d34deb9124fe83f5c46416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.832933 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88ba4ee21f84d869cd33c9f6896efdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.833806 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40a944dbc9d4164a0100811bbadc6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.834484 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Bootstrap complete.
I20260619 19:54:11.834560 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaea1da54fc4c4d803b9beffa7023e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.835640 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:11.836146 2269 raft_consensus.cc:697] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:11.837163 2269 consensus_queue.cc:237] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.838553 921 raft_consensus.cc:3060] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.843688 2770 tablet.cc:1724] T 55684b109a03488a88efd45a067159a0 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:11.843760 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c10ee4d02fa48fdb10e3e5110f85cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:11.844695 2816 tablet.cc:1724] T 098d5bd070b54889905539f1fa1a47e6 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:11.845453 2808 tablet.cc:1724] T 53ff57208565495480920b6eaaff9295 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260619 19:54:11.852034 762 tablet_service.cc:1511] Processing CreateTablet for tablet 71fa4434f83f42d4abacceeb2e816c26 (DEFAULT_TABLE table=default.Table_2a582108ce724404a89ca7858fa45231 [id=0babdd7742b04e1cbd4e5c7e9f2d81dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.852694 755 tablet_service.cc:1511] Processing CreateTablet for tablet 78e2c3b30d98438f853538b8ce1ee39a (DEFAULT_TABLE table=default.Table_d9821562c6cb4b1c9d89b85a55bb94c8 [id=a60d23e8cc134adbaad0c231c40c9c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.853026 746 tablet_service.cc:1511] Processing CreateTablet for tablet 95f7527ee18540cea3d835e8988e6c5f (DEFAULT_TABLE table=default.Table_a62ff56b27aa44c594c3e7438005ac8f [id=79e41ad9b08e4941b9235a03a7402e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.853361 750 tablet_service.cc:1511] Processing CreateTablet for tablet cf93b18ae6a44bdb876948d26c4ed087 (DEFAULT_TABLE table=default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.853644 751 tablet_service.cc:1511] Processing CreateTablet for tablet 420dc94a60d34deb9124fe83f5c46416 (DEFAULT_TABLE table=default.Table_574918c06b8d48589440d492d563c2e7 [id=74815300845f45dcb4ee74561f9ad65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.853906 765 tablet_service.cc:1511] Processing CreateTablet for tablet 39706a77fb3a40afbaa9b0436d4eaa28 (DEFAULT_TABLE table=default.Table_87f3089ec8fb4c7990ece82f72c17904 [id=655b7cf8202e4202b360ace2ae3e4d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.860634 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fa4434f83f42d4abacceeb2e816c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.860829 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f7527ee18540cea3d835e8988e6c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.865043 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf93b18ae6a44bdb876948d26c4ed087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.868969 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420dc94a60d34deb9124fe83f5c46416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.871762 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39706a77fb3a40afbaa9b0436d4eaa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.875366 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e2c3b30d98438f853538b8ce1ee39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.879017 754 tablet_service.cc:1511] Processing CreateTablet for tablet 90feb11ad7c447babcae31a6fc94d8de (DEFAULT_TABLE table=default.Table_108b76c017514b1aabe28f50b0351398 [id=f5b441c246034329952c26e9043c1552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.879598 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90feb11ad7c447babcae31a6fc94d8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.885026 1994 log.cc:1199] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/71d212a279754f2497ad4fc2a3c8b5c3
I20260619 19:54:11.885495 1994 ts_tablet_manager.cc:1950] T 71d212a279754f2497ad4fc2a3c8b5c3 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:11.886983 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 71d212a279754f2497ad4fc2a3c8b5c3 (table default.Table_0761528dd12f4e449282247241577e72 [id=f58a91c6f29e4958b3de00addcb87fec]) successfully deleted
I20260619 19:54:11.888567 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2d05f5175346f9b21958b139ae80f1 (DEFAULT_TABLE table=default.Table_ad28ce3b193d467594d095dd90fbe05a [id=d46ce4769c424c43b2c4b0675947153a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.888778 754 tablet_service.cc:1511] Processing CreateTablet for tablet cbaea1da54fc4c4d803b9beffa7023e1 (DEFAULT_TABLE table=default.Table_f7e6fcdbf0ac4e9e85a7672234a28ac7 [id=fdd7ff78be9a4c1cbadfc5d5a98482af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.889008 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2d05f5175346f9b21958b139ae80f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.889128 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaea1da54fc4c4d803b9beffa7023e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.812666 1029 tablet_service.cc:1511] Processing CreateTablet for tablet cbaea1da54fc4c4d803b9beffa7023e1 (DEFAULT_TABLE table=default.Table_f7e6fcdbf0ac4e9e85a7672234a28ac7 [id=fdd7ff78be9a4c1cbadfc5d5a98482af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.895354 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaea1da54fc4c4d803b9beffa7023e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.897318 2026 ts_tablet_manager.cc:1929] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:11.897523 2026 log.cc:1199] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9be5cda43d0b4719a82f33a03e2261d3
I20260619 19:54:11.897526 762 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2d05f5175346f9b21958b139ae80f1 (DEFAULT_TABLE table=default.Table_ad28ce3b193d467594d095dd90fbe05a [id=d46ce4769c424c43b2c4b0675947153a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.897895 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2d05f5175346f9b21958b139ae80f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.898090 2026 ts_tablet_manager.cc:1950] T 9be5cda43d0b4719a82f33a03e2261d3 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:11.898439 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 140) took 10585 ms. Trace:
I20260619 19:54:11.815315 1200 raft_consensus.cc:740] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:11.898605 2744 raft_consensus.cc:493] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:11.898584 2026 rpcz_store.cc:276] 0619 19:54:01.313253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.313295 (+ 42us) service_pool.cc:224] Handling call
0619 19:54:11.639241 (+10325946us) ts_tablet_manager.cc:1151] Deleting tablet 9be5cda43d0b4719a82f33a03e2261d3
0619 19:54:11.639251 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.727363 (+ 88112us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.897245 (+169882us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:11.898405 (+ 1160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10312097}
I20260619 19:54:11.898728 2744 raft_consensus.cc:515] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.898947 2026 tablet_replica.cc:333] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:11.898958 1200 consensus_queue.cc:260] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.899178 2026 raft_consensus.cc:2243] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:11.899341 2744 leader_election.cc:290] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:11.899356 2026 raft_consensus.cc:2272] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:11.899566 1200 ts_tablet_manager.cc:1434] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.591s user 0.027s sys 0.000s
W20260619 19:54:11.899680 1200 ts_tablet_manager.cc:1467] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Tablet startup took 591ms
I20260619 19:54:11.899921 2026 ts_tablet_manager.cc:1916] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:11.901877 765 tablet_service.cc:1511] Processing CreateTablet for tablet d40a944dbc9d4164a0100811bbadc6b5 (DEFAULT_TABLE table=default.Table_841448a18d3d49318e834d44004ae04e [id=4033fdba72c749f69ab79c3f6f695af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.902261 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40a944dbc9d4164a0100811bbadc6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.903731 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9be5cda43d0b4719a82f33a03e2261d3 (table default.Table_f17eeb5cd144427d8bf4066856809dfe [id=596e254ea57a41eeae97ee0e8ff2adc9]) successfully deleted
I20260619 19:54:11.907452 746 tablet_service.cc:1511] Processing CreateTablet for tablet 0999af971ba94bb8b3d6fcb7f0800692 (DEFAULT_TABLE table=default.Table_babe01f83df8452898d81d45fe0855a8 [id=9ed88383855a471493f6d9a3918f17f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:11.899765 1200 ts_tablet_manager.cc:1469] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Trace:
0619 19:53:59.051844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.051958 (+ 114us) service_pool.cc:224] Handling call
0619 19:53:59.055235 (+ 3277us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:53:59.055277 (+ 42us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:53:59.230053 (+174776us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:59.272310 (+ 42257us) tablet_replica.cc:206] Creating consensus instance
0619 19:53:59.288585 (+ 16275us) inbound_call.cc:177] Queueing success response
0619 19:54:11.006623 (+11718038us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0619 19:54:11.308395 (+301772us) ts_tablet_manager.cc:1435] Starting tablet replica
0619 19:54:11.308558 (+ 163us) tablet_replica.cc:261] Starting instrumentation
0619 19:54:11.308702 (+ 144us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":65,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"tablet-open.queue_time_us":11718013}
I20260619 19:54:11.910188 1200 tablet_bootstrap.cc:492] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:11.904330 858 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:11.911440 858 leader_election.cc:304] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.911969 2797 raft_consensus.cc:2749] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:11.907498 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6ec149e1ac475f8038b328dae4af2a" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:11.912506 915 raft_consensus.cc:3060] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:11.914098 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6f2a8462edb54df2aa0343ecea6dd761 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2a8462edb54df2aa0343ecea6dd761 already in progress: creating tablet
W20260619 19:54:11.914420 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8c10ee4d02fa48fdb10e3e5110f85cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c10ee4d02fa48fdb10e3e5110f85cad already in progress: creating tablet
I20260619 19:54:11.909948 899 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2d05f5175346f9b21958b139ae80f1 (DEFAULT_TABLE table=default.Table_ad28ce3b193d467594d095dd90fbe05a [id=d46ce4769c424c43b2c4b0675947153a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.920308 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2d05f5175346f9b21958b139ae80f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.921921 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0999af971ba94bb8b3d6fcb7f0800692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.923492 1208 raft_consensus.cc:740] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:11.924925 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 997cd0b5a8d24b56a2d5b95ab877d95f (table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]) successfully deleted
W20260619 19:54:11.925007 858 leader_election.cc:343] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:11.925151 858 leader_election.cc:304] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.925484 2801 raft_consensus.cc:2749] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:11.925674 858 leader_election.cc:304] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.926059 2801 raft_consensus.cc:3060] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.910554 1201 tablet_bootstrap.cc:492] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:11.927292 1201 ts_tablet_manager.cc:1403] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.311s user 0.010s sys 0.016s
I20260619 19:54:11.927233 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:11.927428 919 raft_consensus.cc:2468] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:11.928038 1201 raft_consensus.cc:359] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.928193 1201 raft_consensus.cc:385] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:11.928258 1201 raft_consensus.cc:740] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:11.928447 1201 consensus_queue.cc:260] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.929234 1200 tablet_bootstrap.cc:654] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:11.929447 1201 ts_tablet_manager.cc:1434] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:11.929752 1201 tablet_bootstrap.cc:492] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:11.930217 2801 raft_consensus.cc:2749] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:11.931288 996 leader_election.cc:304] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:11.932569 915 raft_consensus.cc:2468] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:54:11.933025 859 consensus_peers.cc:597] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8e3354ae6dd46bd9c5414d4c4a720a1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:11.934404 921 raft_consensus.cc:2468] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:11.934674 2744 raft_consensus.cc:2804] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:11.934751 2744 raft_consensus.cc:493] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:11.934808 2744 raft_consensus.cc:3060] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:11.935627 1200 tablet_bootstrap.cc:492] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
W20260619 19:54:11.937536 858 leader_election.cc:343] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:11.937937 858 leader_election.cc:343] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:11.938033 858 leader_election.cc:304] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.938310 2801 raft_consensus.cc:2749] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:11.935863 892 tablet_service.cc:1511] Processing CreateTablet for tablet 0999af971ba94bb8b3d6fcb7f0800692 (DEFAULT_TABLE table=default.Table_babe01f83df8452898d81d45fe0855a8 [id=9ed88383855a471493f6d9a3918f17f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:11.949872 858 leader_election.cc:343] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:11.950506 2715 consensus_queue.cc:1048] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:11.950654 858 consensus_peers.cc:597] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b22024a0c434f8e8d4a370dbfb9a4e2. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:11.960846 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e3f4b47d0e7451d91add5a81330bc7d consensus state has no leader
W20260619 19:54:11.962423 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 consensus state has no leader
I20260619 19:54:11.931553 2819 tablet.cc:1724] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:11.924115 1208 consensus_queue.cc:260] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:11.936566 754 tablet_service.cc:1511] Processing CreateTablet for tablet d88ba4ee21f84d869cd33c9f6896efdf (DEFAULT_TABLE table=default.Table_81f483b6dbf949ee904fdb2d85285759 [id=8c2069f7b4bc4cb1bc7d7b494da6a434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:11.939599 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:11.963310 783 raft_consensus.cc:2468] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:11.963491 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88ba4ee21f84d869cd33c9f6896efdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:11.968350 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ca02c454eec840eb9289950b6da7b131
I20260619 19:54:11.952845 719 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:11.975415 888 tablet_service.cc:1558] Processing DeleteTablet for tablet ca02c454eec840eb9289950b6da7b131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:11.998703 1208 ts_tablet_manager.cc:1434] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.830s user 0.024s sys 0.000s
W20260619 19:54:11.998934 1208 ts_tablet_manager.cc:1467] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Tablet startup took 830ms
W20260619 19:54:11.999049 1208 ts_tablet_manager.cc:1469] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Trace:
0619 19:53:59.064178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:53:59.064269 (+ 91us) service_pool.cc:224] Handling call
0619 19:53:59.068875 (+ 4606us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:53:59.068903 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:53:59.141864 (+ 72961us) tablet_metadata.cc:665] Metadata flushed
0619 19:53:59.146293 (+ 4429us) tablet_replica.cc:206] Creating consensus instance
0619 19:53:59.151761 (+ 5468us) inbound_call.cc:177] Queueing success response
0619 19:54:11.023560 (+11871799us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0619 19:54:11.168267 (+144707us) ts_tablet_manager.cc:1435] Starting tablet replica
0619 19:54:11.168497 (+ 230us) tablet_replica.cc:261] Starting instrumentation
0619 19:54:11.219221 (+ 50724us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":35385,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":51,"tablet-open.queue_time_us":11871845}
I20260619 19:54:12.001755 2314 consensus_queue.cc:1048] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.003252 2269 raft_consensus.cc:493] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:12.003446 2269 raft_consensus.cc:515] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.003922 1208 tablet_bootstrap.cc:492] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.004124 2269 leader_election.cc:290] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:12.004987 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1ded605c2edc4c2fb138d07dea4a14b4
I20260619 19:54:12.005474 532 catalog_manager.cc:6784] ReplaceTablet: tablet 1ded605c2edc4c2fb138d07dea4a14b4 deleted and replaced by tablet 2fb1c6e2c00848539217ffb4c3f57231
W20260619 19:54:12.005900 859 leader_election.cc:343] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 991c877feeae43c580d9471c25c4424c
W20260619 19:54:12.008356 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e7b94596b0246628b963524983bb226 consensus state has no leader
I20260619 19:54:12.016093 2783 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:12.016801 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_67dfa6733a6d46649a28c9b2eb7249b5" } modify_external_catalogs: true
I20260619 19:54:12.017105 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_67dfa6733a6d46649a28c9b2eb7249b5" } modify_external_catalogs: true
I20260619 19:54:12.018929 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_eb8e60da5ccb4beaac79c304b660a4ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.019423 2314 raft_consensus.cc:2804] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:12.019559 2314 raft_consensus.cc:697] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
W20260619 19:54:12.019589 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb8e60da5ccb4beaac79c304b660a4ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.019836 2314 consensus_queue.cc:237] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.020313 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_32b31412506340c7ac33a174eda95f6b" } new_table_name: "default.Table_54d709f23afb40979d6661097264021d" modify_external_catalogs: true
I20260619 19:54:12.021042 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ecc39f19974445339140abe391370170"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.021221 2026 ts_tablet_manager.cc:1929] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.021353 2026 log.cc:1199] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d97025f1e0634720bc68d0a6196bd20b
W20260619 19:54:12.021584 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecc39f19974445339140abe391370170 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.021710 2026 ts_tablet_manager.cc:1950] T d97025f1e0634720bc68d0a6196bd20b P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.022022 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 141) took 10708 ms. Trace:
I20260619 19:54:12.022101 2026 rpcz_store.cc:276] 0619 19:54:01.313568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.313635 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:11.898876 (+10585241us) ts_tablet_manager.cc:1151] Deleting tablet d97025f1e0634720bc68d0a6196bd20b
0619 19:54:11.898884 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.931396 (+ 32512us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.021108 (+ 89712us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.022004 (+ 896us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10571806}
I20260619 19:54:12.022418 2026 tablet_replica.cc:333] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.027846 2026 raft_consensus.cc:2243] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.028942 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]). Expected version 2 got 0
I20260619 19:54:12.028818 2026 raft_consensus.cc:2272] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.029907 531 catalog_manager.cc:5696] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:12.030506 2539 raft_consensus.cc:493] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.030620 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:12.030639 2539 raft_consensus.cc:515] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.030864 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:12.031157 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 55684b109a03488a88efd45a067159a0 (table default.Table_de336ee9cc7e4ed98d1983f3a46ced3c [id=043c20ae78a943e0bbf1c9a6753261b1]). Expected version 2 got 1
I20260619 19:54:12.031461 2539 leader_election.cc:290] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:12.031949 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
W20260619 19:54:12.032442 859 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 46dcf2293e2d461ca1be171069867d1f
I20260619 19:54:12.032356 531 catalog_manager.cc:5696] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:12.032677 2819 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:12.033846 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 81053.7us
I20260619 19:54:12.034222 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d97025f1e0634720bc68d0a6196bd20b (table default.Table_31acb6e850e140b09225f0905b1a5d8c [id=d6c6c699115c4d7c8edbc8a1131ab5c9]) successfully deleted
I20260619 19:54:12.034724 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ded605c2edc4c2fb138d07dea4a14b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fb1c6e2c00848539217ffb4c3f57231) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.034996 719 leader_election.cc:304] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.038717 2026 ts_tablet_manager.cc:1916] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.022030 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0999af971ba94bb8b3d6fcb7f0800692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:12.041841 1201 tablet_bootstrap.cc:654] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.044337 2527 raft_consensus.cc:2804] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:12.044504 2527 raft_consensus.cc:697] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:12.044767 2527 consensus_queue.cc:237] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.051003 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d400ef98ca5d4aad95051cf2edab9f26
I20260619 19:54:12.053489 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2980de0b77f148a6ad1e15416b842ea0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.054167 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2980de0b77f148a6ad1e15416b842ea0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.054828 719 leader_election.cc:304] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.055809 2757 raft_consensus.cc:2804] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:12.055943 2757 raft_consensus.cc:697] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:12.056201 2757 consensus_queue.cc:237] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.056627 523 master_service.cc:960] ReplaceTablet: received request to replace tablet d703c5c2820642aab6dd1e500ce1e9fd from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:12.063490 899 tablet_service.cc:1558] Processing DeleteTablet for tablet d400ef98ca5d4aad95051cf2edab9f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.064579 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b8f22a48856a436a9a5abcd9cae20620
I20260619 19:54:12.066275 2026 ts_tablet_manager.cc:1929] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.067629 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_638366ccda344409a3c5e2b40dc5255b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.068291 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_638366ccda344409a3c5e2b40dc5255b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.069751 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_bd6b2d9609f54f4d9347e0b9ffd3ee7f" } modify_external_catalogs: true
I20260619 19:54:12.069916 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_bd6b2d9609f54f4d9347e0b9ffd3ee7f" } modify_external_catalogs: true
W20260619 19:54:12.070026 719 consensus_peers.cc:597] T 7dc1a472e7aa49639212a41619eabff3 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:12.075706 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet dfb556a60a9749a2889ad84db2294f8e
I20260619 19:54:12.076505 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9f2e34ba96cf4823862a1d07b19ee94d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.077135 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f2e34ba96cf4823862a1d07b19ee94d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.072316 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f22a48856a436a9a5abcd9cae20620 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.077232 1201 tablet_bootstrap.cc:492] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.081564 1201 ts_tablet_manager.cc:1403] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.152s user 0.010s sys 0.006s
I20260619 19:54:12.082475 1201 raft_consensus.cc:359] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.082840 1201 raft_consensus.cc:385] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.082957 1201 raft_consensus.cc:740] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.083353 899 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb556a60a9749a2889ad84db2294f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.083319 1201 consensus_queue.cc:260] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.083870 1201 ts_tablet_manager.cc:1434] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:12.084263 1201 tablet_bootstrap.cc:492] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.086238 1201 tablet_bootstrap.cc:654] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.087265 2539 raft_consensus.cc:493] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.087397 2539 raft_consensus.cc:515] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.088070 2539 leader_election.cc:290] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.086383 2026 log.cc:1199] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/1a686826694b49b9bb5bcdefd61c9a15
I20260619 19:54:12.089453 2026 ts_tablet_manager.cc:1950] T 1a686826694b49b9bb5bcdefd61c9a15 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:12.090211 859 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:54:11.970065 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ca02c454eec840eb9289950b6da7b131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:11.973927 2744 raft_consensus.cc:515] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.006332 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ded605c2edc4c2fb138d07dea4a14b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fb1c6e2c00848539217ffb4c3f57231) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.104235 2744 leader_election.cc:290] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.104362 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 142) took 10790 ms. Trace:
I20260619 19:54:12.015007 2814 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:12.033134 2747 consensus_queue.cc:1048] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.052753 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet d400ef98ca5d4aad95051cf2edab9f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.105178 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:12.066434 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f22a48856a436a9a5abcd9cae20620 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.078727 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb556a60a9749a2889ad84db2294f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.105369 915 raft_consensus.cc:3060] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.105278 2026 rpcz_store.cc:276] 0619 19:54:01.314245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.314307 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:12.022367 (+10708060us) ts_tablet_manager.cc:1151] Deleting tablet 1a686826694b49b9bb5bcdefd61c9a15
0619 19:54:12.022376 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.062673 (+ 40297us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.066210 (+ 3537us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.104334 (+ 38124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4965,"tablet-delete.queue_time_us":10695246}
I20260619 19:54:12.105837 2026 tablet_replica.cc:333] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.106093 2026 raft_consensus.cc:2243] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.106370 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 1a686826694b49b9bb5bcdefd61c9a15 (table default.Table_8103445a5e2e424a92b928a93c4b24df [id=44ccb87e4ef94a32a8a743c5fc99399a]) successfully deleted
I20260619 19:54:12.106664 2026 raft_consensus.cc:2272] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.105224 1201 tablet_bootstrap.cc:492] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.107589 1201 ts_tablet_manager.cc:1403] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
W20260619 19:54:12.108064 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ca02c454eec840eb9289950b6da7b131 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca02c454eec840eb9289950b6da7b131 already in progress: creating tablet
I20260619 19:54:12.108255 915 raft_consensus.cc:2468] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:12.108647 1201 raft_consensus.cc:359] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.108798 1201 raft_consensus.cc:385] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.108844 1201 raft_consensus.cc:740] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:54:12.108986 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1ded605c2edc4c2fb138d07dea4a14b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ded605c2edc4c2fb138d07dea4a14b4 already in progress: creating tablet
I20260619 19:54:12.109031 1201 consensus_queue.cc:260] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.109577 2026 ts_tablet_manager.cc:1916] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.109647 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d400ef98ca5d4aad95051cf2edab9f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d400ef98ca5d4aad95051cf2edab9f26 already in progress: creating tablet
I20260619 19:54:12.109699 996 leader_election.cc:304] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:12.109958 2747 raft_consensus.cc:2804] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:12.110075 2747 raft_consensus.cc:697] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
W20260619 19:54:12.110309 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b8f22a48856a436a9a5abcd9cae20620 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8f22a48856a436a9a5abcd9cae20620 already in progress: creating tablet
I20260619 19:54:12.110311 2747 consensus_queue.cc:237] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.110654 1200 ts_tablet_manager.cc:1403] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.201s user 0.004s sys 0.000s
I20260619 19:54:12.111505 1200 raft_consensus.cc:359] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.111685 1201 ts_tablet_manager.cc:1434] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 19:54:12.111749 1200 raft_consensus.cc:385] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.111902 1200 raft_consensus.cc:740] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.112016 1201 tablet_bootstrap.cc:492] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.112205 1200 consensus_queue.cc:260] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.112900 1200 ts_tablet_manager.cc:1434] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:12.113240 1200 tablet_bootstrap.cc:492] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:12.115628 1200 tablet_bootstrap.cc:654] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.120584 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_46bc484129474a3e99f1add149b09e6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.121423 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46bc484129474a3e99f1add149b09e6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:12.123067 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74813bf79789451f90bcf7779aff9290 consensus state has no leader
I20260619 19:54:12.123086 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:12.123242 1201 tablet_bootstrap.cc:654] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.123356 776 raft_consensus.cc:3060] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.123474 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 74f39941c13847d79e2b2c3ddd176533 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:12.124704 2539 raft_consensus.cc:493] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.124851 2539 raft_consensus.cc:515] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.125597 2539 leader_election.cc:290] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.126631 776 raft_consensus.cc:2468] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:12.127314 859 leader_election.cc:343] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 8bc11c632b514118856ea4c11b431142
W20260619 19:54:12.128206 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet dfb556a60a9749a2889ad84db2294f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb556a60a9749a2889ad84db2294f8e already in progress: creating tablet
I20260619 19:54:12.129577 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9ef0500c485d406db28f8f004310209d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.130455 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ef0500c485d406db28f8f004310209d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.136665 2539 consensus_queue.cc:1048] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.074281 2434 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 2 FOLLOWER]: Replica starting. Triggering 4 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
W20260619 19:54:12.139175 858 leader_election.cc:343] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 991c877feeae43c580d9471c25c4424c
I20260619 19:54:12.139317 858 leader_election.cc:304] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.139765 2539 raft_consensus.cc:2749] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:12.140290 2026 ts_tablet_manager.cc:1929] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.140667 2026 log.cc:1199] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/82d2dd6eedd24f44a6a17aceb20e62bb
I20260619 19:54:12.141363 2026 ts_tablet_manager.cc:1950] T 82d2dd6eedd24f44a6a17aceb20e62bb P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.143275 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 143) took 10828 ms. Trace:
I20260619 19:54:12.143512 2026 rpcz_store.cc:276] 0619 19:54:01.314602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.314658 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:12.105788 (+10791130us) ts_tablet_manager.cc:1151] Deleting tablet 82d2dd6eedd24f44a6a17aceb20e62bb
0619 19:54:12.105797 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.117465 (+ 11668us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.136353 (+ 18888us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.143254 (+ 6901us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10778592}
W20260619 19:54:12.144313 858 leader_election.cc:343] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 46dcf2293e2d461ca1be171069867d1f
I20260619 19:54:12.144436 858 leader_election.cc:304] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.144425 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 82d2dd6eedd24f44a6a17aceb20e62bb (table default.Table_a6f5f2c7ff8b41ce8091dbce60483e0f [id=a35219ac89654132bd60088b911b7859]) successfully deleted
I20260619 19:54:12.144927 2539 raft_consensus.cc:2749] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.145151 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 144) took 10830 ms. Trace:
I20260619 19:54:12.148074 2026 rpcz_store.cc:276] 0619 19:54:01.314951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.315028 (+ 77us) service_pool.cc:224] Handling call
0619 19:54:12.145033 (+10830005us) ts_tablet_manager.cc:1151] Deleting tablet e151dc97ad13456ba35708d50c9d7b26
0619 19:54:12.145045 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.145132 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10817777}
I20260619 19:54:12.148749 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9d44344339f34866bab486a5abf104e9
W20260619 19:54:12.148965 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e151dc97ad13456ba35708d50c9d7b26 because the tablet was not found. No further retry: Not found: Tablet not found: e151dc97ad13456ba35708d50c9d7b26
I20260619 19:54:12.149355 2026 tablet_replica.cc:333] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.149560 2026 raft_consensus.cc:2243] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.149737 2026 raft_consensus.cc:2272] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.149655 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8efe29b385694713822116a243538ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.150297 2026 ts_tablet_manager.cc:1916] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.150318 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8efe29b385694713822116a243538ddf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.153077 2314 consensus_queue.cc:1048] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.154970 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d44344339f34866bab486a5abf104e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.159845 525 catalog_manager.cc:5696] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:12.160409 525 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:12.161012 525 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:12.161283 525 catalog_manager.cc:5696] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:12.163110 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f7830d1bf3d24690974e40ce41686a3a" } new_table_name: "default.Table_44e25fbf88e94d2bb49aac58c471ec46" modify_external_catalogs: true
I20260619 19:54:12.165306 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5dc79a861e64497eb82be82378600794" } new_table_name: "default.Table_4d2e5dfabbe24fa99291eec7549a23a8" modify_external_catalogs: true
I20260619 19:54:12.168170 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6163515494404bd0aeba25314d70b905" } new_table_name: "default.Table_3260b2ff38f7407c9e97eef73d777be8" modify_external_catalogs: true
I20260619 19:54:12.175444 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4ff5cbcad6d34fa7a697088b1b61ffda" } modify_external_catalogs: true
I20260619 19:54:12.176725 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ca02c454eec840eb9289950b6da7b131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.184444 1208 tablet_bootstrap.cc:654] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.192289 1973 ts_tablet_manager.cc:1929] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.192569 1973 log.cc:1199] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/28e463032d0744cc88d011accbebfe1f
I20260619 19:54:12.193102 1973 ts_tablet_manager.cc:1950] T 28e463032d0744cc88d011accbebfe1f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:12.193581 2026 ts_tablet_manager.cc:1929] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.194119 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 364) took 4797 ms. Trace:
I20260619 19:54:12.194301 1973 rpcz_store.cc:276] 0619 19:54:07.396710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.396754 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:11.789363 (+4392609us) ts_tablet_manager.cc:1151] Deleting tablet 28e463032d0744cc88d011accbebfe1f
0619 19:54:11.789373 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:11.930195 (+140822us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.192210 (+262015us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.194092 (+ 1882us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4392350}
I20260619 19:54:12.194927 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 381) took 4518 ms. Trace:
I20260619 19:54:12.195165 2026 log.cc:1199] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/5bae5be1340f4158a0b243415e232ae5
I20260619 19:54:12.195109 1973 rpcz_store.cc:276] 0619 19:54:07.676379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.676439 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:12.194776 (+4518337us) ts_tablet_manager.cc:1151] Deleting tablet 10c73b679e394f31b9e5d51681e06976
0619 19:54:12.194789 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.194912 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4518098}
I20260619 19:54:12.196337 2026 ts_tablet_manager.cc:1950] T 5bae5be1340f4158a0b243415e232ae5 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.198326 2539 consensus_queue.cc:1048] T 3064bd01ced9429d82ce449e8afc4999 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.198583 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 145) took 10883 ms. Trace:
I20260619 19:54:12.199640 2026 rpcz_store.cc:276] 0619 19:54:01.315337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.315394 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:12.149295 (+10833901us) ts_tablet_manager.cc:1151] Deleting tablet 5bae5be1340f4158a0b243415e232ae5
0619 19:54:12.149308 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.175253 (+ 25945us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.193495 (+ 18242us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.198558 (+ 5063us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10821984}
I20260619 19:54:12.200695 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 5bae5be1340f4158a0b243415e232ae5 (table default.Table_de336ee9cc7e4ed98d1983f3a46ced3c [id=043c20ae78a943e0bbf1c9a6753261b1]) successfully deleted
I20260619 19:54:12.200811 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4ff5cbcad6d34fa7a697088b1b61ffda" } modify_external_catalogs: true
I20260619 19:54:12.152751 2694 consensus_queue.cc:1048] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.203727 2026 tablet_replica.cc:333] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.206888 2026 raft_consensus.cc:2243] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.207177 2026 raft_consensus.cc:2272] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.181869 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d44344339f34866bab486a5abf104e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.209285 2026 ts_tablet_manager.cc:1916] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.210109 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9d44344339f34866bab486a5abf104e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d44344339f34866bab486a5abf104e9 already in progress: creating tablet
I20260619 19:54:12.213217 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ded605c2edc4c2fb138d07dea4a14b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fb1c6e2c00848539217ffb4c3f57231) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.214072 762 tablet_service.cc:1558] Processing DeleteTablet for tablet d400ef98ca5d4aad95051cf2edab9f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.214815 762 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f22a48856a436a9a5abcd9cae20620 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:11 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.224393 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 383) took 3935 ms. Trace:
I20260619 19:54:12.224531 1973 rpcz_store.cc:276] 0619 19:54:08.288963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.289017 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:12.218133 (+3929116us) ts_tablet_manager.cc:1151] Deleting tablet 74d8cd01251f4cfa93ecddb391c1c91e
0619 19:54:12.224235 (+ 6102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.224362 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3928934}
I20260619 19:54:12.225780 1208 tablet_bootstrap.cc:492] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:12.234691 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 28e463032d0744cc88d011accbebfe1f (table default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]) successfully deleted
W20260619 19:54:12.235010 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 10c73b679e394f31b9e5d51681e06976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c73b679e394f31b9e5d51681e06976 already in progress: creating tablet
W20260619 19:54:12.235245 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 74d8cd01251f4cfa93ecddb391c1c91e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74d8cd01251f4cfa93ecddb391c1c91e already in progress: creating tablet
I20260619 19:54:12.231226 762 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb556a60a9749a2889ad84db2294f8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.234398 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a589ce3ae94cd1bb28b15e4e0e4a22" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.234654 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc11c632b514118856ea4c11b431142" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.239506 783 raft_consensus.cc:2393] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:12.239660 785 raft_consensus.cc:2393] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:12.240113 1208 ts_tablet_manager.cc:1403] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.236s user 0.010s sys 0.004s
I20260619 19:54:12.235368 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d44344339f34866bab486a5abf104e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.235491 2314 consensus_queue.cc:1048] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.255471 1208 raft_consensus.cc:359] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.255674 2026 ts_tablet_manager.cc:1929] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:12.255731 1208 raft_consensus.cc:385] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.255905 1208 raft_consensus.cc:740] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.256281 1208 consensus_queue.cc:260] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.256937 1208 ts_tablet_manager.cc:1434] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260619 19:54:12.259325 2026 log.cc:1199] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/46dcf2293e2d461ca1be171069867d1f
I20260619 19:54:12.265519 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 385) took 3917 ms. Trace:
I20260619 19:54:12.265676 1973 rpcz_store.cc:276] 0619 19:54:08.347925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.352640 (+ 4715us) service_pool.cc:224] Handling call
0619 19:54:12.224816 (+3872176us) ts_tablet_manager.cc:1151] Deleting tablet a9bdcbcf35e14a7ca2c0241478d278cd
0619 19:54:12.265319 (+ 40503us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.265485 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3871800}
I20260619 19:54:12.260867 1201 tablet_bootstrap.cc:492] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.266178 1201 ts_tablet_manager.cc:1403] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.154s user 0.033s sys 0.049s
I20260619 19:54:12.266332 2026 ts_tablet_manager.cc:1950] T 46dcf2293e2d461ca1be171069867d1f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.267161 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 146) took 10951 ms. Trace:
I20260619 19:54:12.267030 1201 raft_consensus.cc:359] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.267349 1201 raft_consensus.cc:385] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.267478 1201 raft_consensus.cc:740] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.267306 2026 rpcz_store.cc:276] 0619 19:54:01.315688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.315916 (+ 228us) service_pool.cc:224] Handling call
0619 19:54:12.203644 (+10887728us) ts_tablet_manager.cc:1151] Deleting tablet 46dcf2293e2d461ca1be171069867d1f
0619 19:54:12.203662 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.225038 (+ 21376us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.255582 (+ 30544us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.267114 (+ 11532us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10876113}
I20260619 19:54:12.267776 1201 consensus_queue.cc:260] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.268375 1201 ts_tablet_manager.cc:1434] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:12.268416 2026 tablet_replica.cc:333] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.268661 1201 tablet_bootstrap.cc:492] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.268672 2026 raft_consensus.cc:2243] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.269104 2026 raft_consensus.cc:2272] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.269834 2026 ts_tablet_manager.cc:1916] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.270147 1201 tablet_bootstrap.cc:654] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.271836 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 407) took 3732 ms. Trace:
I20260619 19:54:12.271970 1973 rpcz_store.cc:276] 0619 19:54:08.539060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.561274 (+ 22214us) service_pool.cc:224] Handling call
0619 19:54:12.265988 (+3704714us) ts_tablet_manager.cc:1151] Deleting tablet b12efc4264ae48e29fbcd446ea161307
0619 19:54:12.271626 (+ 5638us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.271778 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3704480}
I20260619 19:54:12.272506 1973 tablet_replica.cc:333] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:12.272716 1973 raft_consensus.cc:2243] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.272897 1973 raft_consensus.cc:2272] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.273872 1973 ts_tablet_manager.cc:1916] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.282326 858 leader_election.cc:304] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.283042 2269 raft_consensus.cc:3060] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.284652 1973 ts_tablet_manager.cc:1929] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.285269 1973 log.cc:1199] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:12.285787 2269 raft_consensus.cc:2749] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.287537 1973 ts_tablet_manager.cc:1950] T c54b2e4f657245c2aa23d138968b3b0d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:12.290452 1200 tablet_bootstrap.cc:492] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:12.290699 1200 ts_tablet_manager.cc:1403] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.178s user 0.006s sys 0.000s
I20260619 19:54:12.291610 1200 raft_consensus.cc:359] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.291877 1200 raft_consensus.cc:385] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.291966 1200 raft_consensus.cc:740] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.292251 1200 consensus_queue.cc:260] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.293725 858 leader_election.cc:304] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.295094 2539 raft_consensus.cc:3060] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.297663 1200 ts_tablet_manager.cc:1434] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260619 19:54:12.298234 1200 tablet_bootstrap.cc:492] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:12.298945 2539 raft_consensus.cc:2749] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.300321 1200 tablet_bootstrap.cc:654] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.314785 2026 ts_tablet_manager.cc:1929] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.318817 2026 log.cc:1199] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fd9c959792fa48e89b669520f7332b26
I20260619 19:54:12.319530 2026 ts_tablet_manager.cc:1950] T fd9c959792fa48e89b669520f7332b26 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.320686 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 147) took 11004 ms. Trace:
I20260619 19:54:12.321360 2026 rpcz_store.cc:276] 0619 19:54:01.316430 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.316503 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:12.268362 (+10951859us) ts_tablet_manager.cc:1151] Deleting tablet fd9c959792fa48e89b669520f7332b26
0619 19:54:12.268374 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.284013 (+ 15639us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.314689 (+ 30676us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.320655 (+ 5966us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10940788}
I20260619 19:54:12.322130 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fd9c959792fa48e89b669520f7332b26 (table default.Table_d11dd25ca82141b79681a23f91d8fcb0 [id=0cb3b7f319a34662a7b8c13ecc98d360]) successfully deleted
I20260619 19:54:12.322431 1201 tablet_bootstrap.cc:492] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.322638 2026 tablet_replica.cc:333] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.322675 1201 ts_tablet_manager.cc:1403] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.021s
I20260619 19:54:12.322945 2026 raft_consensus.cc:2243] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.323203 2026 raft_consensus.cc:2272] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.323927 1201 raft_consensus.cc:359] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.324537 2694 raft_consensus.cc:493] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.324656 1201 raft_consensus.cc:385] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.324707 2694 raft_consensus.cc:515] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.324777 1201 raft_consensus.cc:740] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.325338 2694 leader_election.cc:290] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.325208 1201 consensus_queue.cc:260] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.326231 1201 ts_tablet_manager.cc:1434] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:54:12.326452 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08fc0181e5642d0a2b7967ff30d4eaa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.326649 1201 tablet_bootstrap.cc:492] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:12.327126 996 leader_election.cc:343] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.327486 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08fc0181e5642d0a2b7967ff30d4eaa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:12.325233 2026 ts_tablet_manager.cc:1916] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.328150 996 leader_election.cc:343] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.328264 996 leader_election.cc:304] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:12.328915 2694 raft_consensus.cc:2749] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.329265 1201 tablet_bootstrap.cc:654] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.341459 1201 tablet_bootstrap.cc:492] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.341717 1201 ts_tablet_manager.cc:1403] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.006s
I20260619 19:54:12.343169 1201 raft_consensus.cc:359] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.343502 1201 raft_consensus.cc:385] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.343601 1201 raft_consensus.cc:740] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.344002 1201 consensus_queue.cc:260] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.344806 1201 ts_tablet_manager.cc:1434] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:12.345300 1201 tablet_bootstrap.cc:492] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.347762 1201 tablet_bootstrap.cc:654] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.348243 2026 ts_tablet_manager.cc:1929] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.353978 2026 log.cc:1199] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/30f7be0f6e9f4fc6ba7bde011a9bbf60
I20260619 19:54:12.354691 2026 ts_tablet_manager.cc:1950] T 30f7be0f6e9f4fc6ba7bde011a9bbf60 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:12.356119 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a9bdcbcf35e14a7ca2c0241478d278cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9bdcbcf35e14a7ca2c0241478d278cd already in progress: creating tablet
I20260619 19:54:12.356698 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 148) took 11039 ms. Trace:
I20260619 19:54:12.356863 2026 rpcz_store.cc:276] 0619 19:54:01.316803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.316851 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:12.322568 (+11005717us) ts_tablet_manager.cc:1151] Deleting tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60
0619 19:54:12.322578 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.341296 (+ 18718us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.348184 (+ 6888us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.356674 (+ 8490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10994904}
W20260619 19:54:12.357343 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b12efc4264ae48e29fbcd446ea161307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b12efc4264ae48e29fbcd446ea161307 already in progress: creating tablet
I20260619 19:54:12.357571 2026 tablet_replica.cc:333] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.357649 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 30f7be0f6e9f4fc6ba7bde011a9bbf60 (table default.Table_06a592321d9b45b1b878d51b17c448c6 [id=6c9fac095a1d4192b64322a131a26435]) successfully deleted
I20260619 19:54:12.357852 2026 raft_consensus.cc:2243] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.358148 2026 raft_consensus.cc:2272] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.359088 2026 ts_tablet_manager.cc:1916] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.359396 2694 consensus_queue.cc:1048] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:12.375975 858 consensus_peers.cc:597] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28e463032d0744cc88d011accbebfe1f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:12.381381 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 74f39941c13847d79e2b2c3ddd176533
I20260619 19:54:12.382205 529 catalog_manager.cc:6784] ReplaceTablet: tablet 74f39941c13847d79e2b2c3ddd176533 deleted and replaced by tablet 4b35985fed5949889ef6cd321ea38e7b
I20260619 19:54:12.382354 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 74f39941c13847d79e2b2c3ddd176533 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b35985fed5949889ef6cd321ea38e7b) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.382896 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 415) took 3810 ms. Trace:
I20260619 19:54:12.383019 1973 rpcz_store.cc:276] 0619 19:54:08.572639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.572680 (+ 41us) service_pool.cc:224] Handling call
0619 19:54:12.272230 (+3699550us) ts_tablet_manager.cc:1151] Deleting tablet c54b2e4f657245c2aa23d138968b3b0d
0619 19:54:12.272433 (+ 203us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.278152 (+ 5719us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.284247 (+ 6095us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.382825 (+ 98578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3691001}
I20260619 19:54:12.383404 1973 tablet_replica.cc:333] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:12.383633 1973 raft_consensus.cc:2243] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.383824 1973 raft_consensus.cc:2272] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.385080 1973 ts_tablet_manager.cc:1916] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.385790 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 74f39941c13847d79e2b2c3ddd176533 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b35985fed5949889ef6cd321ea38e7b) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.387089 1994 tablet_replica.cc:333] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:12.387355 1994 raft_consensus.cc:2243] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.387703 1994 raft_consensus.cc:2272] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.388335 1994 ts_tablet_manager.cc:1916] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.395300 1994 ts_tablet_manager.cc:1929] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.395466 2026 ts_tablet_manager.cc:1929] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.395450 1208 tablet_bootstrap.cc:492] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.395618 1994 log.cc:1199] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/74f39941c13847d79e2b2c3ddd176533
I20260619 19:54:12.396157 1994 ts_tablet_manager.cc:1950] T 74f39941c13847d79e2b2c3ddd176533 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:12.397663 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 74f39941c13847d79e2b2c3ddd176533 (table default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]) successfully deleted
I20260619 19:54:12.398553 1973 ts_tablet_manager.cc:1929] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.399179 1973 log.cc:1199] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/0b55debc1b064192a56d2453364ba260
I20260619 19:54:12.400172 2434 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d38b77ff37948e19592b36b6d884fe0, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.401319 2434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 379, Last appended: 2.383, Last appended by leader: 383, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:54:12.402938 1201 tablet_bootstrap.cc:492] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.403334 2026 log.cc:1199] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/7fb8df8d8ac047bfa6ab7a6b533e38fc
I20260619 19:54:12.403537 1201 ts_tablet_manager.cc:1403] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.058s user 0.014s sys 0.013s
W20260619 19:54:12.406002 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 226b636ca31f40138488d4fc2c85358a consensus state has no leader
I20260619 19:54:12.406502 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8f83f7609f9844b9bfdd44150af8b18a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.407191 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f83f7609f9844b9bfdd44150af8b18a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.407316 1201 raft_consensus.cc:359] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.407554 2026 ts_tablet_manager.cc:1950] T 7fb8df8d8ac047bfa6ab7a6b533e38fc P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.407667 1201 raft_consensus.cc:385] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.407792 1201 raft_consensus.cc:740] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.407990 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 152) took 11090 ms. Trace:
I20260619 19:54:12.408068 2026 rpcz_store.cc:276] 0619 19:54:01.332097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.332164 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:12.357514 (+11025350us) ts_tablet_manager.cc:1151] Deleting tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc
0619 19:54:12.357525 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.392485 (+ 34960us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.395402 (+ 2917us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.407972 (+ 12570us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11025078}
I20260619 19:54:12.408299 1973 ts_tablet_manager.cc:1950] T 0b55debc1b064192a56d2453364ba260 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:12.408612 2026 tablet_replica.cc:333] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.408571 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]) successfully deleted
W20260619 19:54:12.408705 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e7b94596b0246628b963524983bb226 consensus state has no leader
I20260619 19:54:12.408816 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 7fb8df8d8ac047bfa6ab7a6b533e38fc (table default.Table_573c9bb6dffe4624b4281ba8299a28c8 [id=a257daec65804c85b5bdd314f7dd7be3]) successfully deleted
I20260619 19:54:12.408828 2026 raft_consensus.cc:2243] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.408983 2026 raft_consensus.cc:2272] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.408178 1201 consensus_queue.cc:260] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.409126 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_87f3089ec8fb4c7990ece82f72c17904" } modify_external_catalogs: true
I20260619 19:54:12.409286 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_87f3089ec8fb4c7990ece82f72c17904" } modify_external_catalogs: true
I20260619 19:54:12.409657 2026 ts_tablet_manager.cc:1916] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.410782 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a8c49f78e984e1ebd0c4e79a457447c consensus state has no leader
I20260619 19:54:12.411168 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2d8e5fe907c946cab36fcb67654f064b" } modify_external_catalogs: true
I20260619 19:54:12.411356 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2d8e5fe907c946cab36fcb67654f064b" } modify_external_catalogs: true
I20260619 19:54:12.412881 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 74f39941c13847d79e2b2c3ddd176533 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b35985fed5949889ef6cd321ea38e7b) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.412307 1208 tablet_bootstrap.cc:654] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.413733 1201 ts_tablet_manager.cc:1434] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260619 19:54:12.413916 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_46a7c157a163498b8dad537378867594" } modify_external_catalogs: true
I20260619 19:54:12.414108 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_46a7c157a163498b8dad537378867594" } modify_external_catalogs: true
W20260619 19:54:12.414017 858 consensus_peers.cc:597] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:12.414420 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 413) took 3842 ms. Trace:
I20260619 19:54:12.414533 1973 rpcz_store.cc:276] 0619 19:54:08.572385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.572437 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:12.383325 (+3810888us) ts_tablet_manager.cc:1151] Deleting tablet 0b55debc1b064192a56d2453364ba260
0619 19:54:12.383335 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.391500 (+ 8165us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.398336 (+ 6836us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.414386 (+ 16050us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3801988}
I20260619 19:54:12.414752 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_89a388cee2964d0a82df7dc583b3c8b3" } new_table_name: "default.Table_48ce2bd2205a4d909d02f198be79c8db" modify_external_catalogs: true
I20260619 19:54:12.414951 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 414) took 3842 ms. Trace:
I20260619 19:54:12.415441 1201 tablet_bootstrap.cc:492] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.416502 2026 ts_tablet_manager.cc:1929] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.419118 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_768684129cfe44258358f47422cf89a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.419821 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768684129cfe44258358f47422cf89a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.419641 1201 tablet_bootstrap.cc:654] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.425817 1208 tablet_bootstrap.cc:492] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:12.427448 1208 ts_tablet_manager.cc:1403] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.003s
I20260619 19:54:12.428829 1208 raft_consensus.cc:359] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.429095 1208 raft_consensus.cc:385] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.429189 1208 raft_consensus.cc:740] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.429534 1208 consensus_queue.cc:260] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:12.430613 859 consensus_peers.cc:597] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71d212a279754f2497ad4fc2a3c8b5c3. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:12.430626 1208 ts_tablet_manager.cc:1434] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:12.431205 1208 tablet_bootstrap.cc:492] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.415052 1973 rpcz_store.cc:276] 0619 19:54:08.572528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.572628 (+ 100us) service_pool.cc:224] Handling call
0619 19:54:12.414836 (+3842208us) ts_tablet_manager.cc:1151] Deleting tablet 76ffe451545c4af6821971384fce483e
0619 19:54:12.414846 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.414914 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3833407}
I20260619 19:54:12.431849 2747 consensus_queue.cc:1048] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.431967 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 418) took 3853 ms. Trace:
I20260619 19:54:12.432127 1973 rpcz_store.cc:276] 0619 19:54:08.577986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.581486 (+ 3500us) service_pool.cc:224] Handling call
0619 19:54:12.431769 (+3850283us) ts_tablet_manager.cc:1151] Deleting tablet fade40bf3e7145f29076821f091677bd
0619 19:54:12.431781 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.431901 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3850064}
I20260619 19:54:12.432725 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 416) took 3859 ms. Trace:
I20260619 19:54:12.432940 1973 rpcz_store.cc:276] 0619 19:54:08.572763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.577557 (+ 4794us) service_pool.cc:224] Handling call
0619 19:54:12.432549 (+3854992us) ts_tablet_manager.cc:1151] Deleting tablet 0f32e1c7a27941ca9377901b19b32af3
0619 19:54:12.432557 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.432670 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3846715}
I20260619 19:54:12.433570 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 406) took 3894 ms. Trace:
I20260619 19:54:12.433744 1973 rpcz_store.cc:276] 0619 19:54:08.538979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.572821 (+ 33842us) service_pool.cc:224] Handling call
0619 19:54:12.433328 (+3860507us) ts_tablet_manager.cc:1151] Deleting tablet b546831050f84a91b8e4df5b96b1be14
0619 19:54:12.433360 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.433504 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3847386}
I20260619 19:54:12.434829 2026 log.cc:1199] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/ecbe466eee2f43359181a1d26d6e761e
I20260619 19:54:12.436668 2026 ts_tablet_manager.cc:1950] T ecbe466eee2f43359181a1d26d6e761e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.437011 2854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:54:12.438027 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 0b55debc1b064192a56d2453364ba260 (table default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]) successfully deleted
W20260619 19:54:12.438614 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 76ffe451545c4af6821971384fce483e because the tablet was not found. No further retry: Not found: Tablet not found: 76ffe451545c4af6821971384fce483e
W20260619 19:54:12.439059 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fade40bf3e7145f29076821f091677bd because the tablet was not found. No further retry: Not found: Tablet not found: fade40bf3e7145f29076821f091677bd
W20260619 19:54:12.439510 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0f32e1c7a27941ca9377901b19b32af3 because the tablet was not found. No further retry: Not found: Tablet not found: 0f32e1c7a27941ca9377901b19b32af3
W20260619 19:54:12.440054 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b546831050f84a91b8e4df5b96b1be14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b546831050f84a91b8e4df5b96b1be14 already in progress: creating tablet
I20260619 19:54:12.440493 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 153) took 11107 ms. Trace:
I20260619 19:54:12.441246 2026 rpcz_store.cc:276] 0619 19:54:01.332682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.332733 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:12.408562 (+11075829us) ts_tablet_manager.cc:1151] Deleting tablet ecbe466eee2f43359181a1d26d6e761e
0619 19:54:12.408572 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.413251 (+ 4679us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.416445 (+ 3194us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.440468 (+ 24023us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11075581}
I20260619 19:54:12.443020 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet ecbe466eee2f43359181a1d26d6e761e (table default.Table_2a0e967a9ab24a16b767629e2c9c6529 [id=f9c9368e00a44a3cba3399486f27f016]) successfully deleted
I20260619 19:54:12.444005 2026 tablet_replica.cc:333] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.444887 2026 raft_consensus.cc:2243] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.445897 2434 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 19:54:12.454047 2374 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 2 FOLLOWER]: Advancing to term 3
I20260619 19:54:12.455425 2854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:54:12.455727 1973 tablet_replica.cc:333] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:12.455958 1973 raft_consensus.cc:2243] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.456362 1973 raft_consensus.cc:2272] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.457089 1973 ts_tablet_manager.cc:1916] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.457799 1200 tablet_bootstrap.cc:492] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:12.458000 1200 ts_tablet_manager.cc:1403] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.160s user 0.012s sys 0.006s
I20260619 19:54:12.458875 1200 raft_consensus.cc:359] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.445617 2026 raft_consensus.cc:2272] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.459183 1200 raft_consensus.cc:385] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.459295 1200 raft_consensus.cc:740] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.459590 1200 consensus_queue.cc:260] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.459980 2026 ts_tablet_manager.cc:1916] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.462996 1200 ts_tablet_manager.cc:1434] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:54:12.463663 1200 tablet_bootstrap.cc:492] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:12.466859 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f7696e1f927f4877b720964c7b8af02c
I20260619 19:54:12.467695 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 85f16c7a84e54c21b3f908540654bf58 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:12.469246 2374 pending_rounds.cc:85] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Aborting all ops after (but not including) 380
I20260619 19:54:12.469446 2374 pending_rounds.cc:107] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Aborting uncommitted WRITE_OP operation due to leader change: 2.381
I20260619 19:54:12.469661 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e73233a773d74ae2b28e0a7f5480cb61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.470170 2374 pending_rounds.cc:107] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Aborting uncommitted WRITE_OP operation due to leader change: 2.382
W20260619 19:54:12.470324 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e73233a773d74ae2b28e0a7f5480cb61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.470438 2374 pending_rounds.cc:107] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: Aborting uncommitted WRITE_OP operation due to leader change: 2.383
I20260619 19:54:12.471639 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 39706a77fb3a40afbaa9b0436d4eaa28
I20260619 19:54:12.473037 527 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]). Expected version 1 got 0
I20260619 19:54:12.473300 527 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 098d5bd070b54889905539f1fa1a47e6 (table default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a]). Expected version 1 got 0
I20260619 19:54:12.473575 527 catalog_manager.cc:5696] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:12.473855 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d1ea5a845ac449f1a9f65e78d02e3bb6" } new_table_name: "default.Table_4ffde42e445c4cc2a747b88b27d6514c" modify_external_catalogs: true
I20260619 19:54:12.473995 527 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:12.474277 527 catalog_manager.cc:5696] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:12.474681 527 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:12.479206 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f7696e1f927f4877b720964c7b8af02c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.479475 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 39706a77fb3a40afbaa9b0436d4eaa28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.481050 2026 ts_tablet_manager.cc:1929] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.481434 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet f7696e1f927f4877b720964c7b8af02c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.481712 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 39706a77fb3a40afbaa9b0436d4eaa28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:12.482255 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f7696e1f927f4877b720964c7b8af02c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7696e1f927f4877b720964c7b8af02c already in progress: creating tablet
I20260619 19:54:12.482445 2026 log.cc:1199] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/37393d7c16594032bf2a69abb0ab5931
W20260619 19:54:12.483001 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 39706a77fb3a40afbaa9b0436d4eaa28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39706a77fb3a40afbaa9b0436d4eaa28 already in progress: creating tablet
I20260619 19:54:12.484086 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet cb068672e26d48b9a871ceb1c81022cc
I20260619 19:54:12.484385 2026 ts_tablet_manager.cc:1950] T 37393d7c16594032bf2a69abb0ab5931 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.484930 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e8fd08c12eb04674bc5cafd9bb81fca6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.485539 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8fd08c12eb04674bc5cafd9bb81fca6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.485242 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 154) took 11152 ms. Trace:
I20260619 19:54:12.487859 2026 rpcz_store.cc:276] 0619 19:54:01.333108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.333147 (+ 39us) service_pool.cc:224] Handling call
0619 19:54:12.443742 (+11110595us) ts_tablet_manager.cc:1151] Deleting tablet 37393d7c16594032bf2a69abb0ab5931
0619 19:54:12.443862 (+ 120us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.466134 (+ 22272us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.480976 (+ 14842us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.485222 (+ 4246us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11110404}
I20260619 19:54:12.488315 899 tablet_service.cc:1558] Processing DeleteTablet for tablet cb068672e26d48b9a871ceb1c81022cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.489248 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet cb068672e26d48b9a871ceb1c81022cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.489480 2026 tablet_replica.cc:333] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.489622 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 37393d7c16594032bf2a69abb0ab5931 (table default.Table_7a2106fc27da4bfaa12b35fb3e27f0bf [id=95592d0ef6074d7ba3678c493c25ca56]) successfully deleted
I20260619 19:54:12.489691 2026 raft_consensus.cc:2243] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.490051 2026 raft_consensus.cc:2272] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.490664 2026 ts_tablet_manager.cc:1916] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.491478 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cb068672e26d48b9a871ceb1c81022cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb068672e26d48b9a871ceb1c81022cc already in progress: creating tablet
I20260619 19:54:12.492539 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f7696e1f927f4877b720964c7b8af02c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.492914 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 39706a77fb3a40afbaa9b0436d4eaa28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.493249 754 tablet_service.cc:1558] Processing DeleteTablet for tablet cb068672e26d48b9a871ceb1c81022cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:12.494671 858 consensus_peers.cc:597] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c54b2e4f657245c2aa23d138968b3b0d. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:12.504473 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6be09bf87314a96a243ff2f726cfd2b consensus state has no leader
I20260619 19:54:12.506553 1200 tablet_bootstrap.cc:654] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.510584 2694 raft_consensus.cc:493] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.510790 2694 raft_consensus.cc:515] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.511533 2694 leader_election.cc:290] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.512662 2026 ts_tablet_manager.cc:1929] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.513588 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf175c80483346788a148b7277b9ca9d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:12.514724 996 leader_election.cc:343] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.512794 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf175c80483346788a148b7277b9ca9d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:12.516333 996 leader_election.cc:343] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.516507 996 leader_election.cc:304] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:12.517071 2694 raft_consensus.cc:2749] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.517447 2026 log.cc:1199] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/91e43148bb5b47128e08ed7faf8c7c1f
I20260619 19:54:12.518242 2026 ts_tablet_manager.cc:1950] T 91e43148bb5b47128e08ed7faf8c7c1f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.519659 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 155) took 11186 ms. Trace:
I20260619 19:54:12.520555 2026 rpcz_store.cc:276] 0619 19:54:01.333487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.333529 (+ 42us) service_pool.cc:224] Handling call
0619 19:54:12.489423 (+11155894us) ts_tablet_manager.cc:1151] Deleting tablet 91e43148bb5b47128e08ed7faf8c7c1f
0619 19:54:12.489435 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.502029 (+ 12594us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.512586 (+ 10557us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.519642 (+ 7056us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11155699}
I20260619 19:54:12.521620 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 160) took 10874 ms. Trace:
I20260619 19:54:12.521731 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 91e43148bb5b47128e08ed7faf8c7c1f (table default.Table_add3279cce4944a1a6e56b997e6093e7 [id=40e068d4874b46e5bd112f84ad360dc6]) successfully deleted
I20260619 19:54:12.522588 2026 rpcz_store.cc:276] 0619 19:54:01.651643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.651753 (+ 110us) service_pool.cc:224] Handling call
0619 19:54:12.521438 (+10869685us) ts_tablet_manager.cc:1151] Deleting tablet 9b78d8a4d8dd42859be248b698257e2c
0619 19:54:12.521449 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.521598 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10830316}
I20260619 19:54:12.523763 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 161) took 10852 ms. Trace:
W20260619 19:54:12.524070 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9b78d8a4d8dd42859be248b698257e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b78d8a4d8dd42859be248b698257e2c already in progress: creating tablet
I20260619 19:54:12.524581 2026 rpcz_store.cc:276] 0619 19:54:01.671201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:01.671945 (+ 744us) service_pool.cc:224] Handling call
0619 19:54:12.523626 (+10851681us) ts_tablet_manager.cc:1151] Deleting tablet ba0cd4cd0661415d8b2b2339363e7aca
0619 19:54:12.523637 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.523746 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10829352}
I20260619 19:54:12.525421 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 184) took 10397 ms. Trace:
I20260619 19:54:12.525804 2026 rpcz_store.cc:276] 0619 19:54:02.128114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.128278 (+ 164us) service_pool.cc:224] Handling call
0619 19:54:12.525078 (+10396800us) ts_tablet_manager.cc:1151] Deleting tablet 56640f773efb4123b93f4ca3799ddde7
0619 19:54:12.525305 (+ 227us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.525404 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10392469}
W20260619 19:54:12.526576 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 56640f773efb4123b93f4ca3799ddde7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56640f773efb4123b93f4ca3799ddde7 already in progress: creating tablet
I20260619 19:54:12.529547 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 194) took 10161 ms. Trace:
I20260619 19:54:12.529685 2026 rpcz_store.cc:276] 0619 19:54:02.367609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.375242 (+ 7633us) service_pool.cc:224] Handling call
0619 19:54:12.526902 (+10151660us) ts_tablet_manager.cc:1151] Deleting tablet fe814880d9984bbd83fa121cb2a34eac
0619 19:54:12.529417 (+ 2515us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.529524 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10151157}
W20260619 19:54:12.530313 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet fe814880d9984bbd83fa121cb2a34eac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe814880d9984bbd83fa121cb2a34eac already in progress: creating tablet
I20260619 19:54:12.531174 1201 tablet_bootstrap.cc:492] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.531355 1201 ts_tablet_manager.cc:1403] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.116s user 0.014s sys 0.020s
I20260619 19:54:12.532264 1201 raft_consensus.cc:359] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.532496 1201 raft_consensus.cc:385] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.532584 1201 raft_consensus.cc:740] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.532823 1201 consensus_queue.cc:260] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.533649 1201 ts_tablet_manager.cc:1434] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:12.533977 1201 tablet_bootstrap.cc:492] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.535730 1201 tablet_bootstrap.cc:654] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.535979 2026 tablet_replica.cc:333] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.537068 2026 raft_consensus.cc:2243] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.537426 2026 raft_consensus.cc:2272] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.538089 2026 ts_tablet_manager.cc:1916] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.539849 1208 tablet_bootstrap.cc:654] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.562420 2026 ts_tablet_manager.cc:1929] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:12.562981 2026 log.cc:1199] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/30e606b958d940c6a353a09a2eb627ee
I20260619 19:54:12.563534 2026 ts_tablet_manager.cc:1950] T 30e606b958d940c6a353a09a2eb627ee P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.564332 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 193) took 10196 ms. Trace:
I20260619 19:54:12.564360 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_aafc46bf4f274dd28db7b2d0c62e70eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.564834 2026 rpcz_store.cc:276] 0619 19:54:02.367484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.375813 (+ 8329us) service_pool.cc:224] Handling call
0619 19:54:12.535912 (+10160099us) ts_tablet_manager.cc:1151] Deleting tablet 30e606b958d940c6a353a09a2eb627ee
0619 19:54:12.535935 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.542498 (+ 6563us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.562333 (+ 19835us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.564314 (+ 1981us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10159752}
W20260619 19:54:12.565232 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aafc46bf4f274dd28db7b2d0c62e70eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.565375 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 30e606b958d940c6a353a09a2eb627ee (table default.Table_d23a54ae1ba943d39d8bee350a57ff40 [id=6ae36ea0c1f740d983c6b27478be5665]) successfully deleted
I20260619 19:54:12.565920 1208 tablet_bootstrap.cc:492] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:12.565941 2026 tablet_replica.cc:333] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.566063 1208 ts_tablet_manager.cc:1403] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.135s user 0.009s sys 0.001s
I20260619 19:54:12.566133 2026 raft_consensus.cc:2243] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.566784 1208 raft_consensus.cc:359] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.567847 1200 tablet_bootstrap.cc:492] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:12.568041 1200 ts_tablet_manager.cc:1403] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.002s
I20260619 19:54:12.568795 1200 raft_consensus.cc:359] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.568903 2026 raft_consensus.cc:2272] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.569561 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.569936 2026 ts_tablet_manager.cc:1916] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.570212 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.587869 2026 ts_tablet_manager.cc:1929] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.596433 2026 log.cc:1199] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/c54b2e4f657245c2aa23d138968b3b0d
I20260619 19:54:12.597234 2026 ts_tablet_manager.cc:1950] T c54b2e4f657245c2aa23d138968b3b0d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.597896 2269 raft_consensus.cc:493] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.598093 2269 raft_consensus.cc:515] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.598692 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 192) took 10231 ms. Trace:
I20260619 19:54:12.598865 2269 leader_election.cc:290] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.598781 2026 rpcz_store.cc:276] 0619 19:54:02.367358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.376201 (+ 8843us) service_pool.cc:224] Handling call
0619 19:54:12.565891 (+10189690us) ts_tablet_manager.cc:1151] Deleting tablet c54b2e4f657245c2aa23d138968b3b0d
0619 19:54:12.565901 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.574552 (+ 8651us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.587797 (+ 13245us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.598670 (+ 10873us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10189422}
I20260619 19:54:12.600569 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 195) took 10164 ms. Trace:
I20260619 19:54:12.600986 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet c54b2e4f657245c2aa23d138968b3b0d (table default.Table_7ae6ef4dc2a74b9babb2925078822313 [id=3f7820df305d4653980c5db7e412c308]) successfully deleted
I20260619 19:54:12.601095 2026 rpcz_store.cc:276] 0619 19:54:02.435664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.436990 (+ 1326us) service_pool.cc:224] Handling call
0619 19:54:12.600415 (+10163425us) ts_tablet_manager.cc:1151] Deleting tablet b4f7122fa5f94eeaa3b99cae107d8c9a
0619 19:54:12.600427 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.600551 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10163092}
I20260619 19:54:12.601728 2026 tablet_replica.cc:333] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.602175 2026 raft_consensus.cc:2243] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.602654 2026 raft_consensus.cc:2272] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:12.602671 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b4f7122fa5f94eeaa3b99cae107d8c9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f7122fa5f94eeaa3b99cae107d8c9a already in progress: creating tablet
I20260619 19:54:12.603233 1208 raft_consensus.cc:385] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.603361 1208 raft_consensus.cc:740] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.603574 2026 ts_tablet_manager.cc:1916] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.603583 1208 consensus_queue.cc:260] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.604175 1208 ts_tablet_manager.cc:1434] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260619 19:54:12.606741 968 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:12.611806 2801 consensus_queue.cc:1048] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.613354 1200 raft_consensus.cc:385] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.613468 1200 raft_consensus.cc:740] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.600417 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ace991ad1a4d52ab609940aacf6681" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:12.613700 1200 consensus_queue.cc:260] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.614384 1200 ts_tablet_manager.cc:1434] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20260619 19:54:12.616896 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ace991ad1a4d52ab609940aacf6681" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:12.618631 858 leader_election.cc:343] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:12.620710 859 leader_election.cc:343] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.620857 859 leader_election.cc:304] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.621498 2539 raft_consensus.cc:2749] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.621702 2539 consensus_queue.cc:1048] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.629456 1201 tablet_bootstrap.cc:492] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.629645 1201 ts_tablet_manager.cc:1403] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.016s
I20260619 19:54:12.629987 1200 tablet_bootstrap.cc:492] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:12.631270 1201 raft_consensus.cc:359] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.631472 1201 raft_consensus.cc:385] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.631538 1201 raft_consensus.cc:740] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.631870 1201 consensus_queue.cc:260] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.632335 1200 tablet_bootstrap.cc:654] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.632603 1201 ts_tablet_manager.cc:1434] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:12.632910 1201 tablet_bootstrap.cc:492] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.634683 1201 tablet_bootstrap.cc:654] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.632917 1973 ts_tablet_manager.cc:1929] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.635681 2026 ts_tablet_manager.cc:1929] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.635874 2026 log.cc:1199] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9a4c335fc5ca4885b5482c6b749f76f9
I20260619 19:54:12.636338 1973 log.cc:1199] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:12.636729 2026 ts_tablet_manager.cc:1950] T 9a4c335fc5ca4885b5482c6b749f76f9 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.637462 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 85f16c7a84e54c21b3f908540654bf58
I20260619 19:54:12.637751 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 196) took 10101 ms. Trace:
I20260619 19:54:12.637847 2026 rpcz_store.cc:276] 0619 19:54:02.535900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:02.536901 (+ 1001us) service_pool.cc:224] Handling call
0619 19:54:12.601677 (+10064776us) ts_tablet_manager.cc:1151] Deleting tablet 9a4c335fc5ca4885b5482c6b749f76f9
0619 19:54:12.601687 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.609938 (+ 8251us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.628401 (+ 18463us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.637724 (+ 9323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10052515}
I20260619 19:54:12.638047 1973 ts_tablet_manager.cc:1950] T d651c8fb8ff244a5a09dd9ea593ecb14 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:12.638128 531 catalog_manager.cc:6784] ReplaceTablet: tablet 85f16c7a84e54c21b3f908540654bf58 deleted and replaced by tablet 3136118e1a5847f0a39fcb14bbc46a64
I20260619 19:54:12.638213 2026 tablet_replica.cc:333] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.638412 2026 raft_consensus.cc:2243] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.638413 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 417) took 4060 ms. Trace:
I20260619 19:54:12.638592 2026 raft_consensus.cc:2272] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.638558 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b2a87fb0340e4c25894584473a100047" } modify_external_catalogs: true
I20260619 19:54:12.638509 1973 rpcz_store.cc:276] 0619 19:54:08.577850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.577898 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:12.434221 (+3856323us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:54:12.455622 (+ 21401us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.573916 (+118294us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.632818 (+ 58902us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.638393 (+ 5575us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3847949}
I20260619 19:54:12.638758 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b2a87fb0340e4c25894584473a100047" } modify_external_catalogs: true
I20260619 19:54:12.638816 1973 tablet_replica.cc:333] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:12.638998 1973 raft_consensus.cc:2243] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.639251 1973 pending_rounds.cc:70] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:12.640105 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f16c7a84e54c21b3f908540654bf58 with delete_type TABLET_DATA_DELETED (replaced by tablet 3136118e1a5847f0a39fcb14bbc46a64) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:12.640861 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 85f16c7a84e54c21b3f908540654bf58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f16c7a84e54c21b3f908540654bf58 already in progress: creating tablet
I20260619 19:54:12.643210 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9a4c335fc5ca4885b5482c6b749f76f9 (table default.Table_e996cd4a2ce04c02a10ef16acb8d545b [id=af4d9d7b334042f6be3ea00656ff2e3f]) successfully deleted
I20260619 19:54:12.643816 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f16c7a84e54c21b3f908540654bf58 with delete_type TABLET_DATA_DELETED (replaced by tablet 3136118e1a5847f0a39fcb14bbc46a64) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.644130 1208 tablet_bootstrap.cc:492] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.644995 2026 ts_tablet_manager.cc:1916] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.645239 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f16c7a84e54c21b3f908540654bf58 with delete_type TABLET_DATA_DELETED (replaced by tablet 3136118e1a5847f0a39fcb14bbc46a64) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.645538 2694 raft_consensus.cc:493] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.645573 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d651c8fb8ff244a5a09dd9ea593ecb14 (table default.Table_24d96d4b01f94727832aaf2c7fc13576 [id=b6c966d7d56a46cfb4fa632aad28d7b6]) successfully deleted
I20260619 19:54:12.645665 1208 tablet_bootstrap.cc:654] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.645697 2694 raft_consensus.cc:515] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.646354 2694 leader_election.cc:290] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.647224 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.647373 2801 consensus_queue.cc:1048] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.647938 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:12.648490 996 leader_election.cc:343] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:12.648711 996 leader_election.cc:343] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.648793 996 leader_election.cc:304] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:12.649129 2747 raft_consensus.cc:2749] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:12.649471 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 8e3f4b47d0e7451d91add5a81330bc7d (table default.Table_47777facbac0455db73ae3e21ce363ea [id=13a54bc3bdb04d96afdbbc9daf0a6781], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e3f4b47d0e7451d91add5a81330bc7d consensus state has no leader
I20260619 19:54:12.655092 1200 tablet_bootstrap.cc:492] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:12.661034 1200 ts_tablet_manager.cc:1403] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.001s
I20260619 19:54:12.665084 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_906aa3cdbfd5474989f1f99803b0751d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.665874 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_906aa3cdbfd5474989f1f99803b0751d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:12.667510 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de10e2325cfa4e2f84ada2e9072e4b2f consensus state has no leader
I20260619 19:54:12.667834 526 master_service.cc:960] ReplaceTablet: received request to replace tablet f40da590ead8491788f59f1711e7e525 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:12.669471 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_71366a598b944511b0e6d86f5c594dc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.670063 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71366a598b944511b0e6d86f5c594dc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:12.670954 858 consensus_peers.cc:597] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:12.672205 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_db398321a2c040db8d9c4f88816f3398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.672875 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db398321a2c040db8d9c4f88816f3398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.676218 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:12.676838 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:12.677078 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]). Expected version 1 got 0
I20260619 19:54:12.677592 525 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_247be2054e924a3885a4822bb5c4c2d3 [id=cb0dfc15d9414ae3b63638e94c05c0a5] alter complete (version 1)
I20260619 19:54:12.680260 1201 tablet_bootstrap.cc:492] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.680425 1201 ts_tablet_manager.cc:1403] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.003s
I20260619 19:54:12.681159 1201 raft_consensus.cc:359] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.681332 1201 raft_consensus.cc:385] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.681381 1201 raft_consensus.cc:740] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.681643 1201 consensus_queue.cc:260] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.682104 1201 ts_tablet_manager.cc:1434] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:12.682348 1201 tablet_bootstrap.cc:492] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.680269 2026 ts_tablet_manager.cc:1929] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:12.682873 2026 log.cc:1199] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/1202fe45d0964d368989f969e95f880d
I20260619 19:54:12.683207 2026 ts_tablet_manager.cc:1950] T 1202fe45d0964d368989f969e95f880d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.683960 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 222) took 9366 ms. Trace:
I20260619 19:54:12.684048 2026 rpcz_store.cc:276] 0619 19:54:03.319813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.647934 (+328121us) service_pool.cc:224] Handling call
0619 19:54:12.638160 (+8990226us) ts_tablet_manager.cc:1151] Deleting tablet 1202fe45d0964d368989f969e95f880d
0619 19:54:12.638172 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.675711 (+ 37539us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.680216 (+ 4505us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.683940 (+ 3724us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8938107}
I20260619 19:54:12.692278 1208 tablet_bootstrap.cc:492] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:12.692554 1208 ts_tablet_manager.cc:1403] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20260619 19:54:12.693440 1208 raft_consensus.cc:359] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.693678 1208 raft_consensus.cc:385] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.693771 1208 raft_consensus.cc:740] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.694064 1208 consensus_queue.cc:260] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.694739 1208 ts_tablet_manager.cc:1434] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:12.695066 1208 tablet_bootstrap.cc:492] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.696636 1208 tablet_bootstrap.cc:654] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.706764 1201 tablet_bootstrap.cc:654] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.709414 2314 raft_consensus.cc:493] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.709566 2314 raft_consensus.cc:515] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.710212 2314 leader_election.cc:290] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:12.639302 1973 pending_rounds.cc:77] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7298657697876008960 op_type: NO_OP noop_request { }
I20260619 19:54:12.711090 1973 raft_consensus.cc:2889] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:12.711215 1973 raft_consensus.cc:2272] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.712044 1973 ts_tablet_manager.cc:1916] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.714850 1200 raft_consensus.cc:359] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.715488 1200 raft_consensus.cc:385] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.715570 1200 raft_consensus.cc:740] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.715816 1200 consensus_queue.cc:260] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.716318 1200 ts_tablet_manager.cc:1434] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:12.716614 1200 tablet_bootstrap.cc:492] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:12.723409 720 leader_election.cc:343] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3
I20260619 19:54:12.724220 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26355bc6b5c147a88c14a9f053b4e1f3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:12.724480 921 raft_consensus.cc:2468] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:12.727593 719 leader_election.cc:304] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.728247 2314 raft_consensus.cc:2804] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:12.728336 2314 raft_consensus.cc:493] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:12.728402 2314 raft_consensus.cc:3060] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:12.729017 1208 tablet_bootstrap.cc:492] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:12.729131 1208 ts_tablet_manager.cc:1403] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.004s
I20260619 19:54:12.729398 1201 tablet_bootstrap.cc:492] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.729526 1201 ts_tablet_manager.cc:1403] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.005s
I20260619 19:54:12.729735 1208 raft_consensus.cc:359] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.729880 1208 raft_consensus.cc:385] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.729939 1208 raft_consensus.cc:740] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.730178 1201 raft_consensus.cc:359] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.730326 1201 raft_consensus.cc:385] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.730368 1201 raft_consensus.cc:740] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.730535 1201 consensus_queue.cc:260] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.731063 1201 ts_tablet_manager.cc:1434] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260619 19:54:12.731377 1201 tablet_bootstrap.cc:492] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.731113 2314 raft_consensus.cc:515] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.737450 2314 leader_election.cc:290] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:12.738459 720 leader_election.cc:343] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3
I20260619 19:54:12.739248 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26355bc6b5c147a88c14a9f053b4e1f3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:12.739467 921 raft_consensus.cc:3060] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:12.739961 1201 tablet_bootstrap.cc:654] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.739943 525 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_7b602f1b15fd49eeb03e86bae9c258c7 [id=3c9da136fa6d4578a5ad210801a2ccea] alter complete (version 6)
I20260619 19:54:12.742179 921 raft_consensus.cc:2468] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
W20260619 19:54:12.742378 525 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:53243 (request call id 210) took 792 ms (client timeout 1000 ms). Trace:
I20260619 19:54:12.742662 899 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.742709 719 leader_election.cc:304] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.742839 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 30e606b958d940c6a353a09a2eb627ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.742990 888 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9c959792fa48e89b669520f7332b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:50 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.743108 2314 raft_consensus.cc:2804] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:12.743233 2314 raft_consensus.cc:697] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:12.743451 2314 consensus_queue.cc:237] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.732184 1208 consensus_queue.cc:260] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.745056 1208 ts_tablet_manager.cc:1434] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260619 19:54:12.745324 1208 tablet_bootstrap.cc:492] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.747745 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e43148bb5b47128e08ed7faf8c7c1f with delete_type TABLET_DATA_DELETED (replaced by tablet 7e3a8c4b651545c9ad620be798c63b53) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.749817 2747 consensus_queue.cc:1048] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.750689 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 642e0199fd244f7e927bf7abf231327d
I20260619 19:54:12.751598 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f3d6d26aa74247d4b6d348c88b60d2af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.752225 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3d6d26aa74247d4b6d348c88b60d2af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.752369 1201 tablet_bootstrap.cc:492] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.752368 1208 tablet_bootstrap.cc:654] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.752521 1201 ts_tablet_manager.cc:1403] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260619 19:54:12.753239 1201 raft_consensus.cc:359] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.753398 1201 raft_consensus.cc:385] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.753450 1201 raft_consensus.cc:740] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.753684 1201 consensus_queue.cc:260] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.754129 1201 ts_tablet_manager.cc:1434] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:12.754400 1201 tablet_bootstrap.cc:492] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.756188 1201 tablet_bootstrap.cc:654] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.758508 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f40da590ead8491788f59f1711e7e525
I20260619 19:54:12.759196 526 catalog_manager.cc:6784] ReplaceTablet: tablet f40da590ead8491788f59f1711e7e525 deleted and replaced by tablet 1ec79ccfa8054a4bab2641d42c25b81b
I20260619 19:54:12.759604 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_80b5f0844e274a0f9bf20c3ac5445137" } new_table_name: "default.Table_76a9d0b007c44fccb350af13ab0b2092" modify_external_catalogs: true
I20260619 19:54:12.761060 2026 tablet_replica.cc:333] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.761287 2026 raft_consensus.cc:2243] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.761761 2026 raft_consensus.cc:2272] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.762123 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_84d6e7a18d774747831d92c19462ca03" } new_table_name: "default.Table_292bcfbb97fc40f3a4f90f8ad274fb83" modify_external_catalogs: true
I20260619 19:54:12.762511 2026 ts_tablet_manager.cc:1916] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.764011 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_68c5aafd2b074c8cb05af88820d8fb40" } new_table_name: "default.Table_84985ee2ef7e4bca97516d92f18abd7c" modify_external_catalogs: true
I20260619 19:54:12.765667 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 642e0199fd244f7e927bf7abf231327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.765879 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet f40da590ead8491788f59f1711e7e525 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ec79ccfa8054a4bab2641d42c25b81b) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.767020 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 1202fe45d0964d368989f969e95f880d (table default.Table_cb2d44091aa541459ddc23620b508b4e [id=41f6ba3e85b04574878f66c6f98d60ff]) successfully deleted
I20260619 19:54:12.767637 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 642e0199fd244f7e927bf7abf231327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.767866 762 tablet_service.cc:1558] Processing DeleteTablet for tablet f40da590ead8491788f59f1711e7e525 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ec79ccfa8054a4bab2641d42c25b81b) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.768074 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f40da590ead8491788f59f1711e7e525 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ec79ccfa8054a4bab2641d42c25b81b) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:12.768160 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 642e0199fd244f7e927bf7abf231327d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 642e0199fd244f7e927bf7abf231327d already in progress: creating tablet
I20260619 19:54:12.768266 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 642e0199fd244f7e927bf7abf231327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:12.768435 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f40da590ead8491788f59f1711e7e525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f40da590ead8491788f59f1711e7e525 already in progress: creating tablet
I20260619 19:54:12.770350 1201 tablet_bootstrap.cc:492] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.770496 1201 ts_tablet_manager.cc:1403] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260619 19:54:12.771209 1201 raft_consensus.cc:359] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.771375 1201 raft_consensus.cc:385] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.771425 1201 raft_consensus.cc:740] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.771658 1201 consensus_queue.cc:260] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.772104 1201 ts_tablet_manager.cc:1434] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:12.772804 1201 tablet_bootstrap.cc:492] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:12.742520 525 rpcz_store.cc:269] 0619 19:54:11.949759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.964396 (+ 14637us) service_pool.cc:224] Handling call
0619 19:54:12.013876 (+ 49480us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:12.742337 (+728461us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:12.385062 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:12.385230 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:12.385237 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:12.385239 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:12.385367 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:12.385380 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:12.385387 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:12.385534 (+ 147us) tablet.cc:701] Row locks acquired
0619 19:54:12.385538 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:54:12.385702 (+ 164us) write_op.cc:270] Start()
0619 19:54:12.423510 (+ 37808us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x61900011ff58. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fd7506c30da 00007fd7506ca1bf 00007fd75044246c 00007fd7503fa0fa 00007fd7505b7a9e 00007fd75058ad3d 00007fd750589e29 00007fd750592250 00007fd75059205d 0000000000aa681c
0619 19:54:12.423590 (+ 80us) write_op.cc:276] Timestamp: P: 1781898852385630 usec, L: 0
0619 19:54:12.423596 (+ 6us) op_driver.cc:348] REPLICATION: starting
0619 19:54:12.423872 (+ 276us) log.cc:844] Serialized 913 byte log entry
0619 19:54:12.462085 (+ 38213us) op_driver.cc:464] REPLICATION: finished
0619 19:54:12.462983 (+ 898us) write_op.cc:301] APPLY: starting
0619 19:54:12.463005 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:12.463061 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:12.463064 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:12.463177 (+ 113us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:12.463222 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:12.463230 (+ 8us) write_op.cc:312] APPLY: finished
0619 19:54:12.463325 (+ 95us) log.cc:844] Serialized 29 byte log entry
0619 19:54:12.463402 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.463428 (+ 26us) write_op.cc:454] Released schema lock
0619 19:54:12.463436 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:12.463526 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.463532 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:12.559954 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:12.560169 (+ 215us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:12.560179 (+ 10us) write_op.cc:435] Acquired schema lock
0619 19:54:12.560183 (+ 4us) tablet.cc:662] Decoding operations
0619 19:54:12.560331 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:12.560348 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:12.560355 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:12.560442 (+ 87us) tablet.cc:701] Row locks acquired
0619 19:54:12.560446 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:54:12.560491 (+ 45us) write_op.cc:270] Start()
0619 19:54:12.560526 (+ 35us) write_op.cc:276] Timestamp: P: 1781898852560466 usec, L: 0
0619 19:54:12.560529 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:12.569901 (+ 9372us) log.cc:844] Serialized 356 byte log entry
0619 19:54:12.570121 (+ 220us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fd74f1a9f22 00007fd75058b305 00007fd750589e29 00007fd750592250 00007fd75059205d 0000000000aa681c 00007fd7431749ff 00007fd743177d1b 00007fd743177b98 0000000000aa681c
0619 19:54:12.635483 (+ 65362us) op_driver.cc:464] REPLICATION: finished
0619 19:54:12.635785 (+ 302us) write_op.cc:301] APPLY: starting
0619 19:54:12.635802 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:12.635843 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:12.635846 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:12.635898 (+ 52us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:12.635930 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:12.635938 (+ 8us) write_op.cc:312] APPLY: finished
0619 19:54:12.636014 (+ 76us) log.cc:844] Serialized 23 byte log entry
0619 19:54:12.636082 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.636100 (+ 18us) write_op.cc:454] Released schema lock
0619 19:54:12.636106 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:12.636183 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.636187 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:12.710316 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:12.710401 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:12.710406 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:12.710407 (+ 1us) tablet.cc:662] Decoding operations
0619 19:54:12.710477 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:12.710484 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:12.710488 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:12.710539 (+ 51us) tablet.cc:701] Row locks acquired
0619 19:54:12.710541 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:12.710568 (+ 27us) write_op.cc:270] Start()
0619 19:54:12.710591 (+ 23us) write_op.cc:276] Timestamp: P: 1781898852710534 usec, L: 0
0619 19:54:12.710594 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:12.710718 (+ 124us) log.cc:844] Serialized 356 byte log entry
0619 19:54:12.733839 (+ 23121us) op_driver.cc:464] REPLICATION: finished
0619 19:54:12.736298 (+ 2459us) write_op.cc:301] APPLY: starting
0619 19:54:12.736309 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:12.736333 (+ 24us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:12.736362 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:12.736403 (+ 41us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:12.736438 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:12.736444 (+ 6us) write_op.cc:312] APPLY: finished
0619 19:54:12.736490 (+ 46us) log.cc:844] Serialized 23 byte log entry
0619 19:54:12.736522 (+ 32us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.736534 (+ 12us) write_op.cc:454] Released schema lock
0619 19:54:12.736539 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":17,"spinlock_wait_cycles":111190400,"child_traces":[["op",{"apply.queue_time_us":809,"apply.run_cpu_time_us":532,"apply.run_wall_time_us":532,"num_ops":2,"prepare.queue_time_us":214615,"prepare.run_cpu_time_us":1572,"prepare.run_wall_time_us":38940,"raft.queue_time_us":418,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":315,"replication_time_us":38441,"spinlock_wait_cycles":86230912}],["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":388,"apply.run_wall_time_us":386,"num_ops":1,"prepare.queue_time_us":93282,"prepare.run_cpu_time_us":1235,"prepare.run_wall_time_us":10247,"raft.queue_time_us":34222,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":314,"replication_time_us":74910,"spinlock_wait_cycles":20822912}],["op",{"apply.queue_time_us":2391,"apply.run_cpu_time_us":289,"apply.run_wall_time_us":289,"num_ops":1,"prepare.queue_time_us":31543,"replication_time_us":23232}]]}
I20260619 19:54:12.773778 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 74813bf79789451f90bcf7779aff9290 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:12.774449 1201 tablet_bootstrap.cc:654] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.780372 2026 ts_tablet_manager.cc:1929] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:12.780582 2026 log.cc:1199] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/e4132f28c434492cbddc8da7d8075c43
I20260619 19:54:12.781038 2026 ts_tablet_manager.cc:1950] T e4132f28c434492cbddc8da7d8075c43 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.788693 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 223) took 9463 ms. Trace:
I20260619 19:54:12.789032 2026 rpcz_store.cc:276] 0619 19:54:03.324971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.654046 (+329075us) service_pool.cc:224] Handling call
0619 19:54:12.761000 (+9106954us) ts_tablet_manager.cc:1151] Deleting tablet e4132f28c434492cbddc8da7d8075c43
0619 19:54:12.761011 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.768784 (+ 7773us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.780316 (+ 11532us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.788662 (+ 8346us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9056257}
I20260619 19:54:12.789728 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet e4132f28c434492cbddc8da7d8075c43 (table default.Table_93a36817c65c48b5b2e86a7b7a2937be [id=a57b082016f14ff48e4194fcbd7b63c1]) successfully deleted
I20260619 19:54:12.774780 1208 tablet_bootstrap.cc:492] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:12.790172 1208 ts_tablet_manager.cc:1403] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.003s
I20260619 19:54:12.790237 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 224) took 9457 ms. Trace:
I20260619 19:54:12.790352 2026 rpcz_store.cc:276] 0619 19:54:03.333355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.675406 (+342051us) service_pool.cc:224] Handling call
0619 19:54:12.790101 (+9114695us) ts_tablet_manager.cc:1151] Deleting tablet 710fae36dd674b1786aa75013284684e
0619 19:54:12.790113 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.790220 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9072335}
W20260619 19:54:12.790926 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 710fae36dd674b1786aa75013284684e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 710fae36dd674b1786aa75013284684e already in progress: creating tablet
I20260619 19:54:12.791210 1208 raft_consensus.cc:359] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.791378 2026 tablet_replica.cc:333] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.791643 2026 raft_consensus.cc:2243] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.791870 2026 raft_consensus.cc:2272] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.792508 2026 ts_tablet_manager.cc:1916] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.792987 1208 raft_consensus.cc:385] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.793120 1208 raft_consensus.cc:740] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.793438 1208 consensus_queue.cc:260] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.794134 1208 ts_tablet_manager.cc:1434] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:54:12.794454 1208 tablet_bootstrap.cc:492] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:12.795904 1208 tablet_bootstrap.cc:654] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.798774 2026 ts_tablet_manager.cc:1929] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.799388 921 raft_consensus.cc:3060] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.805392 2694 consensus_queue.cc:1048] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.809199 1973 ts_tablet_manager.cc:1929] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260619 19:54:12.813519 1201 tablet_bootstrap.cc:492] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.813808 1201 ts_tablet_manager.cc:1403] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.001s
I20260619 19:54:12.814536 1201 raft_consensus.cc:359] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.814776 1201 raft_consensus.cc:385] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.814867 1201 raft_consensus.cc:740] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.815107 1201 consensus_queue.cc:260] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.815655 1201 ts_tablet_manager.cc:1434] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:12.815959 1201 tablet_bootstrap.cc:492] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:12.817389 1201 tablet_bootstrap.cc:654] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.838147 921 raft_consensus.cc:3060] T 7dc1a472e7aa49639212a41619eabff3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.839336 1200 tablet_bootstrap.cc:654] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.842197 2026 log.cc:1199] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/c83c093717ef4424b56d49e2689a6d0b
I20260619 19:54:12.843014 2026 ts_tablet_manager.cc:1950] T c83c093717ef4424b56d49e2689a6d0b P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.846024 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:12.853535 1200 tablet_bootstrap.cc:492] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:12.853775 1200 ts_tablet_manager.cc:1403] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.137s user 0.002s sys 0.002s
I20260619 19:54:12.854575 1200 raft_consensus.cc:359] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.854803 1200 raft_consensus.cc:385] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.854890 1200 raft_consensus.cc:740] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.855204 1200 consensus_queue.cc:260] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.855773 1200 ts_tablet_manager.cc:1434] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:12.857535 1201 tablet_bootstrap.cc:492] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:12.857723 1201 ts_tablet_manager.cc:1403] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.003s
I20260619 19:54:12.867588 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 226) took 9518 ms. Trace:
I20260619 19:54:12.867713 2026 rpcz_store.cc:276] 0619 19:54:03.349508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.704772 (+355264us) service_pool.cc:224] Handling call
0619 19:54:12.791330 (+9086558us) ts_tablet_manager.cc:1151] Deleting tablet c83c093717ef4424b56d49e2689a6d0b
0619 19:54:12.791340 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.795872 (+ 4532us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.798716 (+ 2844us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.867564 (+ 68848us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23270,"tablet-delete.queue_time_us":9052952}
I20260619 19:54:12.868139 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 225) took 9528 ms. Trace:
I20260619 19:54:12.868216 2026 rpcz_store.cc:276] 0619 19:54:03.340101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.700087 (+359986us) service_pool.cc:224] Handling call
0619 19:54:12.867986 (+9167899us) ts_tablet_manager.cc:1151] Deleting tablet 495bafb07abe45da9f62138453dd6636
0619 19:54:12.867997 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.868115 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9091432}
I20260619 19:54:12.868526 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 228) took 9357 ms. Trace:
I20260619 19:54:12.868597 2026 rpcz_store.cc:276] 0619 19:54:03.510583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.776581 (+265998us) service_pool.cc:224] Handling call
0619 19:54:12.868414 (+9091833us) ts_tablet_manager.cc:1151] Deleting tablet 2c71f92f4e3040c09b67e287a19eea74
0619 19:54:12.868422 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.868513 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9082970}
I20260619 19:54:12.868863 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 229) took 9358 ms. Trace:
I20260619 19:54:12.868966 2694 raft_consensus.cc:493] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.868927 2026 rpcz_store.cc:276] 0619 19:54:03.510694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.785493 (+274799us) service_pool.cc:224] Handling call
0619 19:54:12.868773 (+9083280us) ts_tablet_manager.cc:1151] Deleting tablet b2902c7f67a1402987315ee426ddf1d2
0619 19:54:12.868783 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.868850 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9077117}
I20260619 19:54:12.869163 2026 tablet_replica.cc:333] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.869094 2694 raft_consensus.cc:515] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.869329 2026 raft_consensus.cc:2243] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.869479 2026 raft_consensus.cc:2272] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.869742 2694 leader_election.cc:290] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.870240 1201 raft_consensus.cc:359] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.870414 1201 raft_consensus.cc:385] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:12.870481 1201 raft_consensus.cc:740] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:12.870625 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d905e7076014c818e1fb1ef09c15342" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:12.870704 1201 consensus_queue.cc:260] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.870802 915 raft_consensus.cc:2468] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:12.871179 1201 ts_tablet_manager.cc:1434] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260619 19:54:12.871232 996 leader_election.cc:304] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:12.871212 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet c83c093717ef4424b56d49e2689a6d0b (table default.Table_91c55535580a45ac84980c9ba6792306 [id=89511700a0f7484bb33848a0664b39a8]) successfully deleted
I20260619 19:54:12.871454 1201 tablet_bootstrap.cc:492] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:12.871528 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 495bafb07abe45da9f62138453dd6636 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495bafb07abe45da9f62138453dd6636 already in progress: creating tablet
W20260619 19:54:12.871758 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2c71f92f4e3040c09b67e287a19eea74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c71f92f4e3040c09b67e287a19eea74 already in progress: creating tablet
W20260619 19:54:12.871974 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b2902c7f67a1402987315ee426ddf1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2902c7f67a1402987315ee426ddf1d2 already in progress: creating tablet
I20260619 19:54:12.872251 2269 raft_consensus.cc:493] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.872367 2694 raft_consensus.cc:2804] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:12.872435 2694 raft_consensus.cc:493] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:12.872370 2269 raft_consensus.cc:515] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.872499 2694 raft_consensus.cc:3060] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.873003 2269 leader_election.cc:290] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.873117 1201 tablet_bootstrap.cc:654] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.873870 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d905e7076014c818e1fb1ef09c15342" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.874471 2026 ts_tablet_manager.cc:1916] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.874765 996 leader_election.cc:343] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.875124 2314 raft_consensus.cc:493] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.875280 2314 raft_consensus.cc:515] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.875284 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.875862 2314 leader_election.cc:290] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:12.876403 858 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.877056 1973 log.cc:1199] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b57381b0a02141459dc582196d0c0095
I20260619 19:54:12.877496 1973 ts_tablet_manager.cc:1950] T b57381b0a02141459dc582196d0c0095 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:12.877835 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 425) took 4265 ms. Trace:
I20260619 19:54:12.877961 1973 rpcz_store.cc:276] 0619 19:54:08.612751 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.612832 (+ 81us) service_pool.cc:224] Handling call
0619 19:54:12.638771 (+4025939us) ts_tablet_manager.cc:1151] Deleting tablet b57381b0a02141459dc582196d0c0095
0619 19:54:12.638781 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.802066 (+163285us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.809143 (+ 7077us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.877819 (+ 68676us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3999384}
I20260619 19:54:12.878540 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b57381b0a02141459dc582196d0c0095 (table default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]) successfully deleted
I20260619 19:54:12.878770 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf175c80483346788a148b7277b9ca9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:12.878922 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 430) took 3920 ms. Trace:
I20260619 19:54:12.878968 915 raft_consensus.cc:2468] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:12.878991 1973 rpcz_store.cc:276] 0619 19:54:08.958543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.958745 (+ 202us) service_pool.cc:224] Handling call
0619 19:54:12.878817 (+3920072us) ts_tablet_manager.cc:1151] Deleting tablet 180c3fd33d854a06a7cfd2f9671557a7
0619 19:54:12.878826 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.878907 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3817822}
W20260619 19:54:12.879385 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 180c3fd33d854a06a7cfd2f9671557a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 180c3fd33d854a06a7cfd2f9671557a7 already in progress: creating tablet
I20260619 19:54:12.879668 719 leader_election.cc:304] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:12.880015 2314 raft_consensus.cc:2804] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:12.880086 2314 raft_consensus.cc:493] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:12.880141 2314 raft_consensus.cc:3060] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.880769 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:12.881124 2026 ts_tablet_manager.cc:1929] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:12.881223 2026 log.cc:1199] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/eb4b1e87f2e84bcaaa07ff9f687b9e3d
W20260619 19:54:12.881457 859 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.881524 2026 ts_tablet_manager.cc:1950] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.881563 859 leader_election.cc:304] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.881788 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 230) took 9370 ms. Trace:
I20260619 19:54:12.881855 2026 rpcz_store.cc:276] 0619 19:54:03.510869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.791680 (+280811us) service_pool.cc:224] Handling call
0619 19:54:12.869122 (+9077442us) ts_tablet_manager.cc:1151] Deleting tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
0619 19:54:12.869130 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.877623 (+ 8493us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.881068 (+ 3445us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.881769 (+ 701us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9077218}
I20260619 19:54:12.882048 2539 raft_consensus.cc:2749] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.882269 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d (table default.Table_384d87b1154345fd9feaa4bac544af49 [id=282cf765f9e04a38a724e2d4a6f3245c]) successfully deleted
I20260619 19:54:12.882419 1200 tablet_bootstrap.cc:492] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:12.882567 2026 tablet_replica.cc:333] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.882680 2314 raft_consensus.cc:515] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.882777 2026 raft_consensus.cc:2243] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.882929 2026 raft_consensus.cc:2272] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.883191 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf175c80483346788a148b7277b9ca9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:12.883376 1059 raft_consensus.cc:2468] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:12.884986 2026 ts_tablet_manager.cc:1916] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.885838 2694 raft_consensus.cc:515] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.886821 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d905e7076014c818e1fb1ef09c15342" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:12.887380 996 leader_election.cc:343] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.890949 2026 ts_tablet_manager.cc:1929] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:12.891079 2026 log.cc:1199] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:12.891379 2026 ts_tablet_manager.cc:1950] T 10f6e202e8fd4a7292774d5eb4c7266b P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.891676 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 231) took 9380 ms. Trace:
I20260619 19:54:12.891752 2026 rpcz_store.cc:276] 0619 19:54:03.511020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.791922 (+280902us) service_pool.cc:224] Handling call
0619 19:54:12.882516 (+9090594us) ts_tablet_manager.cc:1151] Deleting tablet 10f6e202e8fd4a7292774d5eb4c7266b
0619 19:54:12.882527 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.887998 (+ 5471us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.890887 (+ 2889us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.891662 (+ 775us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9090079}
I20260619 19:54:12.892426 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 10f6e202e8fd4a7292774d5eb4c7266b (table default.Table_6d1f0f1124cb46138d7584cfd183ea34 [id=8eaf4a5b0ebb448bbb0fdd09953c2bd3]) successfully deleted
I20260619 19:54:12.899195 2026 tablet_replica.cc:333] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.899441 2757 raft_consensus.cc:493] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.899627 2757 raft_consensus.cc:515] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.899987 2026 raft_consensus.cc:2243] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:12.900362 2757 leader_election.cc:290] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.900786 2026 raft_consensus.cc:2272] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.901870 2026 ts_tablet_manager.cc:1916] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.902002 720 leader_election.cc:343] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 2c71f92f4e3040c09b67e287a19eea74
I20260619 19:54:12.904481 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71f92f4e3040c09b67e287a19eea74" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:12.907109 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 431) took 3948 ms. Trace:
W20260619 19:54:12.907356 719 leader_election.cc:343] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.907488 719 leader_election.cc:304] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.908027 2757 raft_consensus.cc:2749] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.909170 2694 leader_election.cc:290] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.909614 2314 leader_election.cc:290] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.910218 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf175c80483346788a148b7277b9ca9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:12.910386 1059 raft_consensus.cc:3060] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.911103 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d905e7076014c818e1fb1ef09c15342" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:12.911305 915 raft_consensus.cc:3060] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.913417 1059 raft_consensus.cc:2468] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:12.913714 2539 raft_consensus.cc:493] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.913851 2539 raft_consensus.cc:515] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:12.914036 720 leader_election.cc:304] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:12.914505 2539 leader_election.cc:290] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:12.914796 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf175c80483346788a148b7277b9ca9d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:12.914942 919 raft_consensus.cc:3060] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.915323 915 raft_consensus.cc:2468] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:12.915683 996 leader_election.cc:304] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:12.917526 919 raft_consensus.cc:2468] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:12.919813 2539 raft_consensus.cc:493] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.919937 2539 raft_consensus.cc:515] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.920151 2744 raft_consensus.cc:2804] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:12.920266 2744 raft_consensus.cc:697] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:12.920557 2539 leader_election.cc:290] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.920490 2744 consensus_queue.cc:237] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.921793 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe814880d9984bbd83fa121cb2a34eac" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:12.921965 1053 raft_consensus.cc:2468] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:12.922360 859 leader_election.cc:304] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:12.922629 2539 raft_consensus.cc:2804] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:12.922703 2539 raft_consensus.cc:493] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:12.922758 2539 raft_consensus.cc:3060] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.923297 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f72aa268721148b1a73f7b43cb0b6d1a" } modify_external_catalogs: true
I20260619 19:54:12.923506 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f72aa268721148b1a73f7b43cb0b6d1a" } modify_external_catalogs: true
W20260619 19:54:12.924618 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 798c54ef8cde4020903153f72d6e3b1a consensus state has no leader
I20260619 19:54:12.924985 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7fc3a132e7904368aaeb4545946fed07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:12.925450 2539 raft_consensus.cc:515] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:12.925555 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fc3a132e7904368aaeb4545946fed07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:12.926115 858 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:12.926560 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe814880d9984bbd83fa121cb2a34eac" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.926745 785 raft_consensus.cc:2468] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:12.926750 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe814880d9984bbd83fa121cb2a34eac" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:12.926923 1053 raft_consensus.cc:3060] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:12.927541 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a39b06bad874a5d8c945c27c3552d43 consensus state has no leader
I20260619 19:54:12.927891 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9fa8c861b0b0409cae36b17be2580b3c" } modify_external_catalogs: true
I20260619 19:54:12.927942 2314 raft_consensus.cc:2804] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:12.928038 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9fa8c861b0b0409cae36b17be2580b3c" } modify_external_catalogs: true
I20260619 19:54:12.928570 2314 raft_consensus.cc:697] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:12.928818 2314 consensus_queue.cc:237] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.928987 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_18b53a705e3848fdb3172af3e7f87b4e" } modify_external_catalogs: true
I20260619 19:54:12.929137 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_18b53a705e3848fdb3172af3e7f87b4e" } modify_external_catalogs: true
I20260619 19:54:12.930305 1053 raft_consensus.cc:2468] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:12.930682 859 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:12.930801 859 leader_election.cc:304] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.931088 2715 raft_consensus.cc:2749] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.931324 859 leader_election.cc:304] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:12.931586 2715 raft_consensus.cc:2804] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:12.931682 2715 raft_consensus.cc:697] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:12.931988 2715 consensus_queue.cc:237] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.933784 2539 leader_election.cc:290] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.935523 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe814880d9984bbd83fa121cb2a34eac" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:12.935752 785 raft_consensus.cc:3060] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:12.938704 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 642e0199fd244f7e927bf7abf231327d from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:12.945629 2757 raft_consensus.cc:493] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.945812 2757 raft_consensus.cc:515] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.947120 2026 ts_tablet_manager.cc:1929] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:12.947995 2026 log.cc:1199] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/0b55debc1b064192a56d2453364ba260
I20260619 19:54:12.948006 1200 tablet_bootstrap.cc:654] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:12.948348 2026 ts_tablet_manager.cc:1950] T 0b55debc1b064192a56d2453364ba260 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.948673 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 232) took 9437 ms. Trace:
I20260619 19:54:12.949039 2757 leader_election.cc:290] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:12.949858 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:12.949636 2026 rpcz_store.cc:276] 0619 19:54:03.511160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.792451 (+281291us) service_pool.cc:224] Handling call
0619 19:54:12.899102 (+9106651us) ts_tablet_manager.cc:1151] Deleting tablet 0b55debc1b064192a56d2453364ba260
0619 19:54:12.899115 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.917805 (+ 18690us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.947048 (+ 29243us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.948656 (+ 1608us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9106455}
I20260619 19:54:12.950845 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 233) took 9439 ms. Trace:
I20260619 19:54:12.950963 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 0b55debc1b064192a56d2453364ba260 (table default.Table_6ce0d03b39e0413b802982083364ec9e [id=80a235a0a08f4596ab75df8db6bee4c7]) successfully deleted
I20260619 19:54:12.950588 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce88d3d4ea340dcaa9d8e26f9a047a7" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:12.951259 2026 rpcz_store.cc:276] 0619 19:54:03.511334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.792650 (+281316us) service_pool.cc:224] Handling call
0619 19:54:12.950753 (+9158103us) ts_tablet_manager.cc:1151] Deleting tablet 0dd210e843db4f58a976af5c28dabc9c
0619 19:54:12.950762 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.950829 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9157880}
I20260619 19:54:12.951539 2026 tablet_replica.cc:333] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.951735 2026 raft_consensus.cc:2243] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:12.951768 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 0dd210e843db4f58a976af5c28dabc9c because the tablet was not found. No further retry: Not found: Tablet not found: 0dd210e843db4f58a976af5c28dabc9c
I20260619 19:54:12.951893 2026 raft_consensus.cc:2272] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.952345 719 leader_election.cc:304] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.952409 2026 ts_tablet_manager.cc:1916] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.952806 2757 raft_consensus.cc:2749] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.958984 785 raft_consensus.cc:2468] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:12.963009 2694 consensus_queue.cc:1048] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:12.967679 2026 ts_tablet_manager.cc:1929] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:12.968281 2026 log.cc:1199] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/56ba47943b9d4123985ea6ca1478cd93
I20260619 19:54:12.969579 2026 ts_tablet_manager.cc:1950] T 56ba47943b9d4123985ea6ca1478cd93 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.970295 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 234) took 9458 ms. Trace:
I20260619 19:54:12.970763 2026 rpcz_store.cc:276] 0619 19:54:03.511454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.792883 (+281429us) service_pool.cc:224] Handling call
0619 19:54:12.951498 (+9158615us) ts_tablet_manager.cc:1151] Deleting tablet 56ba47943b9d4123985ea6ca1478cd93
0619 19:54:12.951506 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.955758 (+ 4252us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.967606 (+ 11848us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.970281 (+ 2675us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9158431}
I20260619 19:54:12.971364 2026 tablet_replica.cc:333] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.971560 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 56ba47943b9d4123985ea6ca1478cd93 (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]) successfully deleted
I20260619 19:54:12.971803 2026 raft_consensus.cc:2243] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.971966 2026 raft_consensus.cc:2272] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:12.972528 2026 ts_tablet_manager.cc:1916] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:12.982189 2026 ts_tablet_manager.cc:1929] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:12.983834 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1359dd33e7b946c286bbe8c1ec8ebad5
I20260619 19:54:12.984647 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a3f0b91866884789b9a1ddc76a59ca8f" } new_table_name: "default.Table_ca89a774eca447f98006c1b978ac498a" modify_external_catalogs: true
I20260619 19:54:12.985011 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.985805 2026 log.cc:1199] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/68788824224b426bb433b87763073bae
I20260619 19:54:12.985935 2269 raft_consensus.cc:493] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:12.986138 2026 ts_tablet_manager.cc:1950] T 68788824224b426bb433b87763073bae P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:12.986068 2269 raft_consensus.cc:515] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:12.986413 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 235) took 9474 ms. Trace:
I20260619 19:54:12.986474 2026 rpcz_store.cc:276] 0619 19:54:03.511565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.793075 (+281510us) service_pool.cc:224] Handling call
0619 19:54:12.971317 (+9178242us) ts_tablet_manager.cc:1151] Deleting tablet 68788824224b426bb433b87763073bae
0619 19:54:12.971327 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.979331 (+ 8004us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.982129 (+ 2798us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:12.986398 (+ 4269us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9178027}
I20260619 19:54:12.986680 2269 leader_election.cc:290] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:12.987639 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:12.987632 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:12.988497 859 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.988621 2026 tablet_replica.cc:333] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:12.988796 2026 raft_consensus.cc:2243] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:12.989236 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:12.989392 2026 raft_consensus.cc:2272] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:12.989439 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 because the tablet was not found. No further retry: Not found: Tablet not found: 1359dd33e7b946c286bbe8c1ec8ebad5
I20260619 19:54:12.989801 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 17ce8540ee2846198786b8e215275641
I20260619 19:54:12.989827 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:12.989930 2026 ts_tablet_manager.cc:1916] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:12.990136 858 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:12.990222 858 leader_election.cc:304] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:12.990554 2269 raft_consensus.cc:2749] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:12.990478 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_801d5b341fe94df38040e5987a924d1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:12.991068 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_801d5b341fe94df38040e5987a924d1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:12.992760 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ce8540ee2846198786b8e215275641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:12.993749 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ce8540ee2846198786b8e215275641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:12.995241 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 17ce8540ee2846198786b8e215275641 because the tablet was not found. No further retry: Not found: Tablet not found: 17ce8540ee2846198786b8e215275641
I20260619 19:54:12.995630 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ce8540ee2846198786b8e215275641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.000770 2026 ts_tablet_manager.cc:1929] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:13.003247 2026 log.cc:1199] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/4b88dd7d19514e83857e2c6108291b9f
I20260619 19:54:13.003870 2026 ts_tablet_manager.cc:1950] T 4b88dd7d19514e83857e2c6108291b9f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.004643 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 236) took 9492 ms. Trace:
I20260619 19:54:13.005170 2026 rpcz_store.cc:276] 0619 19:54:03.511709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.793299 (+281590us) service_pool.cc:224] Handling call
0619 19:54:12.988563 (+9195264us) ts_tablet_manager.cc:1151] Deleting tablet 4b88dd7d19514e83857e2c6108291b9f
0619 19:54:12.988573 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.992769 (+ 4196us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.000700 (+ 7931us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.004625 (+ 3925us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9195086}
I20260619 19:54:13.005991 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 4b88dd7d19514e83857e2c6108291b9f (table default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]) successfully deleted
I20260619 19:54:13.006408 2026 tablet_replica.cc:333] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:13.006814 2026 raft_consensus.cc:2243] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:13.006896 1200 tablet_bootstrap.cc:492] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.007400 2026 raft_consensus.cc:2272] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.008729 2026 ts_tablet_manager.cc:1916] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.014498 531 master_service.cc:960] ReplaceTablet: received request to replace tablet 6da56cd05ea740eb949abb9bba60760a from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:13.016623 1201 tablet_bootstrap.cc:492] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:13.023886 1200 ts_tablet_manager.cc:1403] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.142s user 0.003s sys 0.001s
I20260619 19:54:13.024664 2314 raft_consensus.cc:493] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.024757 1200 raft_consensus.cc:359] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.025033 1200 raft_consensus.cc:385] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.025121 1200 raft_consensus.cc:740] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.025449 1200 consensus_queue.cc:260] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.026016 1200 ts_tablet_manager.cc:1434] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:13.026317 1200 tablet_bootstrap.cc:492] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.027820 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0d3189fcabab4e4d898b875f885c0c30" } new_table_name: "default.Table_7d9c20bff50a4be7a07b75cb792f2725" modify_external_catalogs: true
I20260619 19:54:13.035633 687 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 17ce8540ee2846198786b8e215275641
I20260619 19:54:13.036679 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ce8540ee2846198786b8e215275641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.037022 687 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1359dd33e7b946c286bbe8c1ec8ebad5
W20260619 19:54:13.038626 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 17ce8540ee2846198786b8e215275641 because the tablet was not found. No further retry: Not found: Tablet not found: 17ce8540ee2846198786b8e215275641
I20260619 19:54:13.038875 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:13.039592 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 because the tablet was not found. No further retry: Not found: Tablet not found: 1359dd33e7b946c286bbe8c1ec8ebad5
I20260619 19:54:13.040503 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7d3ab2751649f4b9fe54b88bb1eca2 (DEFAULT_TABLE table=default.Table_fa04a3fc676f423db521f04052e2b148 [id=195011c6c79049eb97667db3b9890951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.041080 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7d3ab2751649f4b9fe54b88bb1eca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.022492 2026 ts_tablet_manager.cc:1929] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:13.035074 2715 raft_consensus.cc:493] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.043292 1201 ts_tablet_manager.cc:1403] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.172s user 0.005s sys 0.000s
I20260619 19:54:13.037077 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ce8540ee2846198786b8e215275641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.043375 2715 raft_consensus.cc:515] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.037992 2539 raft_consensus.cc:493] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.043987 2539 raft_consensus.cc:515] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.044180 2715 leader_election.cc:290] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.043287 2026 log.cc:1199] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/b8e3354ae6dd46bd9c5414d4c4a720a1
I20260619 19:54:13.044502 2539 leader_election.cc:290] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.038156 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.044709 2026 ts_tablet_manager.cc:1950] T b8e3354ae6dd46bd9c5414d4c4a720a1 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.045461 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 237) took 9533 ms. Trace:
I20260619 19:54:13.045552 2026 rpcz_store.cc:276] 0619 19:54:03.511828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.793496 (+281668us) service_pool.cc:224] Handling call
0619 19:54:13.006359 (+9212863us) ts_tablet_manager.cc:1151] Deleting tablet b8e3354ae6dd46bd9c5414d4c4a720a1
0619 19:54:13.006369 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.015852 (+ 9483us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.022417 (+ 6565us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.045440 (+ 23023us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9212669}
I20260619 19:54:13.045861 2026 tablet_replica.cc:333] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:13.045980 1201 raft_consensus.cc:359] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.046124 1201 raft_consensus.cc:385] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.046170 1201 raft_consensus.cc:740] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.046301 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08fc0181e5642d0a2b7967ff30d4eaa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:13.046332 1201 consensus_queue.cc:260] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.046489 1053 raft_consensus.cc:2468] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:13.046749 1201 ts_tablet_manager.cc:1434] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260619 19:54:13.046993 1201 tablet_bootstrap.cc:492] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:13.047047 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet b8e3354ae6dd46bd9c5414d4c4a720a1 (table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]) successfully deleted
I20260619 19:54:13.043403 2269 raft_consensus.cc:493] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.047288 859 leader_election.cc:304] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.047425 2269 raft_consensus.cc:515] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.047561 2539 raft_consensus.cc:2804] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:13.047617 2539 raft_consensus.cc:493] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:13.047674 2539 raft_consensus.cc:3060] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.048122 2269 leader_election.cc:290] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.046041 2026 raft_consensus.cc:2243] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.048390 2026 raft_consensus.cc:2272] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.048797 1201 tablet_bootstrap.cc:654] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.048898 2026 ts_tablet_manager.cc:1916] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.050519 2539 raft_consensus.cc:515] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.051025 2539 leader_election.cc:290] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.052728 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08fc0181e5642d0a2b7967ff30d4eaa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:13.052876 1057 raft_consensus.cc:3060] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.054911 2026 ts_tablet_manager.cc:1929] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:13.055056 2026 log.cc:1199] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:54:13.052678 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b365df01054338a056cb0d469bc8db" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:13.055287 1053 raft_consensus.cc:2468] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:13.055526 2026 ts_tablet_manager.cc:1950] T f6c6ad82f0c94e27b2eb4dbf185fab66 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.056242 859 leader_election.cc:304] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.056314 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 238) took 9544 ms. Trace:
I20260619 19:54:13.056514 2269 raft_consensus.cc:2804] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:13.056603 2269 raft_consensus.cc:493] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:13.056658 2269 raft_consensus.cc:3060] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.057257 1057 raft_consensus.cc:2468] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:13.058207 859 leader_election.cc:304] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.058550 2715 raft_consensus.cc:2804] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:13.058665 2715 raft_consensus.cc:697] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:13.058892 2715 consensus_queue.cc:237] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.059502 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 74813bf79789451f90bcf7779aff9290
I20260619 19:54:13.059978 525 catalog_manager.cc:6784] ReplaceTablet: tablet 74813bf79789451f90bcf7779aff9290 deleted and replaced by tablet 267319f83f5440cb986952279320648f
I20260619 19:54:13.060250 2269 raft_consensus.cc:515] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.060395 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_eb3dbd1f613f4df8ab088d7b8bcd8c33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.060967 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb3dbd1f613f4df8ab088d7b8bcd8c33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.061326 2269 leader_election.cc:290] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.056501 2026 rpcz_store.cc:276] 0619 19:54:03.511973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.793699 (+281726us) service_pool.cc:224] Handling call
0619 19:54:13.045812 (+9252113us) ts_tablet_manager.cc:1151] Deleting tablet f6c6ad82f0c94e27b2eb4dbf185fab66
0619 19:54:13.045823 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.051691 (+ 5868us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.054854 (+ 3163us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.056297 (+ 1443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9251929}
I20260619 19:54:13.061653 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b365df01054338a056cb0d469bc8db" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:13.061874 1057 raft_consensus.cc:3060] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.062022 2026 tablet_replica.cc:333] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:13.062235 2026 raft_consensus.cc:2243] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.062372 2026 raft_consensus.cc:2272] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.062872 2026 ts_tablet_manager.cc:1916] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.064509 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:13.064742 529 catalog_manager.cc:5696] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } }
I20260619 19:54:13.065116 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:13.065328 529 catalog_manager.cc:5696] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:13.065977 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:13.066263 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:13.066445 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
W20260619 19:54:13.068077 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd8a4eb92c604f58adc35919f6bee273 consensus state has no leader
I20260619 19:54:13.068457 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4310c3d1b2cf4ad0841fee7480e05bf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.069029 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4310c3d1b2cf4ad0841fee7480e05bf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.070343 1057 raft_consensus.cc:2468] T 97b365df01054338a056cb0d469bc8db P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:13.070849 859 leader_election.cc:304] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.070920 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 74813bf79789451f90bcf7779aff9290 with delete_type TABLET_DATA_DELETED (replaced by tablet 267319f83f5440cb986952279320648f) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.071166 2747 consensus_queue.cc:1048] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:13.072033 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 74813bf79789451f90bcf7779aff9290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74813bf79789451f90bcf7779aff9290 already in progress: creating tablet
I20260619 19:54:13.072137 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:13.072302 1059 raft_consensus.cc:2468] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:13.072480 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (table default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]) successfully deleted
I20260619 19:54:13.072984 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 74813bf79789451f90bcf7779aff9290 with delete_type TABLET_DATA_DELETED (replaced by tablet 267319f83f5440cb986952279320648f) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.073012 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6da56cd05ea740eb949abb9bba60760a
I20260619 19:54:13.073359 859 leader_election.cc:304] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.073433 531 catalog_manager.cc:6784] ReplaceTablet: tablet 6da56cd05ea740eb949abb9bba60760a deleted and replaced by tablet dea574d64d5f4a619bb1f3ffd53fe3f1
I20260619 19:54:13.073613 2909 raft_consensus.cc:2804] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:13.073839 2269 raft_consensus.cc:2804] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:13.073935 2269 raft_consensus.cc:493] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:13.073804 2909 raft_consensus.cc:697] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:13.073858 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:13.073998 2269 raft_consensus.cc:3060] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.074198 2909 consensus_queue.cc:237] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:13.074470 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.076010 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da56cd05ea740eb949abb9bba60760a with delete_type TABLET_DATA_DELETED (replaced by tablet dea574d64d5f4a619bb1f3ffd53fe3f1) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.076323 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:13.076681 2269 raft_consensus.cc:515] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.077126 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6a2d2bb3927d4217b9a2e9f2958673d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:13.077605 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da56cd05ea740eb949abb9bba60760a with delete_type TABLET_DATA_DELETED (replaced by tablet dea574d64d5f4a619bb1f3ffd53fe3f1) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:13.077745 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a2d2bb3927d4217b9a2e9f2958673d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.078496 2269 leader_election.cc:290] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.078583 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:13.078784 1059 raft_consensus.cc:3060] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:13.080174 527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 251) took 1374 ms (client timeout 1000 ms). Trace:
W20260619 19:54:13.080303 527 rpcz_store.cc:269] 0619 19:54:11.705983 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.961176 (+255193us) service_pool.cc:224] Handling call
0619 19:54:12.025169 (+ 63993us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:13.080104 (+1054935us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:12.608934 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:12.609091 (+ 157us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:12.609095 (+ 4us) write_op.cc:435] Acquired schema lock
0619 19:54:12.609097 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:12.609224 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:12.609232 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:12.609236 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:12.609334 (+ 98us) tablet.cc:701] Row locks acquired
0619 19:54:12.609337 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:12.609369 (+ 32us) write_op.cc:270] Start()
0619 19:54:12.609394 (+ 25us) write_op.cc:276] Timestamp: P: 1781898852609345 usec, L: 0
0619 19:54:12.609397 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:12.609550 (+ 153us) log.cc:844] Serialized 913 byte log entry
0619 19:54:12.661665 (+ 52115us) op_driver.cc:464] REPLICATION: finished
0619 19:54:12.663333 (+ 1668us) write_op.cc:301] APPLY: starting
0619 19:54:12.663360 (+ 27us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:12.663388 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:12.663415 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:12.663467 (+ 52us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:12.663503 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:12.663509 (+ 6us) write_op.cc:312] APPLY: finished
0619 19:54:12.663561 (+ 52us) log.cc:844] Serialized 29 byte log entry
0619 19:54:12.663603 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.663618 (+ 15us) write_op.cc:454] Released schema lock
0619 19:54:12.663624 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:12.663710 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.663717 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":145095424,"child_traces":[["op",{"apply.queue_time_us":1637,"apply.run_cpu_time_us":369,"apply.run_wall_time_us":369,"num_ops":2,"prepare.queue_time_us":118216,"prepare.run_cpu_time_us":681,"prepare.run_wall_time_us":949,"replication_time_us":52253}]]}
I20260619 19:54:13.081878 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e996cd4a2ce04c02a10ef16acb8d545b" } modify_external_catalogs: true
I20260619 19:54:13.082211 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e996cd4a2ce04c02a10ef16acb8d545b" } modify_external_catalogs: true
W20260619 19:54:13.084352 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6da56cd05ea740eb949abb9bba60760a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da56cd05ea740eb949abb9bba60760a already in progress: creating tablet
I20260619 19:54:13.085081 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.086704 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_19bc418b3c714dd09369d232f417db60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:13.087430 2026 ts_tablet_manager.cc:1929] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:13.087546 2026 log.cc:1199] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/8bc11c632b514118856ea4c11b431142
W20260619 19:54:13.088114 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19bc418b3c714dd09369d232f417db60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.088079 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.088398 1994 tablet_replica.cc:333] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:13.088704 1994 raft_consensus.cc:2243] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:13.088737 2026 ts_tablet_manager.cc:1950] T 8bc11c632b514118856ea4c11b431142 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.088905 1994 pending_rounds.cc:70] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:13.088968 1994 pending_rounds.cc:77] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657698246017024 op_type: NO_OP noop_request { }
I20260619 19:54:13.089087 1994 raft_consensus.cc:2889] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:13.089190 1994 raft_consensus.cc:2272] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.090107 1994 ts_tablet_manager.cc:1916] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.084919 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08fc0181e5642d0a2b7967ff30d4eaa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.095317 783 raft_consensus.cc:2468] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:13.085193 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c08fc0181e5642d0a2b7967ff30d4eaa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:13.095672 777 raft_consensus.cc:3060] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.097314 1994 ts_tablet_manager.cc:1929] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:13.097427 1994 log.cc:1199] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:13.097811 1994 ts_tablet_manager.cc:1950] T 4023cceb8d9447c9952951c1d6bcdf00 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:13.098431 777 raft_consensus.cc:2468] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:13.085311 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.085541 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b365df01054338a056cb0d469bc8db" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.085750 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b365df01054338a056cb0d469bc8db" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:13.085994 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:13.086308 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 17ce8540ee2846198786b8e215275641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.086618 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.087218 765 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7d3ab2751649f4b9fe54b88bb1eca2 (DEFAULT_TABLE table=default.Table_fa04a3fc676f423db521f04052e2b148 [id=195011c6c79049eb97667db3b9890951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.099705 2314 raft_consensus.cc:515] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.099850 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 239) took 9587 ms. Trace:
I20260619 19:54:13.100752 2314 leader_election.cc:290] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.100159 2026 rpcz_store.cc:276] 0619 19:54:03.512085 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.793897 (+281812us) service_pool.cc:224] Handling call
0619 19:54:13.061948 (+9268051us) ts_tablet_manager.cc:1151] Deleting tablet 8bc11c632b514118856ea4c11b431142
0619 19:54:13.061961 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.067413 (+ 5452us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.087358 (+ 19945us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.099825 (+ 12467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968,"tablet-delete.queue_time_us":9267835}
I20260619 19:54:13.101722 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 8bc11c632b514118856ea4c11b431142 (table default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087]) successfully deleted
I20260619 19:54:13.102160 2026 tablet_replica.cc:333] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:13.102454 2026 raft_consensus.cc:2243] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.102949 2026 raft_consensus.cc:2272] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.104147 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8330e7df55694a7387cb9bdde32d2ba0
I20260619 19:54:13.104228 2026 ts_tablet_manager.cc:1916] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.104962 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cb2387c2679545209ee18439765a87e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.105660 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb2387c2679545209ee18439765a87e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.108407 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 8330e7df55694a7387cb9bdde32d2ba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.108628 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 8330e7df55694a7387cb9bdde32d2ba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:13.109588 720 leader_election.cc:343] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:54:13.126829 892 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7d3ab2751649f4b9fe54b88bb1eca2 (DEFAULT_TABLE table=default.Table_fa04a3fc676f423db521f04052e2b148 [id=195011c6c79049eb97667db3b9890951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.127364 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7d3ab2751649f4b9fe54b88bb1eca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:12.907315 1973 rpcz_store.cc:276] 0619 19:54:08.958931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.959198 (+ 267us) service_pool.cc:224] Handling call
0619 19:54:12.883555 (+3924357us) ts_tablet_manager.cc:1151] Deleting tablet 3ae6164970ec4977a8c0c9fd24ab7275
0619 19:54:12.906962 (+ 23407us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:12.907083 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3822470}
I20260619 19:54:13.131889 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 74813bf79789451f90bcf7779aff9290 with delete_type TABLET_DATA_DELETED (replaced by tablet 267319f83f5440cb986952279320648f) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.132385 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da56cd05ea740eb949abb9bba60760a with delete_type TABLET_DATA_DELETED (replaced by tablet dea574d64d5f4a619bb1f3ffd53fe3f1) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.132844 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.133275 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 8330e7df55694a7387cb9bdde32d2ba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:13.134588 858 leader_election.cc:343] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:13.136270 858 leader_election.cc:343] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:13.137007 858 leader_election.cc:343] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.137394 2917 tablet.cc:1724] T e8c3aef303b94d58aaa24917399ac240 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:13.138310 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 3ae6164970ec4977a8c0c9fd24ab7275 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae6164970ec4977a8c0c9fd24ab7275 already in progress: creating tablet
I20260619 19:54:13.138818 1200 tablet_bootstrap.cc:654] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.139204 2916 tablet.cc:1724] T e8c3aef303b94d58aaa24917399ac240 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260619 19:54:13.137562 858 leader_election.cc:343] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.141865 2026 ts_tablet_manager.cc:1929] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:13.139333 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 012be1c3857f4e01ab87318efc6dd8fa (DEFAULT_TABLE table=default.Table_5f46bc1a728a4da69e53ef6519b4e5a1 [id=e93621184b494a0c8c6690572c19939f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.142920 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012be1c3857f4e01ab87318efc6dd8fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.142956 1208 tablet_bootstrap.cc:492] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:13.143096 1208 ts_tablet_manager.cc:1403] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.349s user 0.010s sys 0.004s
I20260619 19:54:13.148154 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7d3ab2751649f4b9fe54b88bb1eca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.148326 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 429) took 4189 ms. Trace:
I20260619 19:54:13.148425 1973 rpcz_store.cc:276] 0619 19:54:08.958452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.958591 (+ 139us) service_pool.cc:224] Handling call
0619 19:54:13.131190 (+4172599us) ts_tablet_manager.cc:1151] Deleting tablet 3be362aa28504b729801de35d869beac
0619 19:54:13.148189 (+ 16999us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.148303 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4069937}
I20260619 19:54:13.148746 1973 tablet_replica.cc:333] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:13.148931 1973 raft_consensus.cc:2243] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:13.160884 1059 raft_consensus.cc:2468] T 5aaf38b6b7b14298ae0e73bc421de988 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:13.161442 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]) successfully deleted
W20260619 19:54:13.161770 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8330e7df55694a7387cb9bdde32d2ba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8330e7df55694a7387cb9bdde32d2ba0 already in progress: creating tablet
I20260619 19:54:13.163358 859 leader_election.cc:304] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.163995 2909 raft_consensus.cc:2804] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:13.164108 2909 raft_consensus.cc:697] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:13.164354 2909 consensus_queue.cc:237] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.164819 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cfacb03642c548889f249faa410f2c4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.165495 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfacb03642c548889f249faa410f2c4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:13.166720 719 leader_election.cc:343] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:54:13.166877 719 leader_election.cc:304] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.168550 2757 raft_consensus.cc:2749] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:13.169469 1201 tablet_bootstrap.cc:492] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:13.169669 1201 ts_tablet_manager.cc:1403] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.000s
W20260619 19:54:13.170226 720 consensus_peers.cc:597] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:13.170733 1973 raft_consensus.cc:2272] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.170660 1201 raft_consensus.cc:359] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.170915 1201 raft_consensus.cc:385] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.171000 1201 raft_consensus.cc:740] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.171064 2026 log.cc:1199] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:54:13.171630 2026 ts_tablet_manager.cc:1950] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.171717 1973 ts_tablet_manager.cc:1916] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.174494 892 tablet_service.cc:1511] Processing CreateTablet for tablet 012be1c3857f4e01ab87318efc6dd8fa (DEFAULT_TABLE table=default.Table_5f46bc1a728a4da69e53ef6519b4e5a1 [id=e93621184b494a0c8c6690572c19939f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.177698 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6afb529c194cb1b325c27cd4bdab6d (DEFAULT_TABLE table=default.Table_531872c50c2144e49bf65cf0832519b6 [id=48498151f7d346dd8fbd2cb6bc09253b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.178303 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6afb529c194cb1b325c27cd4bdab6d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:13.182024 720 consensus_peers.cc:597] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b88dd7d19514e83857e2c6108291b9f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:13.182348 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 240) took 9670 ms. Trace:
I20260619 19:54:13.182461 2026 rpcz_store.cc:276] 0619 19:54:03.512216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.794121 (+281905us) service_pool.cc:224] Handling call
0619 19:54:13.102079 (+9307958us) ts_tablet_manager.cc:1151] Deleting tablet f8a589ce3ae94cd1bb28b15e4e0e4a22
0619 19:54:13.102092 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.113463 (+ 11371us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.141805 (+ 28342us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.182328 (+ 40523us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9307786}
I20260619 19:54:13.183014 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (table default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]) successfully deleted
I20260619 19:54:13.183557 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 241) took 9671 ms. Trace:
I20260619 19:54:13.183684 2026 rpcz_store.cc:276] 0619 19:54:03.512313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.794295 (+281982us) service_pool.cc:224] Handling call
0619 19:54:13.183415 (+9389120us) ts_tablet_manager.cc:1151] Deleting tablet 05c9a91f95bb4bcdafe493bab8c393b4
0619 19:54:13.183425 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.183540 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9388911}
I20260619 19:54:13.184162 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012be1c3857f4e01ab87318efc6dd8fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:13.184217 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 05c9a91f95bb4bcdafe493bab8c393b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05c9a91f95bb4bcdafe493bab8c393b4 already in progress: creating tablet
I20260619 19:54:13.184573 1200 tablet_bootstrap.cc:492] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.184728 1200 ts_tablet_manager.cc:1403] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.158s user 0.001s sys 0.001s
I20260619 19:54:13.184769 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 242) took 9672 ms. Trace:
I20260619 19:54:13.184859 2026 rpcz_store.cc:276] 0619 19:54:03.512398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.794512 (+282114us) service_pool.cc:224] Handling call
0619 19:54:13.184649 (+9390137us) ts_tablet_manager.cc:1151] Deleting tablet e6dcf87d57044279a218cbb21c383352
0619 19:54:13.184660 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.184745 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9389970}
W20260619 19:54:13.185314 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e6dcf87d57044279a218cbb21c383352 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6dcf87d57044279a218cbb21c383352 already in progress: creating tablet
I20260619 19:54:13.185664 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 243) took 9673 ms. Trace:
I20260619 19:54:13.185753 2026 rpcz_store.cc:276] 0619 19:54:03.512477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.794684 (+282207us) service_pool.cc:224] Handling call
0619 19:54:13.185573 (+9390889us) ts_tablet_manager.cc:1151] Deleting tablet 33cfbae501de432cbcb34d2a6365f806
0619 19:54:13.185584 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.185646 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9390689}
I20260619 19:54:13.186023 1200 raft_consensus.cc:359] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:13.186162 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 33cfbae501de432cbcb34d2a6365f806 because the tablet was not found. No further retry: Not found: Tablet not found: 33cfbae501de432cbcb34d2a6365f806
I20260619 19:54:13.186211 1200 raft_consensus.cc:385] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.186267 1200 raft_consensus.cc:740] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.187273 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 244) took 9674 ms. Trace:
I20260619 19:54:13.187361 2026 rpcz_store.cc:276] 0619 19:54:03.512628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.794891 (+282263us) service_pool.cc:224] Handling call
0619 19:54:13.187185 (+9392294us) ts_tablet_manager.cc:1151] Deleting tablet bb56767231db42bebb75a45b5d512de3
0619 19:54:13.187194 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.187255 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9392075}
W20260619 19:54:13.187783 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet bb56767231db42bebb75a45b5d512de3 because the tablet was not found. No further retry: Not found: Tablet not found: bb56767231db42bebb75a45b5d512de3
I20260619 19:54:13.189116 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 246) took 9676 ms. Trace:
I20260619 19:54:13.189199 2026 rpcz_store.cc:276] 0619 19:54:03.512843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.882360 (+369517us) service_pool.cc:224] Handling call
0619 19:54:13.189002 (+9306642us) ts_tablet_manager.cc:1151] Deleting tablet dcc9c4167c58495fbfcf5fb60952c884
0619 19:54:13.189013 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.189098 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9294813}
W20260619 19:54:13.189615 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet dcc9c4167c58495fbfcf5fb60952c884 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcc9c4167c58495fbfcf5fb60952c884 already in progress: creating tablet
I20260619 19:54:13.189920 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9a0efe4dd74748209603d2df2323ea2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.190644 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a0efe4dd74748209603d2df2323ea2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.193264 2921 tablet.cc:1724] T e8c3aef303b94d58aaa24917399ac240 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:13.194092 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 251) took 9680 ms. Trace:
I20260619 19:54:13.194991 2026 rpcz_store.cc:276] 0619 19:54:03.513454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:03.936721 (+423267us) service_pool.cc:224] Handling call
0619 19:54:13.193966 (+9257245us) ts_tablet_manager.cc:1151] Deleting tablet 58e9d98ec1084b2ea9c087238686ed38
0619 19:54:13.193979 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.194068 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9256953}
W20260619 19:54:13.195675 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 58e9d98ec1084b2ea9c087238686ed38 because the tablet was not found. No further retry: Not found: Tablet not found: 58e9d98ec1084b2ea9c087238686ed38
I20260619 19:54:13.195638 1200 consensus_queue.cc:260] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.196791 2026 tablet_replica.cc:333] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:13.197187 2026 raft_consensus.cc:2243] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.197585 2026 raft_consensus.cc:2272] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.203083 891 tablet_service.cc:1511] Processing CreateTablet for tablet c256edf80b4f4e7c9c528611be588a01 (DEFAULT_TABLE table=default.Table_86c52c50e5004c9495abc628722903b2 [id=79186b0e58cc4f128dd4e84a7e0507b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.199268 888 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6afb529c194cb1b325c27cd4bdab6d (DEFAULT_TABLE table=default.Table_531872c50c2144e49bf65cf0832519b6 [id=48498151f7d346dd8fbd2cb6bc09253b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.203122 2026 ts_tablet_manager.cc:1916] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.200896 899 tablet_service.cc:1511] Processing CreateTablet for tablet 9c552ffad4f3492fab9c8df7c5bcf2cf (DEFAULT_TABLE table=default.Table_aa9ff8b3d180441e8598155135cb17f9 [id=01b8d4f7d2cc448da8fd950bb0723b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.203497 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c256edf80b4f4e7c9c528611be588a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.203673 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c552ffad4f3492fab9c8df7c5bcf2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.201117 2917 tablet.cc:1724] T 11e9d0ae96db4388a39a8b8f9c87187e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:13.207258 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6afb529c194cb1b325c27cd4bdab6d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:13.210640 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 3be362aa28504b729801de35d869beac because the tablet was not found. No further retry: Not found: Tablet not found: 3be362aa28504b729801de35d869beac
I20260619 19:54:13.220045 2314 raft_consensus.cc:493] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.220291 2314 raft_consensus.cc:515] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.221323 2314 leader_election.cc:290] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.224284 1200 ts_tablet_manager.cc:1434] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.039s user 0.003s sys 0.000s
I20260619 19:54:13.224628 1200 tablet_bootstrap.cc:492] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.225383 2921 tablet.cc:1724] T 11e9d0ae96db4388a39a8b8f9c87187e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:13.196014 2916 tablet.cc:1724] T 11e9d0ae96db4388a39a8b8f9c87187e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:13.230712 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ece67ba490164fbda8ded59ca42a5b12" } new_table_name: "default.Table_689a9b5fe2814be7abb33eaec0f6c9e0" modify_external_catalogs: true
I20260619 19:54:13.239459 1200 tablet_bootstrap.cc:654] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.199889 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 9c552ffad4f3492fab9c8df7c5bcf2cf (DEFAULT_TABLE table=default.Table_aa9ff8b3d180441e8598155135cb17f9 [id=01b8d4f7d2cc448da8fd950bb0723b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.202562 1025 tablet_service.cc:1511] Processing CreateTablet for tablet c256edf80b4f4e7c9c528611be588a01 (DEFAULT_TABLE table=default.Table_86c52c50e5004c9495abc628722903b2 [id=79186b0e58cc4f128dd4e84a7e0507b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.240226 2026 ts_tablet_manager.cc:1929] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:13.240330 2026 log.cc:1199] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/76ffe451545c4af6821971384fce483e
I20260619 19:54:13.240540 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c256edf80b4f4e7c9c528611be588a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.240672 2026 ts_tablet_manager.cc:1950] T 76ffe451545c4af6821971384fce483e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.210584 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 79bcc998cf6c4d3e851a437ccd2edb92 (DEFAULT_TABLE table=default.Table_88ebd05c9e0e449293d1245db9335476 [id=44bee1b87a8849d0a9b776bec059c47e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.243737 1201 consensus_queue.cc:260] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.244270 1201 ts_tablet_manager.cc:1434] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.074s user 0.003s sys 0.000s
I20260619 19:54:13.245393 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5fbfc5adf799430e85b4aa1130d23699" } new_table_name: "default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9" modify_external_catalogs: true
I20260619 19:54:13.246169 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bcc998cf6c4d3e851a437ccd2edb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.257236 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:13.259828 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:13.260350 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c552ffad4f3492fab9c8df7c5bcf2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.260469 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:13.260843 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:13.261003 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:13.261382 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_de336ee9cc7e4ed98d1983f3a46ced3c [id=043c20ae78a943e0bbf1c9a6753261b1] alter complete (version 2)
I20260619 19:54:13.267272 2744 raft_consensus.cc:493] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.267446 2744 raft_consensus.cc:515] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.268081 2744 leader_election.cc:290] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.269200 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:13.269830 996 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.279163 885 tablet_service.cc:1511] Processing CreateTablet for tablet 79bcc998cf6c4d3e851a437ccd2edb92 (DEFAULT_TABLE table=default.Table_88ebd05c9e0e449293d1245db9335476 [id=44bee1b87a8849d0a9b776bec059c47e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.281049 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2911b5cfd2494287432e818d4ae19e (DEFAULT_TABLE table=default.Table_66674465fc2640b383f68327c9e1d710 [id=1d9cae00e2c24b7495a8c9146e22a51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.283236 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_841448a18d3d49318e834d44004ae04e" } new_table_name: "default.Table_fa37ebefda5546aba81045109bedc993" modify_external_catalogs: true
I20260619 19:54:13.296382 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 32648df603ac442396922383ffbd2e31
I20260619 19:54:13.298223 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 32648df603ac442396922383ffbd2e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:13.299175 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 32648df603ac442396922383ffbd2e31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32648df603ac442396922383ffbd2e31 already in progress: creating tablet
I20260619 19:54:13.300917 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 32648df603ac442396922383ffbd2e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.301712 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4f89735ef1c44028bfb7e954222cd7ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.302446 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f89735ef1c44028bfb7e954222cd7ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.308262 1200 tablet_bootstrap.cc:492] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.308503 1200 ts_tablet_manager.cc:1403] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.015s
I20260619 19:54:13.309387 1200 raft_consensus.cc:359] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.309671 1200 raft_consensus.cc:385] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.309783 1200 raft_consensus.cc:740] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.310071 1200 consensus_queue.cc:260] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.310236 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2911b5cfd2494287432e818d4ae19e (DEFAULT_TABLE table=default.Table_66674465fc2640b383f68327c9e1d710 [id=1d9cae00e2c24b7495a8c9146e22a51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.310638 1200 ts_tablet_manager.cc:1434] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:13.310868 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2911b5cfd2494287432e818d4ae19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.311024 1200 tablet_bootstrap.cc:492] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.315412 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.315625 2909 raft_consensus.cc:493] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.315799 2909 raft_consensus.cc:515] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:13.309451 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 34f19f5ac03446a89376695b8321e820 (DEFAULT_TABLE table=default.Table_f7f8fcd03be04b6f9d979e221159d073 [id=29c3c8591c74416092b152ab091878ab]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:13.316146 996 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.316274 996 leader_election.cc:304] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.316411 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f19f5ac03446a89376695b8321e820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.316672 2744 raft_consensus.cc:2749] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.317229 2909 leader_election.cc:290] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:13.317975 859 leader_election.cc:343] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:13.318033 1200 tablet_bootstrap.cc:654] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.318975 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_027c74de9bf64a99bcca213da312268c" } modify_external_catalogs: true
I20260619 19:54:13.319239 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_027c74de9bf64a99bcca213da312268c" } modify_external_catalogs: true
I20260619 19:54:13.329217 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6d58f88d65ca4786a9a62876b3eeec0e (DEFAULT_TABLE table=default.Table_e51a6ce3d9ea48d09b42531d3923a957 [id=e09db6a239fb48b69f2b6e6bca817491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.329695 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d58f88d65ca4786a9a62876b3eeec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.332214 892 tablet_service.cc:1511] Processing CreateTablet for tablet 34f19f5ac03446a89376695b8321e820 (DEFAULT_TABLE table=default.Table_f7f8fcd03be04b6f9d979e221159d073 [id=29c3c8591c74416092b152ab091878ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.333845 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_299b0539a019486f9ab66bb6e24975a3" } modify_external_catalogs: true
I20260619 19:54:13.334076 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_299b0539a019486f9ab66bb6e24975a3" } modify_external_catalogs: true
I20260619 19:54:13.339257 1200 tablet_bootstrap.cc:492] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.339489 1200 ts_tablet_manager.cc:1403] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.002s
I20260619 19:54:13.340229 1200 raft_consensus.cc:359] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.340473 1200 raft_consensus.cc:385] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.340582 1200 raft_consensus.cc:740] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.340826 1200 consensus_queue.cc:260] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.343375 1200 ts_tablet_manager.cc:1434] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260619 19:54:13.343720 1200 tablet_bootstrap.cc:492] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.345422 1200 tablet_bootstrap.cc:654] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.353649 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3e72a44fedb84151ad4de6d4c8c4e528"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.354406 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e72a44fedb84151ad4de6d4c8c4e528 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.355975 2909 raft_consensus.cc:493] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.356184 2909 raft_consensus.cc:515] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:13.358016 2909 leader_election.cc:290] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:13.358655 859 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 90b8468df4a449d088f47b3b150ce54a
W20260619 19:54:13.364928 720 leader_election.cc:343] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 10f6e202e8fd4a7292774d5eb4c7266b
W20260619 19:54:13.365173 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 951dfc443c4944d0a44864184e0da9d4 consensus state has no leader
I20260619 19:54:13.365278 746 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6afb529c194cb1b325c27cd4bdab6d (DEFAULT_TABLE table=default.Table_531872c50c2144e49bf65cf0832519b6 [id=48498151f7d346dd8fbd2cb6bc09253b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.365751 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6d58f88d65ca4786a9a62876b3eeec0e (DEFAULT_TABLE table=default.Table_e51a6ce3d9ea48d09b42531d3923a957 [id=e09db6a239fb48b69f2b6e6bca817491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.365806 754 tablet_service.cc:1511] Processing CreateTablet for tablet 9c552ffad4f3492fab9c8df7c5bcf2cf (DEFAULT_TABLE table=default.Table_aa9ff8b3d180441e8598155135cb17f9 [id=01b8d4f7d2cc448da8fd950bb0723b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.366041 762 tablet_service.cc:1511] Processing CreateTablet for tablet c256edf80b4f4e7c9c528611be588a01 (DEFAULT_TABLE table=default.Table_86c52c50e5004c9495abc628722903b2 [id=79186b0e58cc4f128dd4e84a7e0507b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.366127 751 tablet_service.cc:1511] Processing CreateTablet for tablet 79bcc998cf6c4d3e851a437ccd2edb92 (DEFAULT_TABLE table=default.Table_88ebd05c9e0e449293d1245db9335476 [id=44bee1b87a8849d0a9b776bec059c47e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.366629 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2911b5cfd2494287432e818d4ae19e (DEFAULT_TABLE table=default.Table_66674465fc2640b383f68327c9e1d710 [id=1d9cae00e2c24b7495a8c9146e22a51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.367069 755 tablet_service.cc:1511] Processing CreateTablet for tablet 34f19f5ac03446a89376695b8321e820 (DEFAULT_TABLE table=default.Table_f7f8fcd03be04b6f9d979e221159d073 [id=29c3c8591c74416092b152ab091878ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.367429 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 32648df603ac442396922383ffbd2e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.365819 765 tablet_service.cc:1511] Processing CreateTablet for tablet 012be1c3857f4e01ab87318efc6dd8fa (DEFAULT_TABLE table=default.Table_5f46bc1a728a4da69e53ef6519b4e5a1 [id=e93621184b494a0c8c6690572c19939f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.378715 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6331efa968674c528aa9785a2ee9deb9" } new_table_name: "default.Table_7613312118cf43c7bddda4983d308290" modify_external_catalogs: true
I20260619 19:54:13.388024 1208 raft_consensus.cc:359] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.388504 1208 raft_consensus.cc:385] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.388660 1208 raft_consensus.cc:740] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.389043 1208 consensus_queue.cc:260] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.390295 1208 ts_tablet_manager.cc:1434] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.247s user 0.002s sys 0.000s
I20260619 19:54:13.390847 1208 tablet_bootstrap.cc:492] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:13.393009 884 tablet_service.cc:1511] Processing CreateTablet for tablet 6d58f88d65ca4786a9a62876b3eeec0e (DEFAULT_TABLE table=default.Table_e51a6ce3d9ea48d09b42531d3923a957 [id=e09db6a239fb48b69f2b6e6bca817491]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:13.394682 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6532bdfd3c844ff2a25bee6ff1e0c25e consensus state has no leader
I20260619 19:54:13.396802 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4e0bca12b7834af7a6690074fa09e1e8" } modify_external_catalogs: true
I20260619 19:54:13.397111 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4e0bca12b7834af7a6690074fa09e1e8" } modify_external_catalogs: true
I20260619 19:54:13.400298 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6617e8f0d86f45a19258d7453c8101fb (DEFAULT_TABLE table=default.Table_f18be194dbaa4a64b422513b3ce34908 [id=cd5a750dd8364d96ac8981d31f51550a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.400820 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6617e8f0d86f45a19258d7453c8101fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.401552 2909 raft_consensus.cc:493] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.401700 2909 raft_consensus.cc:515] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.402334 2909 leader_election.cc:290] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.404749 2909 raft_consensus.cc:493] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.404883 2909 raft_consensus.cc:515] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.405464 2909 leader_election.cc:290] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.405486 830 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
W20260619 19:54:13.406200 859 leader_election.cc:343] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 2c71f92f4e3040c09b67e287a19eea74
W20260619 19:54:13.404278 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 48231.5us
I20260619 19:54:13.409473 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_15a49a648c354897900ac3ea18195baa [id=52998f068e554dd7b19f353a041fda6a] alter complete (version 1)
I20260619 19:54:13.413411 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6afb529c194cb1b325c27cd4bdab6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.413663 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c256edf80b4f4e7c9c528611be588a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.413663 1200 tablet_bootstrap.cc:492] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.413794 1200 ts_tablet_manager.cc:1403] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.070s user 0.011s sys 0.006s
I20260619 19:54:13.413853 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2911b5cfd2494287432e818d4ae19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.414029 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012be1c3857f4e01ab87318efc6dd8fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.414659 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bcc998cf6c4d3e851a437ccd2edb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.414948 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c552ffad4f3492fab9c8df7c5bcf2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.415179 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d58f88d65ca4786a9a62876b3eeec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.415041 1200 raft_consensus.cc:359] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.415237 1200 raft_consensus.cc:385] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.415359 1200 raft_consensus.cc:740] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.415685 1200 consensus_queue.cc:260] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.415905 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f19f5ac03446a89376695b8321e820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.416320 1200 ts_tablet_manager.cc:1434] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:54:13.417033 2744 raft_consensus.cc:493] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.417163 2744 raft_consensus.cc:515] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.417806 2744 leader_election.cc:290] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.418979 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dcf87d57044279a218cbb21c383352" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:13.420262 1200 tablet_bootstrap.cc:492] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:13.420763 858 leader_election.cc:343] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:13.420879 858 leader_election.cc:304] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:13.421427 996 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.421710 2715 raft_consensus.cc:2749] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:54:13.419116 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dcf87d57044279a218cbb21c383352" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.422312 1200 tablet_bootstrap.cc:654] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:13.422335 996 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.422434 996 leader_election.cc:304] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.422819 2744 raft_consensus.cc:2749] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.423220 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:13.423864 859 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:13.426829 858 leader_election.cc:343] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:13.426967 858 leader_election.cc:304] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:13.427557 2374 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.587s user 0.050s sys 0.041s
W20260619 19:54:13.427729 2374 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.587s user 0.050s sys 0.041s
I20260619 19:54:13.427680 2539 raft_consensus.cc:2749] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.429947 532 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_f5566dfcba0c4225b2a141d7bcb7d135 [id=f1c35564785e48a6b6b465801f79ac2d] alter complete (version 3)
W20260619 19:54:13.431767 532 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 212) took 1061 ms (client timeout 1000 ms). Trace:
W20260619 19:54:13.431931 532 rpcz_store.cc:269] 0619 19:54:12.370517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.379875 (+ 9358us) service_pool.cc:224] Handling call
0619 19:54:12.417230 (+ 37355us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:13.431695 (+1014465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:12.784070 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:12.784185 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:12.784191 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:12.784193 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:12.784290 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:12.784304 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:12.784308 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:12.784364 (+ 56us) tablet.cc:701] Row locks acquired
0619 19:54:12.784366 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:12.823265 (+ 38899us) write_op.cc:270] Start()
0619 19:54:12.823310 (+ 45us) write_op.cc:276] Timestamp: P: 1781898852823200 usec, L: 0
0619 19:54:12.823314 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:12.823542 (+ 228us) log.cc:844] Serialized 356 byte log entry
0619 19:54:12.877452 (+ 53910us) op_driver.cc:464] REPLICATION: finished
0619 19:54:12.877594 (+ 142us) write_op.cc:301] APPLY: starting
0619 19:54:12.877615 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:12.877660 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:12.877696 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:12.877759 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:12.877795 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:12.877802 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:12.877887 (+ 85us) log.cc:844] Serialized 23 byte log entry
0619 19:54:12.877967 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.877988 (+ 21us) write_op.cc:454] Released schema lock
0619 19:54:12.877996 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:12.878084 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.878088 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:13.410534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:13.410756 (+ 222us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:13.410860 (+ 104us) write_op.cc:435] Acquired schema lock
0619 19:54:13.410863 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:13.411682 (+ 819us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:13.411862 (+ 180us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:13.411868 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:13.412285 (+ 417us) tablet.cc:701] Row locks acquired
0619 19:54:13.412288 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:13.412503 (+ 215us) write_op.cc:270] Start()
0619 19:54:13.412887 (+ 384us) write_op.cc:276] Timestamp: P: 1781898853412436 usec, L: 0
0619 19:54:13.412893 (+ 6us) op_driver.cc:348] REPLICATION: starting
0619 19:54:13.415189 (+ 2296us) log.cc:844] Serialized 356 byte log entry
0619 19:54:13.424979 (+ 9790us) op_driver.cc:464] REPLICATION: finished
0619 19:54:13.428765 (+ 3786us) write_op.cc:301] APPLY: starting
0619 19:54:13.428792 (+ 27us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:13.428903 (+ 111us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:13.428970 (+ 67us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:13.429083 (+ 113us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:13.429140 (+ 57us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:13.429153 (+ 13us) write_op.cc:312] APPLY: finished
0619 19:54:13.429322 (+ 169us) log.cc:844] Serialized 23 byte log entry
0619 19:54:13.429399 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:13.429423 (+ 24us) write_op.cc:454] Released schema lock
0619 19:54:13.429431 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":82850176,"child_traces":[["op",{"apply.queue_time_us":83,"apply.run_cpu_time_us":476,"apply.run_wall_time_us":475,"num_ops":1,"prepare.queue_time_us":101012,"prepare.run_cpu_time_us":771,"prepare.run_wall_time_us":40570,"raft.queue_time_us":48,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":262,"replication_time_us":54098}],["op",{"apply.queue_time_us":3669,"apply.run_cpu_time_us":765,"apply.run_wall_time_us":766,"num_ops":1,"prepare.queue_time_us":147769,"raft.queue_time_us":164,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":330,"replication_time_us":12049,"spinlock_wait_cycles":23424}]]}
I20260619 19:54:13.435007 1200 tablet_bootstrap.cc:492] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.435966 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bc11c632b514118856ea4c11b431142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.436081 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b55debc1b064192a56d2453364ba260 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.436146 902 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3354ae6dd46bd9c5414d4c4a720a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:58 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.436265 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.439471 1200 ts_tablet_manager.cc:1403] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.003s
I20260619 19:54:13.440394 1200 raft_consensus.cc:359] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.440584 1200 raft_consensus.cc:385] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.440637 1200 raft_consensus.cc:740] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.436403 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e4132f28c434492cbddc8da7d8075c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.436503 894 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.437625 903 tablet_service.cc:1558] Processing DeleteTablet for tablet fe814880d9984bbd83fa121cb2a34eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.440834 1200 consensus_queue.cc:260] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.442564 1200 ts_tablet_manager.cc:1434] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:13.443307 1200 tablet_bootstrap.cc:492] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.447116 1200 tablet_bootstrap.cc:654] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.449451 2314 consensus_queue.cc:1048] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:13.449680 719 leader_election.cc:343] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:13.449970 719 leader_election.cc:304] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.451114 2757 raft_consensus.cc:2749] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:13.451692 719 consensus_peers.cc:597] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Couldn't send request to peer 95181cc281b946c8b81aa825232d9498. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b88dd7d19514e83857e2c6108291b9f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:13.455382 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8ced5f8d284a4065bf67d55d8b216f0b" } modify_external_catalogs: true
I20260619 19:54:13.455641 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8ced5f8d284a4065bf67d55d8b216f0b" } modify_external_catalogs: true
I20260619 19:54:13.454880 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d84c42e7f7da440696e7684e3dd52ec2" } new_table_name: "default.Table_fe3e51ff1bae43e9ac85ce9276811c5d" modify_external_catalogs: true
W20260619 19:54:13.461084 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d40a944dbc9d4164a0100811bbadc6b5 consensus state has no leader
I20260619 19:54:13.465229 903 tablet_service.cc:1511] Processing CreateTablet for tablet 6617e8f0d86f45a19258d7453c8101fb (DEFAULT_TABLE table=default.Table_f18be194dbaa4a64b422513b3ce34908 [id=cd5a750dd8364d96ac8981d31f51550a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.465703 1200 tablet_bootstrap.cc:492] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.466007 1200 ts_tablet_manager.cc:1403] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260619 19:54:13.468613 531 catalog_manager.cc:5696] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:13.469520 531 catalog_manager.cc:5696] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:13.470109 531 catalog_manager.cc:5696] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:13.470563 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:13.475786 1200 raft_consensus.cc:359] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.476004 1200 raft_consensus.cc:385] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.476078 1200 raft_consensus.cc:740] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.481094 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c008f33c8ae74120a621a08954129d2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.481707 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c008f33c8ae74120a621a08954129d2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.483474 2744 raft_consensus.cc:493] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.483642 2744 raft_consensus.cc:515] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.484295 2744 leader_election.cc:290] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.485296 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f305a99e3481419196532cb5c62c2500" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:13.485519 919 raft_consensus.cc:2468] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:13.485963 996 leader_election.cc:304] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.486251 2744 raft_consensus.cc:2804] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:13.486322 2744 raft_consensus.cc:493] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:13.486384 2744 raft_consensus.cc:3060] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.489060 2744 raft_consensus.cc:515] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.489748 2744 leader_election.cc:290] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.490280 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f305a99e3481419196532cb5c62c2500" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:13.490859 996 leader_election.cc:343] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.491060 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f305a99e3481419196532cb5c62c2500" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:13.491292 919 raft_consensus.cc:3060] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.491868 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f305a99e3481419196532cb5c62c2500" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:13.492439 996 leader_election.cc:343] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.492399 1200 consensus_queue.cc:260] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.495270 1200 ts_tablet_manager.cc:1434] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.029s user 0.000s sys 0.001s
I20260619 19:54:13.499550 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 42a3f254125141bf8783626e669717d2
I20260619 19:54:13.500775 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7
I20260619 19:54:13.501376 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a3f254125141bf8783626e669717d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.504115 919 raft_consensus.cc:2468] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:13.504163 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e83f9ca778734ffba85a723a7f35ae4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.504519 529 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 252) took 803 ms (client timeout 1000 ms). Trace:
I20260619 19:54:13.504652 996 leader_election.cc:304] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.505077 2744 raft_consensus.cc:2804] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:13.505182 2744 raft_consensus.cc:697] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
W20260619 19:54:13.505246 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e83f9ca778734ffba85a723a7f35ae4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.505395 2744 consensus_queue.cc:237] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.505529 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0c7c9744697942fab3cbfc5fb0ea59ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.506052 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c7c9744697942fab3cbfc5fb0ea59ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.507050 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_31824e64fa474d55b20d52c779cb886f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.507615 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31824e64fa474d55b20d52c779cb886f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:13.504649 529 rpcz_store.cc:269] 0619 19:54:12.701073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.737122 (+ 36049us) service_pool.cc:224] Handling call
0619 19:54:13.504470 (+767348us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:13.246781 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:13.246873 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:13.246878 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:13.246881 (+ 3us) tablet.cc:662] Decoding operations
0619 19:54:13.246997 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:13.247011 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:13.247015 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:13.247109 (+ 94us) tablet.cc:701] Row locks acquired
0619 19:54:13.247112 (+ 3us) write_op.cc:260] PREPARE: finished
0619 19:54:13.247233 (+ 121us) write_op.cc:270] Start()
0619 19:54:13.247266 (+ 33us) write_op.cc:276] Timestamp: P: 1781898853247192 usec, L: 0
0619 19:54:13.247270 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:13.247907 (+ 637us) log.cc:844] Serialized 913 byte log entry
0619 19:54:13.251486 (+ 3579us) op_driver.cc:464] REPLICATION: finished
0619 19:54:13.251676 (+ 190us) write_op.cc:301] APPLY: starting
0619 19:54:13.251692 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:13.251744 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:13.251781 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:13.251854 (+ 73us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:13.251890 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:13.251897 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:13.251971 (+ 74us) log.cc:844] Serialized 29 byte log entry
0619 19:54:13.252034 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:13.252057 (+ 23us) write_op.cc:454] Released schema lock
0619 19:54:13.252064 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:13.267686 (+ 15622us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:13.267699 (+ 13us) write_op.cc:454] Released schema lock
Related trace 'op':
0619 19:54:13.396550 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:13.396821 (+ 271us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:13.396827 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:13.396829 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:13.397286 (+ 457us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:13.397334 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:13.397345 (+ 11us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:13.397658 (+ 313us) tablet.cc:701] Row locks acquired
0619 19:54:13.397663 (+ 5us) write_op.cc:260] PREPARE: finished
0619 19:54:13.397806 (+ 143us) write_op.cc:270] Start()
0619 19:54:13.398029 (+ 223us) write_op.cc:276] Timestamp: P: 1781898853397742 usec, L: 0
0619 19:54:13.398083 (+ 54us) op_driver.cc:348] REPLICATION: starting
0619 19:54:13.398606 (+ 523us) log.cc:844] Serialized 356 byte log entry
0619 19:54:13.407897 (+ 9291us) op_driver.cc:464] REPLICATION: finished
0619 19:54:13.408762 (+ 865us) write_op.cc:301] APPLY: starting
0619 19:54:13.408784 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:13.408840 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:13.408869 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:13.408942 (+ 73us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:13.408986 (+ 44us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:13.408999 (+ 13us) write_op.cc:312] APPLY: finished
0619 19:54:13.409103 (+ 104us) log.cc:844] Serialized 23 byte log entry
0619 19:54:13.409176 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:13.409204 (+ 28us) write_op.cc:454] Released schema lock
0619 19:54:13.409212 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:13.410339 (+ 1127us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:13.410349 (+ 10us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":135,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":449,"num_ops":2,"prepare.queue_time_us":155895,"prepare.run_cpu_time_us":864,"prepare.run_wall_time_us":20876,"raft.queue_time_us":47,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"replication_time_us":4185}],["op",{"apply.queue_time_us":792,"apply.run_cpu_time_us":530,"apply.run_wall_time_us":529,"num_ops":1,"prepare.queue_time_us":143134,"prepare.run_cpu_time_us":1545,"prepare.run_wall_time_us":13786,"raft.queue_time_us":79,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":294,"replication_time_us":9774}]]}
I20260619 19:54:13.508196 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7a29dba5616749f5bb313c159dee8c31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.508684 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a29dba5616749f5bb313c159dee8c31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.509500 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a3f254125141bf8783626e669717d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.510363 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.511806 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.512023 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 4023cceb8d9447c9952951c1d6bcdf00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:12 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.512184 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet bf175c80483346788a148b7277b9ca9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.512322 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d905e7076014c818e1fb1ef09c15342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.515887 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31218af79d4f9ca3eadaa11c5de847 (DEFAULT_TABLE table=default.Table_0e520375250b4b46ab3faccabdc1ceff [id=477ed5db09bd494190f5f4e3523a52dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.519073 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31218af79d4f9ca3eadaa11c5de847 (DEFAULT_TABLE table=default.Table_0e520375250b4b46ab3faccabdc1ceff [id=477ed5db09bd494190f5f4e3523a52dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.520776 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ee64505bfcdf49b5820754cbbf822165 (DEFAULT_TABLE table=default.Table_c453f79a82b94fc8b556c1272b0d609a [id=99fc685458cc4be681b77a23d6173903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.524631 894 tablet_service.cc:1511] Processing CreateTablet for tablet ee64505bfcdf49b5820754cbbf822165 (DEFAULT_TABLE table=default.Table_c453f79a82b94fc8b556c1272b0d609a [id=99fc685458cc4be681b77a23d6173903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.526841 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 41455237399b45efbe8190dcb01e764c
I20260619 19:54:13.526808 1036 tablet_service.cc:1511] Processing CreateTablet for tablet ee2b48219a234e7daf2a4bc12f250560 (DEFAULT_TABLE table=default.Table_d816fde10a7643eaa2813e6bf58bd23b [id=9f082bbc0a4244d898301009dda869f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.527549 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2b48219a234e7daf2a4bc12f250560. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:13.527798 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5482cf46c91d426484938c387b785d61 consensus state has no leader
I20260619 19:54:13.528131 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e3f4b47d0e7451d91add5a81330bc7d from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:13.530519 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 258) took 9272 ms. Trace:
I20260619 19:54:13.530647 2026 rpcz_store.cc:276] 0619 19:54:04.258104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.258999 (+ 895us) service_pool.cc:224] Handling call
0619 19:54:13.196739 (+8937740us) ts_tablet_manager.cc:1151] Deleting tablet 76ffe451545c4af6821971384fce483e
0619 19:54:13.196750 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.227263 (+ 30513us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.240148 (+ 12885us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.530492 (+290344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8929214}
I20260619 19:54:13.531092 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 259) took 9270 ms. Trace:
I20260619 19:54:13.531193 2026 rpcz_store.cc:276] 0619 19:54:04.260414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.260467 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:13.530962 (+9270495us) ts_tablet_manager.cc:1151] Deleting tablet 02c5f9405d6a4a16bd49697001c201e1
0619 19:54:13.530974 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.531076 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9204985}
I20260619 19:54:13.531430 2026 tablet_replica.cc:333] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:13.531617 2026 raft_consensus.cc:2243] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.531759 2026 raft_consensus.cc:2272] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.532387 2026 ts_tablet_manager.cc:1916] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.532866 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 41455237399b45efbe8190dcb01e764c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.534582 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 76ffe451545c4af6821971384fce483e (table default.Table_afcf8042005740d085932a1bf118aac1 [id=6db69342725341c49bfbc5ed058ae3dc]) successfully deleted
W20260619 19:54:13.535105 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 02c5f9405d6a4a16bd49697001c201e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02c5f9405d6a4a16bd49697001c201e1 already in progress: creating tablet
I20260619 19:54:13.535813 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bcc998cf6c4d3e851a437ccd2edb92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.536295 1200 tablet_bootstrap.cc:492] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.538107 1200 tablet_bootstrap.cc:654] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:13.539508 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 42a3f254125141bf8783626e669717d2 because the tablet was not found. No further retry: Not found: Tablet not found: 42a3f254125141bf8783626e669717d2
I20260619 19:54:13.540112 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31218af79d4f9ca3eadaa11c5de847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.540850 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2911b5cfd2494287432e818d4ae19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.541051 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d58f88d65ca4786a9a62876b3eeec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.543531 1994 tablet_replica.cc:333] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:13.543730 1994 raft_consensus.cc:2243] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.543901 1994 raft_consensus.cc:2272] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.544267 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6617e8f0d86f45a19258d7453c8101fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.544939 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31218af79d4f9ca3eadaa11c5de847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.547230 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f19f5ac03446a89376695b8321e820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.531759 1201 tablet_bootstrap.cc:492] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:13.549746 1201 tablet_bootstrap.cc:654] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.550660 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee64505bfcdf49b5820754cbbf822165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.555775 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee64505bfcdf49b5820754cbbf822165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.560051 1994 ts_tablet_manager.cc:1916] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.567816 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 41455237399b45efbe8190dcb01e764c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.578218 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3ddfe1bb8e174151b5872ee6dcebfdb7
I20260619 19:54:13.578992 1994 ts_tablet_manager.cc:1929] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:13.580935 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:13.578222 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bdaa6ef43cab4cb384b92bd43c472901 consensus state has no leader
I20260619 19:54:13.582182 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.585249 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:13.585682 1994 log.cc:1199] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/3ce88d3d4ea340dcaa9d8e26f9a047a7
I20260619 19:54:13.586179 1994 ts_tablet_manager.cc:1950] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:13.586162 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]). Expected version 1 got 0
I20260619 19:54:13.587579 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 (table default.Table_299b0539a019486f9ab66bb6e24975a3 [id=0d428bc351c644c49601058ab8da82d6]) successfully deleted
W20260619 19:54:13.588363 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 4023cceb8d9447c9952951c1d6bcdf00 because the tablet was not found. No further retry: Not found: Tablet not found: 4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:13.588676 1994 tablet_replica.cc:333] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:13.591420 1994 raft_consensus.cc:2243] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.591670 1994 raft_consensus.cc:2272] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.592322 1994 ts_tablet_manager.cc:1916] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.593122 2747 raft_consensus.cc:493] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.593248 2747 raft_consensus.cc:515] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.593894 2747 leader_election.cc:290] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.595367 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0cd4cd0661415d8b2b2339363e7aca" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:13.596122 996 leader_election.cc:343] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.600467 1994 ts_tablet_manager.cc:1929] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:13.600668 1994 log.cc:1199] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/bf175c80483346788a148b7277b9ca9d
I20260619 19:54:13.601022 1994 ts_tablet_manager.cc:1950] T bf175c80483346788a148b7277b9ca9d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:13.603181 1200 tablet_bootstrap.cc:492] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.603395 1200 ts_tablet_manager.cc:1403] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.003s
I20260619 19:54:13.604312 1200 raft_consensus.cc:359] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.604499 1200 raft_consensus.cc:385] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.604554 1200 raft_consensus.cc:740] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.604569 891 tablet_service.cc:1511] Processing CreateTablet for tablet ee2b48219a234e7daf2a4bc12f250560 (DEFAULT_TABLE table=default.Table_d816fde10a7643eaa2813e6bf58bd23b [id=9f082bbc0a4244d898301009dda869f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.604801 2747 raft_consensus.cc:493] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.604914 2747 raft_consensus.cc:515] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.605542 2747 leader_election.cc:290] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.606307 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.606379 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 17ce8540ee2846198786b8e215275641 (DEFAULT_TABLE table=default.Table_f72aa268721148b1a73f7b43cb0b6d1a [id=c873899223684248baa7e88a87494665]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:13.606953 996 leader_election.cc:343] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.607477 1200 consensus_queue.cc:260] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.608224 1200 ts_tablet_manager.cc:1434] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 19:54:13.608153 884 tablet_service.cc:1511] Processing CreateTablet for tablet 17ce8540ee2846198786b8e215275641 (DEFAULT_TABLE table=default.Table_f72aa268721148b1a73f7b43cb0b6d1a [id=c873899223684248baa7e88a87494665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.609405 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 (DEFAULT_TABLE table=default.Table_18b53a705e3848fdb3172af3e7f87b4e [id=1aab3873752a47a2ae2097f5033c63f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.612337 892 tablet_service.cc:1511] Processing CreateTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 (DEFAULT_TABLE table=default.Table_18b53a705e3848fdb3172af3e7f87b4e [id=1aab3873752a47a2ae2097f5033c63f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.614782 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ce8540ee2846198786b8e215275641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.615029 899 tablet_service.cc:1511] Processing CreateTablet for tablet 9947ee9df46d495dae358994d1e451cd (DEFAULT_TABLE table=default.Table_22cad3dd8de14d32850b7781efde00fb [id=0d4fa506c9644dcc9a78a051c8346bac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.615384 2747 raft_consensus.cc:493] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.615423 1994 tablet_replica.cc:333] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:13.615511 2747 raft_consensus.cc:515] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.615746 1994 raft_consensus.cc:2243] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:13.616034 1994 pending_rounds.cc:70] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:13.616087 1994 pending_rounds.cc:77] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657701566398464 op_type: NO_OP noop_request { }
I20260619 19:54:13.616123 2747 leader_election.cc:290] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.616194 1994 raft_consensus.cc:2889] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:13.616309 1994 raft_consensus.cc:2272] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.616859 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ace991ad1a4d52ab609940aacf6681" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.617106 785 raft_consensus.cc:2468] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:13.617627 1994 ts_tablet_manager.cc:1916] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.617708 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 9947ee9df46d495dae358994d1e451cd (DEFAULT_TABLE table=default.Table_22cad3dd8de14d32850b7781efde00fb [id=0d4fa506c9644dcc9a78a051c8346bac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.618124 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9947ee9df46d495dae358994d1e451cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.618063 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet bf175c80483346788a148b7277b9ca9d (table default.Table_87768bcb7d2347faa2a8624f28911b02 [id=14dbea33ca974c8fa94e99d0d9f79272]) successfully deleted
I20260619 19:54:13.623980 2758 raft_consensus.cc:493] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.624155 2758 raft_consensus.cc:515] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.625692 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 1261a735922542a1a6c149986f236c1a (DEFAULT_TABLE table=default.Table_1b9c1d7cb147402292e27bb7ca37bf1b [id=c222e8c305044d5485a8ca9dbbc5bcb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.626708 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1261a735922542a1a6c149986f236c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.628832 2747 raft_consensus.cc:493] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.628975 2747 raft_consensus.cc:515] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.629633 2747 leader_election.cc:290] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.630663 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c9a91f95bb4bcdafe493bab8c393b4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.631110 1200 tablet_bootstrap.cc:492] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.631371 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359dd33e7b946c286bbe8c1ec8ebad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.635506 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0cd4cd0661415d8b2b2339363e7aca" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:13.635700 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:13.635989 996 leader_election.cc:343] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.636112 996 leader_election.cc:304] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.636348 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ace991ad1a4d52ab609940aacf6681" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:13.636544 996 leader_election.cc:343] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.636638 996 leader_election.cc:304] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.636981 2694 raft_consensus.cc:2749] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.637035 2715 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:13.637147 2694 raft_consensus.cc:2749] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.637151 2715 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:13.637740 2715 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:13.639849 996 leader_election.cc:343] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: Tablet not RUNNING: STOPPED
W20260619 19:54:13.643695 859 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:13.645797 1107 heartbeater.cc:344] Connected to a master server at 127.0.105.188:44433
I20260619 19:54:13.646756 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c9a91f95bb4bcdafe493bab8c393b4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:13.645462 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:13.647768 996 leader_election.cc:343] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:13.648088 720 consensus_peers.cc:597] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26355bc6b5c147a88c14a9f053b4e1f3. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:13.649143 1200 tablet_bootstrap.cc:654] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:13.650262 996 leader_election.cc:343] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.650379 996 leader_election.cc:304] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:13.650739 996 leader_election.cc:304] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:13.650699 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1261a735922542a1a6c149986f236c1a (DEFAULT_TABLE table=default.Table_1b9c1d7cb147402292e27bb7ca37bf1b [id=c222e8c305044d5485a8ca9dbbc5bcb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.651248 2694 raft_consensus.cc:2749] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.651396 2694 raft_consensus.cc:2804] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:13.651443 2694 raft_consensus.cc:493] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:13.651494 2694 raft_consensus.cc:3060] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.647240 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71f92f4e3040c09b67e287a19eea74" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.653352 778 raft_consensus.cc:2468] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:13.653997 2694 raft_consensus.cc:515] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.654597 2694 leader_election.cc:290] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.656327 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 88dc27a9f1c7442bbe803120a5d043fe (DEFAULT_TABLE table=default.Table_d06bac02341e4e018a34562340ec7d74 [id=6bbf4afca845492cb080926f44426f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.656674 754 tablet_service.cc:1511] Processing CreateTablet for tablet 6617e8f0d86f45a19258d7453c8101fb (DEFAULT_TABLE table=default.Table_f18be194dbaa4a64b422513b3ce34908 [id=cd5a750dd8364d96ac8981d31f51550a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.656803 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dc27a9f1c7442bbe803120a5d043fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.657056 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6617e8f0d86f45a19258d7453c8101fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.657294 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.657470 762 tablet_service.cc:1558] Processing DeleteTablet for tablet b57381b0a02141459dc582196d0c0095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:13.658174 858 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:13.658174 762 tablet_service.cc:1511] Processing CreateTablet for tablet 1261a735922542a1a6c149986f236c1a (DEFAULT_TABLE table=default.Table_1b9c1d7cb147402292e27bb7ca37bf1b [id=c222e8c305044d5485a8ca9dbbc5bcb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.658303 858 leader_election.cc:304] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.658491 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1261a735922542a1a6c149986f236c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.658687 765 tablet_service.cc:1558] Processing DeleteTablet for tablet c54b2e4f657245c2aa23d138968b3b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.658850 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a3f254125141bf8783626e669717d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.658995 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.659343 2909 raft_consensus.cc:2749] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:13.659317 760 tablet_service.cc:1511] Processing CreateTablet for tablet ee64505bfcdf49b5820754cbbf822165 (DEFAULT_TABLE table=default.Table_c453f79a82b94fc8b556c1272b0d609a [id=99fc685458cc4be681b77a23d6173903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.659581 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 41455237399b45efbe8190dcb01e764c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:13.660329 519 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet f39a95a0ac714de388ed04a8a14e4f6d (table default.Table_8e9360a87f5a4f8b990df38ad739a3c5 [id=050ce6b1eee349318da902df45aa205e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f39a95a0ac714de388ed04a8a14e4f6d consensus state has no leader
I20260619 19:54:13.661197 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ace991ad1a4d52ab609940aacf6681" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:13.661376 784 raft_consensus.cc:3060] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.661661 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ace991ad1a4d52ab609940aacf6681" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:13.662171 996 leader_election.cc:343] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:54:13.663332 2026 ts_tablet_manager.cc:1929] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:13.663446 2026 log.cc:1199] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/47ace991ad1a4d52ab609940aacf6681
I20260619 19:54:13.657173 749 tablet_service.cc:1511] Processing CreateTablet for tablet 0f31218af79d4f9ca3eadaa11c5de847 (DEFAULT_TABLE table=default.Table_0e520375250b4b46ab3faccabdc1ceff [id=477ed5db09bd494190f5f4e3523a52dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.668159 752 tablet_service.cc:1511] Processing CreateTablet for tablet 17ce8540ee2846198786b8e215275641 (DEFAULT_TABLE table=default.Table_f72aa268721148b1a73f7b43cb0b6d1a [id=c873899223684248baa7e88a87494665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.668509 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f31218af79d4f9ca3eadaa11c5de847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.668753 2758 leader_election.cc:290] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.669026 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2b48219a234e7daf2a4bc12f250560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.669194 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee64505bfcdf49b5820754cbbf822165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.669358 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ce8540ee2846198786b8e215275641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.669435 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ce8540ee2846198786b8e215275641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.670944 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359dd33e7b946c286bbe8c1ec8ebad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.671212 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9947ee9df46d495dae358994d1e451cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.671658 757 tablet_service.cc:1511] Processing CreateTablet for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 (DEFAULT_TABLE table=default.Table_18b53a705e3848fdb3172af3e7f87b4e [id=1aab3873752a47a2ae2097f5033c63f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.671981 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359dd33e7b946c286bbe8c1ec8ebad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.672461 748 tablet_service.cc:1511] Processing CreateTablet for tablet 9947ee9df46d495dae358994d1e451cd (DEFAULT_TABLE table=default.Table_22cad3dd8de14d32850b7781efde00fb [id=0d4fa506c9644dcc9a78a051c8346bac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.672777 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9947ee9df46d495dae358994d1e451cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.673166 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.675108 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1261a735922542a1a6c149986f236c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.675941 759 tablet_service.cc:1511] Processing CreateTablet for tablet ee2b48219a234e7daf2a4bc12f250560 (DEFAULT_TABLE table=default.Table_d816fde10a7643eaa2813e6bf58bd23b [id=9f082bbc0a4244d898301009dda869f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.680783 896 tablet_service.cc:1511] Processing CreateTablet for tablet 88dc27a9f1c7442bbe803120a5d043fe (DEFAULT_TABLE table=default.Table_d06bac02341e4e018a34562340ec7d74 [id=6bbf4afca845492cb080926f44426f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.681259 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dc27a9f1c7442bbe803120a5d043fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.683923 858 leader_election.cc:304] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.684764 2539 raft_consensus.cc:2804] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:13.684850 2539 raft_consensus.cc:493] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:13.684923 2539 raft_consensus.cc:3060] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.687749 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8585ffc664864999863392da617d48d5 (DEFAULT_TABLE table=default.Table_d6723d78cce046409a3580a7092ac48f [id=62564480b8df487aa38ba84291fc1b9e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:13.688161 720 leader_election.cc:343] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 8bc11c632b514118856ea4c11b431142
I20260619 19:54:13.688619 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8585ffc664864999863392da617d48d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.693182 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2b48219a234e7daf2a4bc12f250560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.694201 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9f2e34ba96cf4823862a1d07b19ee94d" } new_table_name: "default.Table_97b547a957704426af6c457046bbcf5d" modify_external_catalogs: true
I20260619 19:54:13.694555 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_018b2daa63104a909f9b61710c43d93d" } new_table_name: "default.Table_4620c53896b8420b963ab245b2cbaccc" modify_external_catalogs: true
I20260619 19:54:13.694780 1994 ts_tablet_manager.cc:1929] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:13.694890 1994 log.cc:1199] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:13.695288 1994 ts_tablet_manager.cc:1950] T 9d905e7076014c818e1fb1ef09c15342 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:13.696520 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_02cb77fd6301496d895a8deaf26a694c" } modify_external_catalogs: true
I20260619 19:54:13.696725 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_02cb77fd6301496d895a8deaf26a694c" } modify_external_catalogs: true
I20260619 19:54:13.697654 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d651c8fb8ff244a5a09dd9ea593ecb14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:54 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.698545 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ac203b76f07042c79ac356c1c30c2156"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:13.698871 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9d905e7076014c818e1fb1ef09c15342 (table default.Table_4d84da14868f41e5afe84ea58bd57ab9 [id=6e5582a72f36485783705cfb2f671ddb]) successfully deleted
W20260619 19:54:13.699123 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac203b76f07042c79ac356c1c30c2156 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.699328 1994 tablet_replica.cc:333] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:13.699545 1994 raft_consensus.cc:2243] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.699769 1994 raft_consensus.cc:2272] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.700469 1994 ts_tablet_manager.cc:1916] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.701198 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d436621459c84358a9670595540687ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.701788 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d436621459c84358a9670595540687ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.703562 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ead8fa6263094ddbb60465a7ba503ce3" } new_table_name: "default.Table_5b2e48a604b14d41b144c467b1738da5" modify_external_catalogs: true
I20260619 19:54:13.705189 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0c58e59a4fc14af398679e836a1a2433"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.705742 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c58e59a4fc14af398679e836a1a2433 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.713155 1973 ts_tablet_manager.cc:1929] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:13.713271 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8e3f4b47d0e7451d91add5a81330bc7d
I20260619 19:54:13.713320 1973 log.cc:1199] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/983faf8557814093bc427291711f3fce
I20260619 19:54:13.713672 1973 ts_tablet_manager.cc:1950] T 983faf8557814093bc427291711f3fce P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:13.713815 524 catalog_manager.cc:6784] ReplaceTablet: tablet 8e3f4b47d0e7451d91add5a81330bc7d deleted and replaced by tablet 9eb901a33f434f6898d85d87f852f858
I20260619 19:54:13.714313 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4cd176000f724dec9824ba9d399a5126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.714953 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cd176000f724dec9824ba9d399a5126 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.716110 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_ca89a774eca447f98006c1b978ac498a [id=8de7c14aec0549bfa81434211594c5eb] alter complete (version 3)
I20260619 19:54:13.717480 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e3f4b47d0e7451d91add5a81330bc7d with delete_type TABLET_DATA_DELETED (replaced by tablet 9eb901a33f434f6898d85d87f852f858) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.721020 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e3f4b47d0e7451d91add5a81330bc7d with delete_type TABLET_DATA_DELETED (replaced by tablet 9eb901a33f434f6898d85d87f852f858) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.722623 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 79e86e744f254b7fbca1adfe43e3ade5
W20260619 19:54:13.724195 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c34d1212487348ceae8c58e5c09740cc has no consensus state
I20260619 19:54:13.724529 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 79e86e744f254b7fbca1adfe43e3ade5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:13.724997 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3136118e1a5847f0a39fcb14bbc46a64 has no consensus state
I20260619 19:54:13.725662 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_66ad26c218e448178939af5aded44176"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.726432 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66ad26c218e448178939af5aded44176 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.728682 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c7f823584528450b8a8b973c9d7617c4" } modify_external_catalogs: true
I20260619 19:54:13.729151 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c7f823584528450b8a8b973c9d7617c4" } modify_external_catalogs: true
I20260619 19:54:13.730038 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1ecc1b0d512443f3b3ece618b052d7a9" } modify_external_catalogs: true
I20260619 19:54:13.730232 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1ecc1b0d512443f3b3ece618b052d7a9" } modify_external_catalogs: true
W20260619 19:54:13.732142 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8614b0ab1a3749a1a0aa441574f79ab1 consensus state has no leader
I20260619 19:54:13.733325 1200 tablet_bootstrap.cc:492] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.733565 1200 ts_tablet_manager.cc:1403] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.103s user 0.000s sys 0.006s
I20260619 19:54:13.735860 1200 raft_consensus.cc:359] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.736588 1200 raft_consensus.cc:385] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.736732 1200 raft_consensus.cc:740] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.738978 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_84985ee2ef7e4bca97516d92f18abd7c [id=6d7c9506a27b4a70a32958a89c72c202] alter complete (version 3)
I20260619 19:54:13.747695 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4846baa998dc44a790af9fe0cc649f59" } new_table_name: "default.Table_e0fd7432c9ca4d5f8d44743947ef4c65" modify_external_catalogs: true
I20260619 19:54:13.744679 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet fe814880d9984bbd83fa121cb2a34eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.744827 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d905e7076014c818e1fb1ef09c15342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.744926 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c with delete_type TABLET_DATA_DELETED (replaced by tablet 0476b1447f984f548d06e71cdda6a875) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745013 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745090 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745164 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 774938222588473e90c513232c82aece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745268 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca with delete_type TABLET_DATA_DELETED (replaced by tablet 910cf00e57404f1097800e84a2070b26) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745352 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ace991ad1a4d52ab609940aacf6681 with delete_type TABLET_DATA_DELETED (replaced by tablet a7100b0bfa6d4e3baf4e7f90217f1fff) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745440 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f305a99e3481419196532cb5c62c2500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.745517 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.753667 1200 consensus_queue.cc:260] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.760365 1034 tablet_service.cc:1511] Processing CreateTablet for tablet be5237ff855741438165e20fa12576a5 (DEFAULT_TABLE table=default.Table_2ec9be1473054787a3dd12374aff1ab2 [id=bdba0f7c15684c70998cfb30da86ce0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.764225 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e374217e35c4c1aae543439fcf83a5c" } modify_external_catalogs: true
I20260619 19:54:13.764613 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e374217e35c4c1aae543439fcf83a5c" } modify_external_catalogs: true
I20260619 19:54:13.765396 900 tablet_service.cc:1511] Processing CreateTablet for tablet 8585ffc664864999863392da617d48d5 (DEFAULT_TABLE table=default.Table_d6723d78cce046409a3580a7092ac48f [id=62564480b8df487aa38ba84291fc1b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.767421 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.768256 2026 ts_tablet_manager.cc:1950] T 47ace991ad1a4d52ab609940aacf6681 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:13.769704 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a8b0d5d52f264281993fdb86c8658b88
I20260619 19:54:13.771384 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b57f64f97cdc493ea48e08d897bfc982
I20260619 19:54:13.761461 1200 ts_tablet_manager.cc:1434] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.028s user 0.000s sys 0.002s
I20260619 19:54:13.773016 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b57f64f97cdc493ea48e08d897bfc982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.773149 894 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b0d5d52f264281993fdb86c8658b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.767218 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.771241 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b0d5d52f264281993fdb86c8658b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.762087 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5237ff855741438165e20fa12576a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.773620 2801 consensus_queue.cc:1048] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260619 19:54:13.780452 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.783631 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b0a31efd94754d3f8883825db473e0fd" } modify_external_catalogs: true
I20260619 19:54:13.783881 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b0a31efd94754d3f8883825db473e0fd" } modify_external_catalogs: true
I20260619 19:54:13.785567 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_46c39532c40e4235962d782243d0c66a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.786082 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46c39532c40e4235962d782243d0c66a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.787285 2539 raft_consensus.cc:515] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:13.789120 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5783716513840e0a046b23d245b5700 consensus state has no leader
I20260619 19:54:13.791400 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_eb3dbd1f613f4df8ab088d7b8bcd8c33" } new_table_name: "default.Table_20608453192e425a99f62a98fb413a8d" modify_external_catalogs: true
I20260619 19:54:13.796555 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8585ffc664864999863392da617d48d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.796628 902 tablet_service.cc:1511] Processing CreateTablet for tablet be5237ff855741438165e20fa12576a5 (DEFAULT_TABLE table=default.Table_2ec9be1473054787a3dd12374aff1ab2 [id=bdba0f7c15684c70998cfb30da86ce0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.797083 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5237ff855741438165e20fa12576a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.796622 892 tablet_service.cc:1511] Processing CreateTablet for tablet 595f3130e2554614be1bff275917981d (DEFAULT_TABLE table=default.Table_e308f230944e4e96a5ec1a35eb5b21aa [id=1c8c18675ec84713a63c669793132a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.796471 894 tablet_service.cc:1558] Processing DeleteTablet for tablet b57f64f97cdc493ea48e08d897bfc982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.798208 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f3130e2554614be1bff275917981d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.800526 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 260) took 9515 ms. Trace:
I20260619 19:54:13.800649 2026 rpcz_store.cc:276] 0619 19:54:04.267877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.267936 (+ 59us) service_pool.cc:224] Handling call
0619 19:54:13.531390 (+9263454us) ts_tablet_manager.cc:1151] Deleting tablet 47ace991ad1a4d52ab609940aacf6681
0619 19:54:13.531398 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.610939 (+ 79541us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.663276 (+ 52337us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.782835 (+119559us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9204954}
I20260619 19:54:13.801105 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 264) took 9469 ms. Trace:
I20260619 19:54:13.801232 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a]) successfully deleted
I20260619 19:54:13.802735 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 595f3130e2554614be1bff275917981d (DEFAULT_TABLE table=default.Table_e308f230944e4e96a5ec1a35eb5b21aa [id=1c8c18675ec84713a63c669793132a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.803184 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f3130e2554614be1bff275917981d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.804932 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 79e86e744f254b7fbca1adfe43e3ade5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.809427 1201 tablet_bootstrap.cc:492] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:13.810519 859 leader_election.cc:343] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 2c71f92f4e3040c09b67e287a19eea74
I20260619 19:54:13.810587 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0a25f294171a4e19b508d602a60ded11 (DEFAULT_TABLE table=default.Table_435dbc445b134922a0c9ac422610b4e7 [id=074e11f2f08944f1b094d723a7a58db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.810972 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a25f294171a4e19b508d602a60ded11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.813151 2539 leader_election.cc:290] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.818830 1200 tablet_bootstrap.cc:492] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:13.821662 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8614b0ab1a3749a1a0aa441574f79ab1 (table default.Table_5b2e48a604b14d41b144c467b1738da5 [id=07abbfb4efc94a4a9104ba6600121313]). Expected version 1 got 0
I20260619 19:54:13.822811 1994 ts_tablet_manager.cc:1929] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:13.822947 1994 log.cc:1199] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/41455237399b45efbe8190dcb01e764c
I20260619 19:54:13.823343 1994 ts_tablet_manager.cc:1950] T 41455237399b45efbe8190dcb01e764c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:13.823283 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 65514.7us
I20260619 19:54:13.824334 858 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.824492 1994 tablet_replica.cc:333] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:13.824972 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 41455237399b45efbe8190dcb01e764c (table default.Table_4e0bca12b7834af7a6690074fa09e1e8 [id=af3f4335b675482195a6511647ca2871]) successfully deleted
W20260619 19:54:13.825253 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 already in progress: creating tablet
W20260619 19:54:13.825450 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8e3f4b47d0e7451d91add5a81330bc7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e3f4b47d0e7451d91add5a81330bc7d already in progress: creating tablet
W20260619 19:54:13.825644 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 79e86e744f254b7fbca1adfe43e3ade5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79e86e744f254b7fbca1adfe43e3ade5 already in progress: creating tablet
I20260619 19:54:13.826946 2539 raft_consensus.cc:2749] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:13.831187 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 432) took 4718 ms. Trace:
I20260619 19:54:13.831226 1201 ts_tablet_manager.cc:1403] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.278s user 0.005s sys 0.011s
I20260619 19:54:13.831439 1208 tablet_bootstrap.cc:654] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.832027 1201 raft_consensus.cc:359] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.832193 1201 raft_consensus.cc:385] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.832233 1201 raft_consensus.cc:740] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.832415 1201 consensus_queue.cc:260] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.832943 1201 ts_tablet_manager.cc:1434] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:13.833237 1201 tablet_bootstrap.cc:492] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:13.834549 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:54:13.835937 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.841890 1973 rpcz_store.cc:276] 0619 19:54:09.038137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.038180 (+ 43us) service_pool.cc:224] Handling call
0619 19:54:13.148691 (+4110511us) ts_tablet_manager.cc:1151] Deleting tablet 983faf8557814093bc427291711f3fce
0619 19:54:13.148701 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.465688 (+316987us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.713055 (+247367us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:13.756728 (+ 43673us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21407,"tablet-delete.queue_time_us":4082780}
I20260619 19:54:13.844326 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfa4bcc850547dd8cc34d813c705f9d (DEFAULT_TABLE table=default.Table_f5fe12020ca44561aa32a5a495b17ded [id=027a8c728d5940d49e23a11673298623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.844741 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfa4bcc850547dd8cc34d813c705f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.846129 784 raft_consensus.cc:2468] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:13.846932 899 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.848178 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71f92f4e3040c09b67e287a19eea74" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:13.854208 996 leader_election.cc:304] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:13.854956 2744 raft_consensus.cc:2804] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:13.855088 2744 raft_consensus.cc:697] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:13.855278 1201 tablet_bootstrap.cc:654] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.855420 2744 consensus_queue.cc:237] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.853470 888 tablet_service.cc:1511] Processing CreateTablet for tablet 0a25f294171a4e19b508d602a60ded11 (DEFAULT_TABLE table=default.Table_435dbc445b134922a0c9ac422610b4e7 [id=074e11f2f08944f1b094d723a7a58db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.857482 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a25f294171a4e19b508d602a60ded11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.859529 751 tablet_service.cc:1511] Processing CreateTablet for tablet be5237ff855741438165e20fa12576a5 (DEFAULT_TABLE table=default.Table_2ec9be1473054787a3dd12374aff1ab2 [id=bdba0f7c15684c70998cfb30da86ce0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.861030 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f96563f57f844df4814397f76ec42007
I20260619 19:54:13.862021 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f96563f57f844df4814397f76ec42007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:13.863715 884 tablet_service.cc:1558] Processing DeleteTablet for tablet f96563f57f844df4814397f76ec42007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:13.866904 776 raft_consensus.cc:3060] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.871480 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e3f4b47d0e7451d91add5a81330bc7d with delete_type TABLET_DATA_DELETED (replaced by tablet 9eb901a33f434f6898d85d87f852f858) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.871512 2941 raft_consensus.cc:493] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.872412 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 79e86e744f254b7fbca1adfe43e3ade5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.872457 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b57f64f97cdc493ea48e08d897bfc982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.873198 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5237ff855741438165e20fa12576a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.873091 762 tablet_service.cc:1511] Processing CreateTablet for tablet 88dc27a9f1c7442bbe803120a5d043fe (DEFAULT_TABLE table=default.Table_d06bac02341e4e018a34562340ec7d74 [id=6bbf4afca845492cb080926f44426f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.876755 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 435) took 4601 ms. Trace:
I20260619 19:54:13.877385 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8585ffc664864999863392da617d48d5 (DEFAULT_TABLE table=default.Table_d6723d78cce046409a3580a7092ac48f [id=62564480b8df487aa38ba84291fc1b9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.878628 2941 raft_consensus.cc:515] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:13.880568 720 leader_election.cc:343] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 68788824224b426bb433b87763073bae
I20260619 19:54:13.880745 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0a25f294171a4e19b508d602a60ded11 (DEFAULT_TABLE table=default.Table_435dbc445b134922a0c9ac422610b4e7 [id=074e11f2f08944f1b094d723a7a58db3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.881556 917 raft_consensus.cc:1275] T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260619 19:54:13.881687 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]) successfully deleted
I20260619 19:54:13.882872 1973 rpcz_store.cc:276] 0619 19:54:09.257961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.258009 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:13.852018 (+4594009us) ts_tablet_manager.cc:1151] Deleting tablet d5ddb8412ad145dd85916bf5d756a9f0
0619 19:54:13.852034 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.859455 (+ 7421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4593788}
I20260619 19:54:13.886157 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.886250 884 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfa4bcc850547dd8cc34d813c705f9d (DEFAULT_TABLE table=default.Table_f5fe12020ca44561aa32a5a495b17ded [id=027a8c728d5940d49e23a11673298623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.886332 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b0d5d52f264281993fdb86c8658b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.886451 749 tablet_service.cc:1558] Processing DeleteTablet for tablet f96563f57f844df4814397f76ec42007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:13.886653 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 437) took 4621 ms. Trace:
I20260619 19:54:13.886750 1973 rpcz_store.cc:276] 0619 19:54:09.264892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.264944 (+ 52us) service_pool.cc:224] Handling call
0619 19:54:13.883279 (+4618335us) ts_tablet_manager.cc:1151] Deleting tablet 904e20649a5f4c49a93bb084c1d3bb9a
0619 19:54:13.883289 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.886610 (+ 3321us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4618114}
I20260619 19:54:13.887157 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 440) took 4592 ms. Trace:
I20260619 19:54:13.887266 1973 rpcz_store.cc:276] 0619 19:54:09.294943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.294998 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:13.887011 (+4592013us) ts_tablet_manager.cc:1151] Deleting tablet 0f3a48eabb574be3bc6883cf555b657f
0619 19:54:13.887020 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.887102 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4591478}
I20260619 19:54:13.887483 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb62e94c46749348a3bc2cadee42c79 (DEFAULT_TABLE table=default.Table_247580df801f4df0a325292361c8f7f7 [id=6f646d969a814b8199f3a7bb84c61f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.887621 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 441) took 4557 ms. Trace:
I20260619 19:54:13.887714 1973 rpcz_store.cc:276] 0619 19:54:09.329832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.329882 (+ 50us) service_pool.cc:224] Handling call
0619 19:54:13.887499 (+4557617us) ts_tablet_manager.cc:1151] Deleting tablet ac2d419a6e5d466e97df971b31640519
0619 19:54:13.887507 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.887579 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4557416}
I20260619 19:54:13.887989 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb62e94c46749348a3bc2cadee42c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.888059 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 442) took 4557 ms. Trace:
I20260619 19:54:13.888144 1973 rpcz_store.cc:276] 0619 19:54:09.330207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.330251 (+ 44us) service_pool.cc:224] Handling call
0619 19:54:13.887933 (+4557682us) ts_tablet_manager.cc:1151] Deleting tablet 67faf5d554074ab3bdf79075f649f4e0
0619 19:54:13.887941 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.888023 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4557473}
I20260619 19:54:13.888463 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 448) took 4352 ms. Trace:
I20260619 19:54:13.888542 1973 rpcz_store.cc:276] 0619 19:54:09.535730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.539962 (+ 4232us) service_pool.cc:224] Handling call
0619 19:54:13.888326 (+4348364us) ts_tablet_manager.cc:1151] Deleting tablet fb6bc52ee1fa4ac8967f937e59b4550c
0619 19:54:13.888333 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.888426 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4348065}
I20260619 19:54:13.888818 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 450) took 4265 ms. Trace:
I20260619 19:54:13.888900 1973 rpcz_store.cc:276] 0619 19:54:09.622960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.623159 (+ 199us) service_pool.cc:224] Handling call
0619 19:54:13.888724 (+4265565us) ts_tablet_manager.cc:1151] Deleting tablet d2156cf3d7664ffc9b4b3f47fa750226
0619 19:54:13.888731 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.888789 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4265334}
I20260619 19:54:13.889151 1973 tablet_replica.cc:333] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:13.889371 1973 raft_consensus.cc:2243] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:13.889755 1973 raft_consensus.cc:2272] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.891459 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dc27a9f1c7442bbe803120a5d043fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.896613 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a25f294171a4e19b508d602a60ded11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.896713 760 tablet_service.cc:1511] Processing CreateTablet for tablet 595f3130e2554614be1bff275917981d (DEFAULT_TABLE table=default.Table_e308f230944e4e96a5ec1a35eb5b21aa [id=1c8c18675ec84713a63c669793132a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.897145 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f3130e2554614be1bff275917981d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.897562 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfa4bcc850547dd8cc34d813c705f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.897662 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8585ffc664864999863392da617d48d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.900839 2941 leader_election.cc:290] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.901152 776 raft_consensus.cc:2468] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:13.902117 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_fa8fcf4efbb044c6882855c7eff0f4d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:13.902791 1973 ts_tablet_manager.cc:1916] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:13.903056 719 leader_election.cc:343] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 8bc11c632b514118856ea4c11b431142
I20260619 19:54:13.903363 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_969ed8e28890403b8254ffb6146ad41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.904138 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa8fcf4efbb044c6882855c7eff0f4d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:13.905655 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_969ed8e28890403b8254ffb6146ad41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.907444 1200 tablet_bootstrap.cc:654] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:13.910823 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_92f1a8c127b447be96dc51e3fe3fde03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.911567 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92f1a8c127b447be96dc51e3fe3fde03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.916194 719 leader_election.cc:304] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.916754 2757 raft_consensus.cc:2749] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:13.912985 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d25b06554eb1441c8dc2fa9030209fa8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.917704 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d25b06554eb1441c8dc2fa9030209fa8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.918226 2757 consensus_queue.cc:1048] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:13.919828 2801 raft_consensus.cc:493] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.919987 2801 raft_consensus.cc:515] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.921587 1200 tablet_bootstrap.cc:492] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:13.921712 1200 ts_tablet_manager.cc:1403] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.000s
I20260619 19:54:13.922434 1200 raft_consensus.cc:359] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.922597 1200 raft_consensus.cc:385] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:13.922650 1200 raft_consensus.cc:740] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:13.922839 1200 consensus_queue.cc:260] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:13.924674 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d5375b8c78544de92c47cb56a9b8c25 has no consensus state
W20260619 19:54:13.929946 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d5ddb8412ad145dd85916bf5d756a9f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5ddb8412ad145dd85916bf5d756a9f0 already in progress: creating tablet
W20260619 19:54:13.930567 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 904e20649a5f4c49a93bb084c1d3bb9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 904e20649a5f4c49a93bb084c1d3bb9a already in progress: creating tablet
W20260619 19:54:13.930804 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0f3a48eabb574be3bc6883cf555b657f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f3a48eabb574be3bc6883cf555b657f already in progress: creating tablet
W20260619 19:54:13.930991 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ac2d419a6e5d466e97df971b31640519 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac2d419a6e5d466e97df971b31640519 already in progress: creating tablet
I20260619 19:54:13.931182 858 leader_election.cc:304] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:13.931252 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 67faf5d554074ab3bdf79075f649f4e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67faf5d554074ab3bdf79075f649f4e0 already in progress: creating tablet
W20260619 19:54:13.931411 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fb6bc52ee1fa4ac8967f937e59b4550c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb6bc52ee1fa4ac8967f937e59b4550c already in progress: creating tablet
W20260619 19:54:13.931593 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d2156cf3d7664ffc9b4b3f47fa750226 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2156cf3d7664ffc9b4b3f47fa750226 already in progress: creating tablet
I20260619 19:54:13.931609 2539 raft_consensus.cc:2804] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:13.931756 2539 raft_consensus.cc:697] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:13.937490 2539 consensus_queue.cc:237] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.910475 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 83452ce6b5b3479b98ea312db05dc651 (table default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55]). Expected version 2 got 0
I20260619 19:54:13.939566 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:13.940037 530 catalog_manager.cc:5696] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 2, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 2 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:13.940971 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:13.941360 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]). Expected version 1 got 0
I20260619 19:54:13.942780 2909 raft_consensus.cc:493] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:13.942919 2909 raft_consensus.cc:515] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:13.943564 2909 leader_election.cc:290] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:13.943684 776 raft_consensus.cc:3060] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:13.944947 742 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 256) took 1092 ms. Trace:
I20260619 19:54:13.945047 742 rpcz_store.cc:276] 0619 19:54:12.852558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.852636 (+ 78us) service_pool.cc:224] Handling call
0619 19:54:13.403110 (+550474us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x616000318530. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4e536673 00007eff51060d28 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:13.677483 (+274373us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x6160000d4e54. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:13.944895 (+267412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569401984}
I20260619 19:54:13.950730 749 tablet_service.cc:1511] Processing CreateTablet for tablet 85958b817d9541d4802851eec46b7f9e (DEFAULT_TABLE table=default.Table_7051f068984446bfafc44b43b2dd2bea [id=986455c9826449c29e8313ef94b9ebb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.951161 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85958b817d9541d4802851eec46b7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.951862 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfa4bcc850547dd8cc34d813c705f9d (DEFAULT_TABLE table=default.Table_f5fe12020ca44561aa32a5a495b17ded [id=027a8c728d5940d49e23a11673298623]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:13.952330 719 leader_election.cc:343] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 68788824224b426bb433b87763073bae
I20260619 19:54:13.952456 719 leader_election.cc:304] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:13.952620 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1d0c78451479462d835429361c1cb37d" } new_table_name: "default.Table_8332957764724490802823ff562a7fe0" modify_external_catalogs: true
I20260619 19:54:13.954129 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4eb88930eea24fe5a377a3511584ecdd" } new_table_name: "default.Table_4b40caf0c68a4611900cb6b9df5e3e68" modify_external_catalogs: true
I20260619 19:54:13.955605 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3501993f2f45498d8b39e29320e10e04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.956182 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3501993f2f45498d8b39e29320e10e04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.957453 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_baff15c587f7449cbc53a0c38dbf8c32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.957944 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baff15c587f7449cbc53a0c38dbf8c32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:13.960856 2757 raft_consensus.cc:2749] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:13.970407 752 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb62e94c46749348a3bc2cadee42c79 (DEFAULT_TABLE table=default.Table_247580df801f4df0a325292361c8f7f7 [id=6f646d969a814b8199f3a7bb84c61f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.971648 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_81965bd42e674af7a540c53e595dc804" } modify_external_catalogs: true
I20260619 19:54:13.971828 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_81965bd42e674af7a540c53e595dc804" } modify_external_catalogs: true
I20260619 19:54:13.975850 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb62e94c46749348a3bc2cadee42c79 (DEFAULT_TABLE table=default.Table_247580df801f4df0a325292361c8f7f7 [id=6f646d969a814b8199f3a7bb84c61f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.980839 2801 leader_election.cc:290] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:13.982177 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb62e94c46749348a3bc2cadee42c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.982445 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_247580df801f4df0a325292361c8f7f7" } new_table_name: "default.Table_609ffab8ac9744aaacac9e4ef7fa5b7a" modify_external_catalogs: true
I20260619 19:54:13.983027 896 tablet_service.cc:1511] Processing CreateTablet for tablet 85958b817d9541d4802851eec46b7f9e (DEFAULT_TABLE table=default.Table_7051f068984446bfafc44b43b2dd2bea [id=986455c9826449c29e8313ef94b9ebb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:13.983654 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85958b817d9541d4802851eec46b7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:13.991024 1994 raft_consensus.cc:2243] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:13.991415 1994 pending_rounds.cc:70] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:13.991485 1994 pending_rounds.cc:77] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657701612269568 op_type: NO_OP noop_request { }
I20260619 19:54:13.991410 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:13.991573 1994 raft_consensus.cc:2889] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:13.991645 1053 raft_consensus.cc:2468] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:13.992252 2694 raft_consensus.cc:493] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.992419 2694 raft_consensus.cc:515] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.992941 2694 leader_election.cc:290] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.995848 2747 raft_consensus.cc:493] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:13.995916 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb4b1e87f2e84bcaaa07ff9f687b9e3d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.995993 2747 raft_consensus.cc:515] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:13.996476 2747 leader_election.cc:290] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:13.991652 1994 raft_consensus.cc:2272] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:13.998577 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:13.999291 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2f3ca718f1364e56929c805460a6a394"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:13.999949 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f3ca718f1364e56929c805460a6a394 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:14.012552 996 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.014101 1200 ts_tablet_manager.cc:1434] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.092s user 0.001s sys 0.001s
W20260619 19:54:14.020568 996 leader_election.cc:343] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.021512 1994 ts_tablet_manager.cc:1916] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.024138 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:14.028241 996 leader_election.cc:343] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: eb4b1e87f2e84bcaaa07ff9f687b9e3d
I20260619 19:54:14.028457 996 leader_election.cc:304] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.028740 2744 raft_consensus.cc:2749] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:14.029791 2854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc90ee2d59d4dddae6790dd92b20cb5. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:54:14.030052 2854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:54:13.998183 1024 tablet_service.cc:1511] Processing CreateTablet for tablet 85958b817d9541d4802851eec46b7f9e (DEFAULT_TABLE table=default.Table_7051f068984446bfafc44b43b2dd2bea [id=986455c9826449c29e8313ef94b9ebb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:14.030401 2883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:54:14.030629 2883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 19:54:14.030774 2904 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6cc90ee2d59d4dddae6790dd92b20cb5)
I20260619 19:54:14.030994 2904 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:54:14.032112 1994 ts_tablet_manager.cc:1929] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:14.032259 1994 log.cc:1199] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fe814880d9984bbd83fa121cb2a34eac
I20260619 19:54:14.032703 1994 ts_tablet_manager.cc:1950] T fe814880d9984bbd83fa121cb2a34eac P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:13.993839 859 leader_election.cc:343] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fade40bf3e7145f29076821f091677bd
I20260619 19:54:14.034348 859 leader_election.cc:304] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:13.993888 2801 consensus_queue.cc:1048] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260619 19:54:14.035799 2801 raft_consensus.cc:2804] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.035877 2801 raft_consensus.cc:493] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.035943 2801 raft_consensus.cc:3060] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.036240 2904 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
W20260619 19:54:14.036314 858 leader_election.cc:343] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fade40bf3e7145f29076821f091677bd
I20260619 19:54:14.039548 2956 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 19:54:14.012390 2026 rpcz_store.cc:276] 0619 19:54:04.331546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.331607 (+ 61us) service_pool.cc:224] Handling call
0619 19:54:13.800939 (+9469332us) ts_tablet_manager.cc:1151] Deleting tablet 1ff5eab435484861b8bccece188f7a46
0619 19:54:13.800949 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.801054 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9430873}
I20260619 19:54:14.041594 2026 tablet_replica.cc:333] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:14.011023 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.041949 915 raft_consensus.cc:2468] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:14.042083 2026 raft_consensus.cc:2243] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:14.042459 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 1ff5eab435484861b8bccece188f7a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ff5eab435484861b8bccece188f7a46 already in progress: creating tablet
I20260619 19:54:14.043336 2026 raft_consensus.cc:2272] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.044938 2026 ts_tablet_manager.cc:1916] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:13.990193 1201 tablet_bootstrap.cc:492] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:14.047322 1201 ts_tablet_manager.cc:1403] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.214s user 0.003s sys 0.015s
I20260619 19:54:14.048278 1201 raft_consensus.cc:359] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.048795 1201 raft_consensus.cc:385] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.048908 1201 raft_consensus.cc:740] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.050570 996 leader_election.cc:304] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.051189 2374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49010 (request call id 0) took 8567 ms. Trace:
I20260619 19:54:14.051260 2744 raft_consensus.cc:2804] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.051398 2744 raft_consensus.cc:493] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.051594 2744 raft_consensus.cc:3060] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.056538 2744 raft_consensus.cc:515] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.057621 2744 leader_election.cc:290] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.058925 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:14.058903 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:14.059123 915 raft_consensus.cc:3060] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:14.060272 996 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.061825 1208 tablet_bootstrap.cc:492] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.062240 1201 consensus_queue.cc:260] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.062923 1201 ts_tablet_manager.cc:1434] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260619 19:54:14.062891 1208 ts_tablet_manager.cc:1403] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.672s user 0.012s sys 0.003s
I20260619 19:54:14.063671 1201 tablet_bootstrap.cc:492] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:14.070779 2327 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" instance_seqno: 1781898825346256) as {username='slave'} at 127.0.105.129:53163; Asking this server to re-register.
I20260619 19:54:14.073418 830 heartbeater.cc:461] Registering TS with master...
I20260619 19:54:14.082487 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85958b817d9541d4802851eec46b7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:14.091349 2744 raft_consensus.cc:493] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.091730 2744 raft_consensus.cc:515] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.092518 2744 leader_election.cc:290] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.093454 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:14.093746 1208 raft_consensus.cc:359] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.094123 996 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.094199 1208 raft_consensus.cc:385] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.094408 1208 raft_consensus.cc:740] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.094976 1208 consensus_queue.cc:260] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.096227 525 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c2f9e5a4dedd4c81901cb99fecff0919 (table default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96]). Expected version 2 got 0
I20260619 19:54:14.098642 858 leader_election.cc:304] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.100085 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8614b0ab1a3749a1a0aa441574f79ab1 (table default.Table_5b2e48a604b14d41b144c467b1738da5 [id=07abbfb4efc94a4a9104ba6600121313]). Expected version 1 got 0
I20260619 19:54:14.101792 915 raft_consensus.cc:2468] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:14.121910 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71ddb48c4b48459791bd3aaa7982a7e6 consensus state has no leader
I20260619 19:54:14.124280 1200 tablet_bootstrap.cc:492] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:14.124725 1994 tablet_replica.cc:333] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.125164 1994 raft_consensus.cc:2243] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.125325 1994 raft_consensus.cc:2272] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.126006 1994 ts_tablet_manager.cc:1916] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:14.126731 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c322c38aae114a428f64a476a2ae9b5f consensus state has no leader
I20260619 19:54:14.127167 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb" } modify_external_catalogs: true
I20260619 19:54:14.127377 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb" } modify_external_catalogs: true
I20260619 19:54:14.129448 529 master_service.cc:960] ReplaceTablet: received request to replace tablet c47b97e1eeed4f20bfe001fa48dc0471 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:14.133366 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fe814880d9984bbd83fa121cb2a34eac (table default.Table_6c755150293e4861b3e1403d72ead695 [id=55ec6de1c2744eb39dba9656343893b9]) successfully deleted
I20260619 19:54:14.133739 1200 tablet_bootstrap.cc:654] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:14.133731 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9d905e7076014c818e1fb1ef09c15342 because the tablet was not found. No further retry: Not found: Tablet not found: 9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:14.105232 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 983faf8557814093bc427291711f3fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.105722 751 tablet_service.cc:1558] Processing DeleteTablet for tablet fe814880d9984bbd83fa121cb2a34eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.106141 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ace991ad1a4d52ab609940aacf6681 with delete_type TABLET_DATA_DELETED (replaced by tablet a7100b0bfa6d4e3baf4e7f90217f1fff) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.107362 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c71f92f4e3040c09b67e287a19eea74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.107990 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f6e202e8fd4a7292774d5eb4c7266b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.121860 2941 raft_consensus.cc:493] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.134915 1208 ts_tablet_manager.cc:1434] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.071s user 0.002s sys 0.000s
I20260619 19:54:14.134830 2941 raft_consensus.cc:515] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.134912 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ea0c90c0f0554b60a2b9e8e37c4fe43e" } new_table_name: "default.Table_af5f422573394c6281b4b3063e66b303" modify_external_catalogs: true
I20260619 19:54:14.135623 2941 leader_election.cc:290] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.136690 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d27b4fd6fd07484dac45acac41ef8dea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:14.136652 2801 raft_consensus.cc:515] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.137354 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d27b4fd6fd07484dac45acac41ef8dea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.137477 2801 leader_election.cc:290] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.138175 2801 raft_consensus.cc:2749] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:14.138847 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ba0fc2cf64384072b2f81f7a30526192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.140599 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba0fc2cf64384072b2f81f7a30526192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:14.143816 720 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:54:14.146020 1208 tablet_bootstrap.cc:492] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.149660 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e2103c40b6764802b83ec0dd628505e9" } modify_external_catalogs: true
I20260619 19:54:14.162060 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:14.164803 2327 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" instance_seqno: 1781898826474075) as {username='slave'} at 127.0.105.131:35913; Asking this server to re-register.
I20260619 19:54:14.168085 1107 heartbeater.cc:461] Registering TS with master...
I20260619 19:54:14.174448 1994 ts_tablet_manager.cc:1929] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.174705 1994 log.cc:1199] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/fb6bc52ee1fa4ac8967f937e59b4550c
I20260619 19:54:14.175206 1994 ts_tablet_manager.cc:1950] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:14.178035 720 consensus_peers.cc:597] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf175c80483346788a148b7277b9ca9d. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:14.178642 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d905e7076014c818e1fb1ef09c15342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.178987 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97bf32159dc444559df0fc5c5cfd2452" } modify_external_catalogs: true
I20260619 19:54:14.183732 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 88c9073ef30d456d8dc8609ddf1335ce
I20260619 19:54:14.187963 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:14.188071 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.188900 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_92f5508aef334d42a58426bb75ba972a" } modify_external_catalogs: true
I20260619 19:54:14.189216 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_92f5508aef334d42a58426bb75ba972a" } modify_external_catalogs: true
I20260619 19:54:14.192256 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97bf32159dc444559df0fc5c5cfd2452" } modify_external_catalogs: true
I20260619 19:54:14.194034 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e2103c40b6764802b83ec0dd628505e9" } modify_external_catalogs: true
I20260619 19:54:14.206096 2026 ts_tablet_manager.cc:1929] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:14.206415 2026 log.cc:1199] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/33ee0b30259741cdb2fb0e3c815e6b17
I20260619 19:54:14.207367 2941 raft_consensus.cc:493] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.207562 2941 raft_consensus.cc:515] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.208024 2026 ts_tablet_manager.cc:1950] T 33ee0b30259741cdb2fb0e3c815e6b17 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:14.208359 2941 leader_election.cc:290] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:14.209689 720 leader_election.cc:343] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:14.211424 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_2418879ae8fc4eadb945b509d8234ae2 [id=9a77efaee2cd4b07aa78d2910aeeab77]) successfully deleted
I20260619 19:54:14.211474 1994 tablet_replica.cc:333] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.211714 1994 raft_consensus.cc:2243] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.211982 1994 raft_consensus.cc:2272] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.212673 1994 ts_tablet_manager.cc:1916] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:14.218569 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7eb62e94c46749348a3bc2cadee42c79 consensus state has no leader
I20260619 19:54:14.221972 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0d241bec13be41218abdee2d77a73f53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.222741 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d241bec13be41218abdee2d77a73f53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.222700 1359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 4 candidate_status { last_received { term: 3 index: 697 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:54:14.243567 1200 tablet_bootstrap.cc:492] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:14.243840 1200 ts_tablet_manager.cc:1403] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.005s
I20260619 19:54:14.244383 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 4 candidate_status { last_received { term: 3 index: 697 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:54:14.244730 1200 raft_consensus.cc:359] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.244952 1200 raft_consensus.cc:385] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.245057 1200 raft_consensus.cc:740] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.245359 2242 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0; no voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:54:14.245347 1200 consensus_queue.cc:260] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.246177 2904 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 19:54:14.248189 1200 ts_tablet_manager.cc:1434] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:14.248497 1200 tablet_bootstrap.cc:492] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:14.250497 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2d95c0dbf62a4090832ccec6293c0ec4" } new_table_name: "default.Table_c1de804d9a3242d0a7e34f02ba00032e" modify_external_catalogs: true
I20260619 19:54:14.250828 1200 tablet_bootstrap.cc:654] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:14.227119 2949 log.cc:927] Time spent T 26355bc6b5c147a88c14a9f053b4e1f3 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260619 19:54:14.252180 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:54:14.235047 1201 tablet_bootstrap.cc:654] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.253033 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5710399e6e08425593af8f928adeace2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.253615 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5710399e6e08425593af8f928adeace2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.240723 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d905e7076014c818e1fb1ef09c15342" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.254102 915 raft_consensus.cc:2393] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:14.242226 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:14.256022 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fb6712fc0994154aa5022ec16cec1ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:14.256210 996 leader_election.cc:304] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:14.256403 996 raft_consensus.cc:2686] T fb6bc52ee1fa4ac8967f937e59b4550c P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:14.256623 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fb6712fc0994154aa5022ec16cec1ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.259066 2327 ts_manager.cc:194] Registered new tserver with Master: e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:14.242442 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 210867us
I20260619 19:54:14.262559 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:14.263592 2338 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "95181cc281b946c8b81aa825232d9498" instance_seqno: 1781898825902521) as {username='slave'} at 127.0.105.130:43707; Asking this server to re-register.
I20260619 19:54:14.265928 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.266145 915 raft_consensus.cc:2468] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:14.273245 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 261) took 9971 ms. Trace:
I20260619 19:54:14.273377 2026 rpcz_store.cc:276] 0619 19:54:04.302071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.302559 (+ 488us) service_pool.cc:224] Handling call
0619 19:54:14.041542 (+9738983us) ts_tablet_manager.cc:1151] Deleting tablet 33ee0b30259741cdb2fb0e3c815e6b17
0619 19:54:14.041553 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.068380 (+ 26827us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.205959 (+137579us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.273217 (+ 67258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9671247}
I20260619 19:54:14.273726 2026 tablet_replica.cc:333] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:14.273924 2026 raft_consensus.cc:2243] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:14.274245 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 239610us
I20260619 19:54:14.290737 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c47b97e1eeed4f20bfe001fa48dc0471
I20260619 19:54:14.291388 529 catalog_manager.cc:6784] ReplaceTablet: tablet c47b97e1eeed4f20bfe001fa48dc0471 deleted and replaced by tablet e8c52fca539243069032092b552030f9
W20260619 19:54:14.294215 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1fe5f6be6bf445509ab6a3bac320d525 consensus state has no leader
W20260619 19:54:14.296860 858 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.298038 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c47b97e1eeed4f20bfe001fa48dc0471 with delete_type TABLET_DATA_DELETED (replaced by tablet e8c52fca539243069032092b552030f9) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.298269 2920 consensus_queue.cc:1048] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:14.298790 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_72cf4d7f1df6437590fc200e5936fa21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.300664 719 leader_election.cc:343] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:54:14.300805 719 leader_election.cc:304] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.301281 2920 raft_consensus.cc:2749] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:14.301679 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_01a59125e9354956a7df1f8f0b26b592"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.302275 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01a59125e9354956a7df1f8f0b26b592 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.304932 719 leader_election.cc:304] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.305220 2941 raft_consensus.cc:3060] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.307322 968 heartbeater.cc:461] Registering TS with master...
I20260619 19:54:14.308074 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 33ee0b30259741cdb2fb0e3c815e6b17 (table default.Table_9229096a47ef4a3d912826fe42bda5b4 [id=6aa03c7c2ab84d148cd7c1192f6c2ca3]) successfully deleted
W20260619 19:54:14.309460 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72cf4d7f1df6437590fc200e5936fa21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.311698 2941 raft_consensus.cc:2749] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:14.316547 2026 raft_consensus.cc:2272] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.321923 1973 ts_tablet_manager.cc:1929] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:14.322269 1973 log.cc:1199] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:14.324580 2338 ts_manager.cc:194] Registered new tserver with Master: b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.324842 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet c47b97e1eeed4f20bfe001fa48dc0471 with delete_type TABLET_DATA_DELETED (replaced by tablet e8c52fca539243069032092b552030f9) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:14.313323 858 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.312062 1201 tablet_bootstrap.cc:492] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:14.327112 858 consensus_peers.cc:597] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:14.327519 2909 consensus_queue.cc:1048] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:14.328553 2953 consensus_queue.cc:1048] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:14.327318 1201 ts_tablet_manager.cc:1403] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.264s user 0.005s sys 0.002s
I20260619 19:54:14.329741 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:14.330034 1201 raft_consensus.cc:359] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.330446 859 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:54:14.331302 1201 raft_consensus.cc:385] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.331426 1201 raft_consensus.cc:740] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.331477 859 leader_election.cc:304] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.334631 2909 raft_consensus.cc:2749] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:14.322696 1973 ts_tablet_manager.cc:1950] T dff07e4afabc4e21a74ed0aa68c9026f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:14.323341 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfa4bcc850547dd8cc34d813c705f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:14.331694 1201 consensus_queue.cc:260] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.336266 1201 ts_tablet_manager.cc:1434] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:54:14.336709 1201 tablet_bootstrap.cc:492] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:14.336990 1208 tablet_bootstrap.cc:654] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.338963 1201 tablet_bootstrap.cc:654] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.341770 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 988e0a8b1b5b4f7cb68674af923454cf
I20260619 19:54:14.345566 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb62e94c46749348a3bc2cadee42c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:14.346324 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_82c02ca7771f4f82b3e8c9d066e7463e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.346910 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82c02ca7771f4f82b3e8c9d066e7463e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.347630 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 988e0a8b1b5b4f7cb68674af923454cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.348556 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8fd9525ba72d45b089442a6e6a73cc74
I20260619 19:54:14.350407 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fd9525ba72d45b089442a6e6a73cc74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:14.350486 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fd9525ba72d45b089442a6e6a73cc74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.353119 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet 988e0a8b1b5b4f7cb68674af923454cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:14.355739 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_88ebd05c9e0e449293d1245db9335476" } new_table_name: "default.Table_4cd5ba2cc22a454f8607edd045b8e774" modify_external_catalogs: true
I20260619 19:54:14.357240 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e84dba59116149e5aeb65d79a4d2e5fc
I20260619 19:54:14.358314 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_aece37580b584c31a97b2030aa7f0cf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:14.358644 1024 tablet_service.cc:1558] Processing DeleteTablet for tablet e84dba59116149e5aeb65d79a4d2e5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:14.358953 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aece37580b584c31a97b2030aa7f0cf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.359261 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 449) took 4736 ms. Trace:
I20260619 19:54:14.359344 1973 rpcz_store.cc:276] 0619 19:54:09.622821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.622956 (+ 135us) service_pool.cc:224] Handling call
0619 19:54:13.889085 (+4266129us) ts_tablet_manager.cc:1151] Deleting tablet dff07e4afabc4e21a74ed0aa68c9026f
0619 19:54:13.889095 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:13.960394 (+ 71299us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.321737 (+361343us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.359240 (+ 37503us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4265613}
I20260619 19:54:14.359579 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e84dba59116149e5aeb65d79a4d2e5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.359670 1973 tablet_replica.cc:333] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:14.359867 1973 raft_consensus.cc:2243] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.360004 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet dff07e4afabc4e21a74ed0aa68c9026f (table default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]) successfully deleted
I20260619 19:54:14.363642 2744 raft_consensus.cc:493] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.363852 2744 raft_consensus.cc:515] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.364634 2744 leader_election.cc:290] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.369447 1973 raft_consensus.cc:2272] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.369957 1973 ts_tablet_manager.cc:1916] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.368860 1208 tablet_bootstrap.cc:492] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.371443 1208 ts_tablet_manager.cc:1403] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.236s user 0.005s sys 0.008s
I20260619 19:54:14.372133 1208 raft_consensus.cc:359] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.372316 1208 raft_consensus.cc:385] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.372375 1208 raft_consensus.cc:740] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.372560 1208 consensus_queue.cc:260] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.373045 1208 ts_tablet_manager.cc:1434] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:14.373322 1208 tablet_bootstrap.cc:492] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.374750 1208 tablet_bootstrap.cc:654] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.344877 2026 ts_tablet_manager.cc:1916] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:14.356813 859 consensus_peers.cc:597] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41455237399b45efbe8190dcb01e764c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:14.378533 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fb6712fc0994154aa5022ec16cec1ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:14.378845 892 tablet_service.cc:1558] Processing DeleteTablet for tablet c47b97e1eeed4f20bfe001fa48dc0471 with delete_type TABLET_DATA_DELETED (replaced by tablet e8c52fca539243069032092b552030f9) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:14.378904 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 988e0a8b1b5b4f7cb68674af923454cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:14.379109 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fd9525ba72d45b089442a6e6a73cc74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:14.379374 900 tablet_service.cc:1558] Processing DeleteTablet for tablet e84dba59116149e5aeb65d79a4d2e5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:14.381359 858 consensus_peers.cc:597] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:14.400272 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 43497.1us
I20260619 19:54:14.403100 2715 raft_consensus.cc:493] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.403260 2715 raft_consensus.cc:515] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.403791 2715 leader_election.cc:290] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.405028 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c9073ef30d456d8dc8609ddf1335ce" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:14.407025 859 consensus_peers.cc:597] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe814880d9984bbd83fa121cb2a34eac. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:14.407167 858 leader_election.cc:343] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.407634 2909 consensus_queue.cc:1048] T 97b365df01054338a056cb0d469bc8db P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:14.408169 741 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 258) took 1185 ms. Trace:
I20260619 19:54:14.408314 741 rpcz_store.cc:276] 0619 19:54:13.222642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.222696 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:14.065514 (+842818us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x6160000c5e54. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:14.408117 (+342603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914511104}
I20260619 19:54:14.421010 1200 tablet_bootstrap.cc:492] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:14.422318 1200 ts_tablet_manager.cc:1403] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.174s user 0.003s sys 0.003s
I20260619 19:54:14.424854 1200 raft_consensus.cc:359] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.433070 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 58601.3us
I20260619 19:54:14.436673 2026 ts_tablet_manager.cc:1929] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:14.437379 1200 raft_consensus.cc:385] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.437719 1200 raft_consensus.cc:740] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.439404 1200 consensus_queue.cc:260] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.443369 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cfdd40b76a6046b18d83dabc35268af3 consensus state has no leader
I20260619 19:54:14.451591 2338 ts_manager.cc:194] Registered new tserver with Master: 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.460031 2982 tablet.cc:1724] T c2f9e5a4dedd4c81901cb99fecff0919 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:14.463232 527 master_service.cc:960] ReplaceTablet: received request to replace tablet d1d23b9d751c48ad858a35771b0ded61 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:14.440518 1056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c9073ef30d456d8dc8609ddf1335ce" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:14.464586 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_48480bf0e6404c51870932c9cb33ad23" } modify_external_catalogs: true
I20260619 19:54:14.464768 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_48480bf0e6404c51870932c9cb33ad23" } modify_external_catalogs: true
I20260619 19:54:14.464892 1056 raft_consensus.cc:2468] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:14.465294 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_13a373b0df95461581e1325a78c25c13" } new_table_name: "default.Table_194296d408ce42ee8dfb04120cc3af1c" modify_external_catalogs: true
I20260619 19:54:14.451764 1994 ts_tablet_manager.cc:1929] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.467258 1994 log.cc:1199] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b2902c7f67a1402987315ee426ddf1d2
I20260619 19:54:14.467576 1200 ts_tablet_manager.cc:1434] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260619 19:54:14.467890 1200 tablet_bootstrap.cc:492] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:14.468101 1994 ts_tablet_manager.cc:1950] T b2902c7f67a1402987315ee426ddf1d2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.469347 1200 tablet_bootstrap.cc:654] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.469702 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b2902c7f67a1402987315ee426ddf1d2 (table default.Table_5e38109b2d8b496290d95d8b61a1512b [id=902aaad2317e43f891464a10dd2e334f]) successfully deleted
I20260619 19:54:14.474632 1994 tablet_replica.cc:333] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.476879 1994 raft_consensus.cc:2243] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.478626 1994 raft_consensus.cc:2272] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.485600 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1297e60fa2f449378cd87ab38fa206b1" } new_table_name: "default.Table_55803a427a8c45fb8c379a3a59e6957a" modify_external_catalogs: true
I20260619 19:54:14.487900 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e7da0319526a4bb4bbd15f494f7ce2cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.488464 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7da0319526a4bb4bbd15f494f7ce2cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.489813 528 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:14.491271 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5062c62488f6467a9fbcb70bea9f24f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.492026 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5062c62488f6467a9fbcb70bea9f24f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:14.494257 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79bcc998cf6c4d3e851a437ccd2edb92 consensus state has no leader
I20260619 19:54:14.494642 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_247be2054e924a3885a4822bb5c4c2d3" } modify_external_catalogs: true
I20260619 19:54:14.494791 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_247be2054e924a3885a4822bb5c4c2d3" } modify_external_catalogs: true
W20260619 19:54:14.477522 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 221332us
I20260619 19:54:14.503582 1994 ts_tablet_manager.cc:1916] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.504375 996 leader_election.cc:304] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.513236 2744 raft_consensus.cc:2804] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.513352 2744 raft_consensus.cc:493] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.513425 2744 raft_consensus.cc:3060] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.516137 2744 raft_consensus.cc:515] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.516806 2744 leader_election.cc:290] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.521737 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:14.522548 2026 log.cc:1199] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fade40bf3e7145f29076821f091677bd
I20260619 19:54:14.523413 2026 ts_tablet_manager.cc:1950] T fade40bf3e7145f29076821f091677bd P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:14.501187 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c9073ef30d456d8dc8609ddf1335ce" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:14.524832 1200 tablet_bootstrap.cc:492] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:14.525023 1200 ts_tablet_manager.cc:1403] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20260619 19:54:14.525739 1200 raft_consensus.cc:359] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.525971 1200 raft_consensus.cc:385] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.526065 1200 raft_consensus.cc:740] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.526328 1200 consensus_queue.cc:260] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.528918 1200 ts_tablet_manager.cc:1434] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:14.529284 1200 tablet_bootstrap.cc:492] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:14.530779 1200 tablet_bootstrap.cc:654] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.441438 2961 raft_consensus.cc:493] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.531025 2961 raft_consensus.cc:515] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.531474 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cad702900111463fa298c76098746bfb consensus state has no leader
I20260619 19:54:14.531777 2961 leader_election.cc:290] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.442296 2962 consensus_queue.cc:1048] T 5aaf38b6b7b14298ae0e73bc421de988 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:14.531988 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 265) took 10174 ms. Trace:
I20260619 19:54:14.531909 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_97afba45159d435bae3025f31b4472e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:14.532083 2026 rpcz_store.cc:276] 0619 19:54:04.357171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.357250 (+ 79us) service_pool.cc:224] Handling call
0619 19:54:14.273680 (+9916430us) ts_tablet_manager.cc:1151] Deleting tablet fade40bf3e7145f29076821f091677bd
0619 19:54:14.273688 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.433632 (+159944us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.436617 (+ 2985us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.531966 (+ 95349us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9900448}
I20260619 19:54:14.454650 2539 raft_consensus.cc:493] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:14.532480 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97afba45159d435bae3025f31b4472e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.532413 2539 raft_consensus.cc:515] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.532974 2539 leader_election.cc:290] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.462033 2981 tablet.cc:1724] T c2f9e5a4dedd4c81901cb99fecff0919 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:14.533653 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fade40bf3e7145f29076821f091677bd (table default.Table_e07b9aab54da4c9a89ab3a73ae8dc6fc [id=7a2746a71d40404a9c2ddf50e04ec15c]) successfully deleted
I20260619 19:54:14.534183 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e83f9ca778734ffba85a723a7f35ae4f" } new_table_name: "default.Table_633f3214b3e74337a37d4e0000d6e0c2" modify_external_catalogs: true
I20260619 19:54:14.535374 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:14.535588 2941 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:14.535704 2941 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.536260 2941 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:14.537070 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ca6d7f30c5a84106bebebc42eedee654
I20260619 19:54:14.537258 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.537424 917 raft_consensus.cc:2468] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:14.537855 719 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
W20260619 19:54:14.537961 858 leader_election.cc:343] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.537818 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b59b55dfe04f45c98219770cd72e72a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.538439 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b59b55dfe04f45c98219770cd72e72a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:14.538466 720 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:14.538812 2920 raft_consensus.cc:2804] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:14.538885 2920 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:14.538955 2920 raft_consensus.cc:3060] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:14.540027 749 tablet_service.cc:1558] Processing DeleteTablet for tablet ca6d7f30c5a84106bebebc42eedee654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:14.541265 528 master_service.cc:960] ReplaceTablet: received request to replace tablet 73029f4bc97349da9d5d2fae4321cd5f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:14.542273 900 tablet_service.cc:1558] Processing DeleteTablet for tablet ca6d7f30c5a84106bebebc42eedee654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:14.543327 2941 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:14.500347 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c9073ef30d456d8dc8609ddf1335ce" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.543469 2941 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.543710 919 raft_consensus.cc:2468] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:14.544106 2941 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:14.544644 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:14.544972 720 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74f39941c13847d79e2b2c3ddd176533
I20260619 19:54:14.545295 719 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.545699 2941 raft_consensus.cc:2749] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:14.546451 2920 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.504325 859 leader_election.cc:304] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.440696 1201 tablet_bootstrap.cc:492] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:14.547245 2539 raft_consensus.cc:2804] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.547326 2539 raft_consensus.cc:493] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.547458 2539 raft_consensus.cc:3060] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.550032 2539 raft_consensus.cc:515] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.551635 2539 leader_election.cc:290] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:14.552068 858 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:14.552762 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c9073ef30d456d8dc8609ddf1335ce" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:14.523672 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:14.553229 915 raft_consensus.cc:3060] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.555895 915 raft_consensus.cc:2468] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:14.556855 858 leader_election.cc:343] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.557121 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ea0540509a4445559c0986f276263022" } modify_external_catalogs: true
I20260619 19:54:14.557435 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ea0540509a4445559c0986f276263022" } modify_external_catalogs: true
I20260619 19:54:14.547319 1201 ts_tablet_manager.cc:1403] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.211s user 0.003s sys 0.003s
I20260619 19:54:14.562978 1201 raft_consensus.cc:359] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.563215 1201 raft_consensus.cc:385] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.563277 1201 raft_consensus.cc:740] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.563494 1201 consensus_queue.cc:260] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.564004 1201 ts_tablet_manager.cc:1434] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:14.564340 1201 tablet_bootstrap.cc:492] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:14.568291 859 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:14.568452 859 leader_election.cc:304] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.568717 2986 raft_consensus.cc:2749] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:14.569002 859 consensus_peers.cc:597] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ce88d3d4ea340dcaa9d8e26f9a047a7. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:14.573137 1973 ts_tablet_manager.cc:1929] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.573271 1973 log.cc:1199] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f8a589ce3ae94cd1bb28b15e4e0e4a22
I20260619 19:54:14.573541 1973 ts_tablet_manager.cc:1950] T f8a589ce3ae94cd1bb28b15e4e0e4a22 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:14.584369 1201 tablet_bootstrap.cc:654] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.585701 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 262) took 10262 ms. Trace:
I20260619 19:54:14.591662 745 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 259) took 1308 ms. Trace:
I20260619 19:54:14.591873 745 rpcz_store.cc:276] 0619 19:54:13.282892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.282960 (+ 68us) service_pool.cc:224] Handling call
0619 19:54:13.858897 (+575937us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x616000341554. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:13.958672 (+ 99775us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x6180001d008c. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4e73c4be 00007eff4e53690c 00007eff51060d28 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138
0619 19:54:14.401630 (+442958us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x616000331654. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:14.591597 (+189967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497164544}
I20260619 19:54:14.593797 2026 rpcz_store.cc:276] 0619 19:54:04.323506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.323621 (+ 115us) service_pool.cc:224] Handling call
0619 19:54:14.585560 (+10261939us) ts_tablet_manager.cc:1151] Deleting tablet 8ce7f825e5f84d5985427e83ee6a989d
0619 19:54:14.585570 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.585681 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10204508}
W20260619 19:54:14.598439 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 8ce7f825e5f84d5985427e83ee6a989d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ce7f825e5f84d5985427e83ee6a989d already in progress: creating tablet
I20260619 19:54:14.602824 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 263) took 10278 ms. Trace:
I20260619 19:54:14.610841 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 451) took 4757 ms. Trace:
I20260619 19:54:14.606936 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2b5d12ab7465791f26d214c2dc2f5" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:14.612037 915 raft_consensus.cc:3060] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:54:14.612696 720 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:14.614751 915 raft_consensus.cc:2468] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
I20260619 19:54:14.615213 719 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.615485 2757 raft_consensus.cc:2804] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:14.615622 2757 raft_consensus.cc:697] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:14.615862 2757 consensus_queue.cc:237] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.616369 2920 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:14.615549 2026 rpcz_store.cc:276] 0619 19:54:04.324848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.325671 (+ 823us) service_pool.cc:224] Handling call
0619 19:54:14.602691 (+10277020us) ts_tablet_manager.cc:1151] Deleting tablet 0991105460f749e1854d512304ff56cd
0619 19:54:14.602701 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.602801 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10179096}
W20260619 19:54:14.619721 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 0991105460f749e1854d512304ff56cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0991105460f749e1854d512304ff56cd already in progress: creating tablet
I20260619 19:54:14.623961 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 268) took 10213 ms. Trace:
I20260619 19:54:14.624306 2026 rpcz_store.cc:276] 0619 19:54:04.410424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.414664 (+ 4240us) service_pool.cc:224] Handling call
0619 19:54:14.622836 (+10208172us) ts_tablet_manager.cc:1151] Deleting tablet 1ca68b755bf841509b6ffcfbe212278c
0619 19:54:14.622853 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.623939 (+ 1086us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10195912}
I20260619 19:54:14.626839 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ee493ced7f6f407db5eda645752fb00a" } modify_external_catalogs: true
I20260619 19:54:14.627049 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ee493ced7f6f407db5eda645752fb00a" } modify_external_catalogs: true
W20260619 19:54:14.628418 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 1ca68b755bf841509b6ffcfbe212278c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca68b755bf841509b6ffcfbe212278c already in progress: creating tablet
I20260619 19:54:14.629522 2026 tablet_replica.cc:333] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:14.630119 2026 raft_consensus.cc:2243] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.632649 2026 raft_consensus.cc:2272] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.635315 2026 ts_tablet_manager.cc:1916] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:14.639609 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34206a3e10fe4c82bfc7666c8327d707 has no consensus state
I20260619 19:54:14.612708 1973 rpcz_store.cc:276] 0619 19:54:09.853121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.853196 (+ 75us) service_pool.cc:224] Handling call
0619 19:54:14.359615 (+4506419us) ts_tablet_manager.cc:1151] Deleting tablet f8a589ce3ae94cd1bb28b15e4e0e4a22
0619 19:54:14.359625 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.459777 (+100152us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.573077 (+113300us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.610814 (+ 37737us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4506166}
I20260619 19:54:14.640002 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1" } modify_external_catalogs: true
I20260619 19:54:14.640189 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4f018d9af9ac4d1baf2f2a2c608aa4b1" } modify_external_catalogs: true
I20260619 19:54:14.640386 1201 tablet_bootstrap.cc:492] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:14.640513 1201 ts_tablet_manager.cc:1403] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.001s
I20260619 19:54:14.641199 1201 raft_consensus.cc:359] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.539659 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ca6d7f30c5a84106bebebc42eedee654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:14.548933 996 consensus_peers.cc:597] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:14.550817 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:14.642858 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 93972.5us
I20260619 19:54:14.642949 1055 raft_consensus.cc:2468] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:54:14.643069 996 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:14.643266 996 leader_election.cc:343] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.643949 996 leader_election.cc:304] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.644320 996 leader_election.cc:304] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.559113 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c9073ef30d456d8dc8609ddf1335ce" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:14.644677 1057 raft_consensus.cc:3060] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.648901 1057 raft_consensus.cc:2468] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:14.649055 2744 raft_consensus.cc:2764] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260619 19:54:14.581216 1994 ts_tablet_manager.cc:1929] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.649338 1994 log.cc:1199] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/05c9a91f95bb4bcdafe493bab8c393b4
I20260619 19:54:14.649369 2744 raft_consensus.cc:2804] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:14.649469 2744 raft_consensus.cc:697] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:14.649696 2744 consensus_queue.cc:237] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.650293 1973 tablet_replica.cc:333] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:14.650484 1973 raft_consensus.cc:2243] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.650657 1973 raft_consensus.cc:2272] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.651243 1973 ts_tablet_manager.cc:1916] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.651731 524 master_service.cc:960] ReplaceTablet: received request to replace tablet dfb556a60a9749a2889ad84db2294f8e from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:14.652360 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_46bc484129474a3e99f1add149b09e6a" } new_table_name: "default.Table_4647d0fd20864186920dcfb257dfc867" modify_external_catalogs: true
I20260619 19:54:14.649700 1994 ts_tablet_manager.cc:1950] T 05c9a91f95bb4bcdafe493bab8c393b4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.659073 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 05c9a91f95bb4bcdafe493bab8c393b4 (table default.Table_e1877af4dc434ff5a38408207ea93c47 [id=9217b336b73943539d0822ba734db057]) successfully deleted
I20260619 19:54:14.659528 1994 tablet_replica.cc:333] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.659785 1994 raft_consensus.cc:2243] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.660009 1994 raft_consensus.cc:2272] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.660665 1994 ts_tablet_manager.cc:1916] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.626937 2997 tablet.cc:1724] T c2f9e5a4dedd4c81901cb99fecff0919 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:14.645407 859 leader_election.cc:304] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.663659 2986 raft_consensus.cc:2804] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.663764 2986 raft_consensus.cc:493] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.663861 2986 raft_consensus.cc:3060] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.666640 859 leader_election.cc:304] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.667052 2962 raft_consensus.cc:2804] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:54:14.667291 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet a7100b0bfa6d4e3baf4e7f90217f1fff (table default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet a7100b0bfa6d4e3baf4e7f90217f1fff consensus state has no leader
I20260619 19:54:14.667330 2962 raft_consensus.cc:697] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:14.667593 2962 consensus_queue.cc:237] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.666874 2986 raft_consensus.cc:515] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.669214 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
W20260619 19:54:14.669714 859 leader_election.cc:343] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: Tablet not RUNNING: STOPPED
I20260619 19:54:14.670356 2986 leader_election.cc:290] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.671280 1208 tablet_bootstrap.cc:492] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.671444 1208 ts_tablet_manager.cc:1403] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.298s user 0.007s sys 0.003s
I20260619 19:54:14.672325 1208 raft_consensus.cc:359] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.672533 1208 raft_consensus.cc:385] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.672609 1208 raft_consensus.cc:740] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.672694 1201 raft_consensus.cc:385] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.672904 1208 consensus_queue.cc:260] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.673843 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:14.673943 1208 ts_tablet_manager.cc:1434] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:14.674273 1208 tablet_bootstrap.cc:492] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.674480 2966 ts_tablet_manager.cc:933] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: Initiating tablet copy from peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:14.674508 1201 raft_consensus.cc:740] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.674726 1201 consensus_queue.cc:260] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:14.676462 858 leader_election.cc:343] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.676577 858 leader_election.cc:304] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.677213 2953 raft_consensus.cc:2749] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:14.678647 1201 ts_tablet_manager.cc:1434] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260619 19:54:14.683949 1201 tablet_bootstrap.cc:492] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:14.689832 1201 tablet_bootstrap.cc:654] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.691095 1208 tablet_bootstrap.cc:654] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.697371 2966 tablet_copy_client.cc:323] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: tablet copy: Beginning tablet copy session from remote peer at address 127.0.105.129:41107
I20260619 19:54:14.703504 1973 ts_tablet_manager.cc:1929] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:14.707491 1994 ts_tablet_manager.cc:1929] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.707638 1994 log.cc:1199] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/774938222588473e90c513232c82aece
I20260619 19:54:14.707926 1994 ts_tablet_manager.cc:1950] T 774938222588473e90c513232c82aece P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.708806 1994 tablet_replica.cc:333] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.708997 1994 raft_consensus.cc:2243] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.709003 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 774938222588473e90c513232c82aece (table default.Table_acb740f517fd4c61bff72f7ceafb5f75 [id=7f73d9f5b89c4d5798cb7f9d95595c8f]) successfully deleted
I20260619 19:54:14.709136 1994 raft_consensus.cc:2272] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.709601 1994 ts_tablet_manager.cc:1916] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.721884 1973 log.cc:1199] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b8e3354ae6dd46bd9c5414d4c4a720a1
W20260619 19:54:14.722209 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c52eaeef941140ecb8d1045c88c7231b has no consensus state
I20260619 19:54:14.724306 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cc7858b6eabf4a87957b2964dd1cfde4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:14.728185 1208 tablet_bootstrap.cc:492] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.728581 1208 ts_tablet_manager.cc:1403] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.000s
I20260619 19:54:14.728760 1973 ts_tablet_manager.cc:1950] T b8e3354ae6dd46bd9c5414d4c4a720a1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:14.730558 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 452) took 4876 ms. Trace:
I20260619 19:54:14.729660 1208 raft_consensus.cc:359] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.734295 1208 raft_consensus.cc:385] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.734437 1208 raft_consensus.cc:740] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.734709 1208 consensus_queue.cc:260] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.735065 1201 tablet_bootstrap.cc:492] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:14.736783 1201 ts_tablet_manager.cc:1403] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.002s
I20260619 19:54:14.737669 1201 raft_consensus.cc:359] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.737915 1201 raft_consensus.cc:385] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.738029 1201 raft_consensus.cc:740] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.738543 1201 consensus_queue.cc:260] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.739349 1201 ts_tablet_manager.cc:1434] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:14.739682 1201 tablet_bootstrap.cc:492] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:14.735345 1208 ts_tablet_manager.cc:1434] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:54:14.741488 1201 tablet_bootstrap.cc:654] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.741871 1208 tablet_bootstrap.cc:492] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.747089 2962 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:14.747915 2962 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.748579 1208 tablet_bootstrap.cc:654] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.749302 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:14.749509 779 raft_consensus.cc:2468] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:14.750115 859 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74f39941c13847d79e2b2c3ddd176533
I20260619 19:54:14.750706 858 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.750957 2909 raft_consensus.cc:2804] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:14.751015 2909 raft_consensus.cc:493] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:14.751073 2909 raft_consensus.cc:3060] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:14.734166 1973 rpcz_store.cc:276] 0619 19:54:09.853766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.853847 (+ 81us) service_pool.cc:224] Handling call
0619 19:54:14.650240 (+4796393us) ts_tablet_manager.cc:1151] Deleting tablet b8e3354ae6dd46bd9c5414d4c4a720a1
0619 19:54:14.650251 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.697378 (+ 47127us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.703419 (+ 6041us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.730537 (+ 27118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4796189}
I20260619 19:54:14.753667 2909 raft_consensus.cc:515] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.754848 2909 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:14.756172 859 leader_election.cc:343] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74f39941c13847d79e2b2c3ddd176533
I20260619 19:54:14.757031 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f39941c13847d79e2b2c3ddd176533" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:14.757225 779 raft_consensus.cc:3060] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:14.757750 2962 leader_election.cc:290] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:14.760414 779 raft_consensus.cc:2468] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 2.
I20260619 19:54:14.761719 1208 tablet_bootstrap.cc:492] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.761658 858 leader_election.cc:304] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.761972 1208 ts_tablet_manager.cc:1403] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260619 19:54:14.762291 2962 raft_consensus.cc:2804] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:14.762578 2962 raft_consensus.cc:697] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:14.762895 1208 raft_consensus.cc:359] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.763145 1208 raft_consensus.cc:385] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.763221 1208 raft_consensus.cc:740] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.763049 2962 consensus_queue.cc:237] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:14.763471 1208 consensus_queue.cc:260] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.764039 1208 ts_tablet_manager.cc:1434] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260619 19:54:14.764942 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 107179us
I20260619 19:54:14.765604 3004 consensus_queue.cc:1048] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:14.766104 805 tablet_copy_service.cc:140] P b1f5f240547f42ec82f57e6c8af5ea89: Received BeginTabletCopySession request for tablet 26355bc6b5c147a88c14a9f053b4e1f3 from peer e78a44e2c8824fe7bce462e9d33f660c ({username='slave'} at 127.0.105.131:41381)
I20260619 19:54:14.766275 805 tablet_copy_service.cc:161] P b1f5f240547f42ec82f57e6c8af5ea89: Beginning new tablet copy session on tablet 26355bc6b5c147a88c14a9f053b4e1f3 from peer e78a44e2c8824fe7bce462e9d33f660c at {username='slave'} at 127.0.105.131:41381: session id = e78a44e2c8824fe7bce462e9d33f660c-26355bc6b5c147a88c14a9f053b4e1f3
I20260619 19:54:14.770380 805 tablet_copy_source_session.cc:215] T 26355bc6b5c147a88c14a9f053b4e1f3 P b1f5f240547f42ec82f57e6c8af5ea89: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 19:54:14.772559 1200 tablet_bootstrap.cc:492] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:14.772878 1200 ts_tablet_manager.cc:1403] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.244s user 0.002s sys 0.002s
I20260619 19:54:14.774398 1200 raft_consensus.cc:359] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.774820 1200 raft_consensus.cc:385] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.774977 1200 raft_consensus.cc:740] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.775484 1200 consensus_queue.cc:260] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.776314 1994 ts_tablet_manager.cc:1929] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.776950 1994 log.cc:1199] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/ba0cd4cd0661415d8b2b2339363e7aca
I20260619 19:54:14.778846 1994 ts_tablet_manager.cc:1950] T ba0cd4cd0661415d8b2b2339363e7aca P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.672947 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f8a589ce3ae94cd1bb28b15e4e0e4a22 (table default.Table_6fd994ad984e43798d665d87cf37c8f1 [id=f39b6874290545f29bfb9600bed63ba6]) successfully deleted
W20260619 19:54:14.783970 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 110969us
I20260619 19:54:14.784513 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b8e3354ae6dd46bd9c5414d4c4a720a1 (table default.Table_02d1f42490804c6ea53f8e922447bfc5 [id=9e1c0c34304342798f62913f9627ca0f]) successfully deleted
W20260619 19:54:14.784818 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc7858b6eabf4a87957b2964dd1cfde4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.794870 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_227f6683e0654c1a8d6b3993255ae331"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:14.795192 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 583) took 1051 ms. Trace:
W20260619 19:54:14.795892 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_227f6683e0654c1a8d6b3993255ae331 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.797663 1994 rpcz_store.cc:276] 0619 19:54:13.744058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.745219 (+ 1161us) service_pool.cc:224] Handling call
0619 19:54:14.708762 (+963543us) ts_tablet_manager.cc:1151] Deleting tablet ba0cd4cd0661415d8b2b2339363e7aca
0619 19:54:14.708771 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.746747 (+ 37976us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.776102 (+ 29355us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.795119 (+ 19017us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":955729}
I20260619 19:54:14.798779 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet ba0cd4cd0661415d8b2b2339363e7aca (table default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]) successfully deleted
I20260619 19:54:14.799170 1994 tablet_replica.cc:333] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.799386 1994 raft_consensus.cc:2243] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:14.799609 1994 pending_rounds.cc:70] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:14.803194 1994 pending_rounds.cc:77] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657705394405376 op_type: NO_OP noop_request { }
I20260619 19:54:14.803445 1994 raft_consensus.cc:2889] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:14.803610 1994 raft_consensus.cc:2272] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.804765 1994 ts_tablet_manager.cc:1916] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.809223 3003 raft_consensus.cc:493] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.809505 3003 raft_consensus.cc:515] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.810340 3003 leader_election.cc:290] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.810907 2966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26355bc6b5c147a88c14a9f053b4e1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:14.810887 2997 tablet.cc:1724] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:14.822072 2966 tablet_copy_client.cc:806] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: tablet copy: Starting download of 0 data blocks...
I20260619 19:54:14.822530 2966 tablet_copy_client.cc:670] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: tablet copy: Starting download of 1 WAL segments...
I20260619 19:54:14.829200 2920 raft_consensus.cc:493] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.829854 2920 raft_consensus.cc:515] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.830585 2920 leader_election.cc:290] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.830921 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:14.832417 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aaf38b6b7b14298ae0e73bc421de988" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.831087 1994 ts_tablet_manager.cc:1929] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:14.832916 1994 log.cc:1199] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/47ace991ad1a4d52ab609940aacf6681
I20260619 19:54:14.833218 719 leader_election.cc:304] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.833727 2920 raft_consensus.cc:2749] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:14.834609 1994 ts_tablet_manager.cc:1950] T 47ace991ad1a4d52ab609940aacf6681 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.836097 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5a155405123a4e39958b742564b7817e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.836874 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a155405123a4e39958b742564b7817e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.837662 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 584) took 1093 ms. Trace:
I20260619 19:54:14.838064 2920 raft_consensus.cc:493] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.838215 2920 raft_consensus.cc:515] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.839358 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f305a99e3481419196532cb5c62c2500" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.839300 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f305a99e3481419196532cb5c62c2500" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:14.840096 2920 leader_election.cc:290] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.840171 720 leader_election.cc:304] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:14.840598 1994 rpcz_store.cc:276] 0619 19:54:13.744136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.745327 (+ 1191us) service_pool.cc:224] Handling call
0619 19:54:14.799086 (+1053759us) ts_tablet_manager.cc:1151] Deleting tablet 47ace991ad1a4d52ab609940aacf6681
0619 19:54:14.799097 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.820413 (+ 21316us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.831009 (+ 10596us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.837627 (+ 6618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1046011}
I20260619 19:54:14.841221 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a]) successfully deleted
I20260619 19:54:14.845690 2920 raft_consensus.cc:2749] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:14.847278 1973 tablet_replica.cc:333] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:14.847489 1973 raft_consensus.cc:2243] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:14.847491 1208 tablet_bootstrap.cc:492] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.847805 1973 pending_rounds.cc:70] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:14.847867 1973 pending_rounds.cc:77] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657685174235136 op_type: NO_OP noop_request { }
I20260619 19:54:14.847972 1973 raft_consensus.cc:2889] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:14.848057 1973 raft_consensus.cc:2272] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.848683 1973 ts_tablet_manager.cc:1916] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.849933 1208 tablet_bootstrap.cc:654] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.851653 2026 ts_tablet_manager.cc:1929] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.853605 1994 tablet_replica.cc:333] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.854172 1994 raft_consensus.cc:2243] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:14.858659 1973 ts_tablet_manager.cc:1929] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:14.858809 1973 log.cc:1199] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/74949d09466f42e2852389e10192989d
I20260619 19:54:14.859218 1973 ts_tablet_manager.cc:1950] T 74949d09466f42e2852389e10192989d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:14.860249 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:14.861447 1994 pending_rounds.cc:70] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:14.867813 2982 tablet.cc:1724] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:14.868093 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 453) took 5013 ms. Trace:
I20260619 19:54:14.868203 1973 rpcz_store.cc:276] 0619 19:54:09.854686 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.854766 (+ 80us) service_pool.cc:224] Handling call
0619 19:54:14.752679 (+4897913us) ts_tablet_manager.cc:1151] Deleting tablet 74949d09466f42e2852389e10192989d
0619 19:54:14.847196 (+ 94517us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.851985 (+ 4789us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.858592 (+ 6607us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.868072 (+ 9480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":4897655}
I20260619 19:54:14.868813 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 74949d09466f42e2852389e10192989d (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]) successfully deleted
I20260619 19:54:14.869252 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 454) took 5013 ms. Trace:
I20260619 19:54:14.869339 1973 rpcz_store.cc:276] 0619 19:54:09.855541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.855621 (+ 80us) service_pool.cc:224] Handling call
0619 19:54:14.869132 (+5013511us) ts_tablet_manager.cc:1151] Deleting tablet 991c877feeae43c580d9471c25c4424c
0619 19:54:14.869145 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.869231 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5013311}
W20260619 19:54:14.869824 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 991c877feeae43c580d9471c25c4424c because the tablet was not found. No further retry: Not found: Tablet not found: 991c877feeae43c580d9471c25c4424c
I20260619 19:54:14.870155 1973 tablet_replica.cc:333] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:14.870404 1973 raft_consensus.cc:2243] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.870594 1973 raft_consensus.cc:2272] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.871366 1973 ts_tablet_manager.cc:1916] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.867408 1994 pending_rounds.cc:77] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657703960301568 op_type: NO_OP noop_request { }
I20260619 19:54:14.879709 1994 raft_consensus.cc:2889] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:14.880056 1994 raft_consensus.cc:2272] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.880060 1200 ts_tablet_manager.cc:1434] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.107s user 0.000s sys 0.002s
I20260619 19:54:14.881031 1200 tablet_bootstrap.cc:492] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:14.881489 1994 ts_tablet_manager.cc:1916] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.882601 1200 tablet_bootstrap.cc:654] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.888116 3003 raft_consensus.cc:493] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:14.888280 3003 raft_consensus.cc:515] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.888803 3003 leader_election.cc:290] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.892572 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2943333e572e4f1384b78d96a27d9c63" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:14.893229 1208 tablet_bootstrap.cc:492] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.893455 1208 ts_tablet_manager.cc:1403] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.006s
I20260619 19:54:14.894268 1208 raft_consensus.cc:359] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.894522 1208 raft_consensus.cc:385] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.894623 1208 raft_consensus.cc:740] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.894940 1208 consensus_queue.cc:260] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.895651 1208 ts_tablet_manager.cc:1434] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:14.896152 1208 tablet_bootstrap.cc:492] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.898598 1208 tablet_bootstrap.cc:654] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:14.900084 996 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.900946 2966 tablet_copy_client.cc:538] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 19:54:14.905524 2966 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:14.864625 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.891839 2981 tablet.cc:1724] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:14.912602 915 raft_consensus.cc:2468] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:14.912993 2026 log.cc:1199] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:14.913611 2026 ts_tablet_manager.cc:1950] T 9d905e7076014c818e1fb1ef09c15342 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:14.914572 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 274) took 10473 ms. Trace:
I20260619 19:54:14.914729 2026 rpcz_store.cc:276] 0619 19:54:04.440659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.443707 (+ 3048us) service_pool.cc:224] Handling call
0619 19:54:14.629467 (+10185760us) ts_tablet_manager.cc:1151] Deleting tablet 9d905e7076014c818e1fb1ef09c15342
0619 19:54:14.629478 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.638509 (+ 9031us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.851589 (+213080us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.914550 (+ 62961us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10153200}
I20260619 19:54:14.915410 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9d905e7076014c818e1fb1ef09c15342 (table default.Table_4d84da14868f41e5afe84ea58bd57ab9 [id=6e5582a72f36485783705cfb2f671ddb]) successfully deleted
I20260619 19:54:14.897765 1201 tablet_bootstrap.cc:492] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:14.917060 1201 ts_tablet_manager.cc:1403] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.177s user 0.006s sys 0.007s
I20260619 19:54:14.918112 1201 raft_consensus.cc:359] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.918372 1201 raft_consensus.cc:385] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.918463 1201 raft_consensus.cc:740] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.918751 1201 consensus_queue.cc:260] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.919508 1201 ts_tablet_manager.cc:1434] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:14.919936 1201 tablet_bootstrap.cc:492] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:14.920858 3015 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6cc90ee2d59d4dddae6790dd92b20cb5)
I20260619 19:54:14.921737 1201 tablet_bootstrap.cc:654] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.921828 3015 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } }
I20260619 19:54:14.923478 3015 leader_election.cc:290] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 031619d60e724837bd292c5ce23d0aff (127.0.105.190:46791), 6cc90ee2d59d4dddae6790dd92b20cb5 (127.0.105.189:45849)
I20260619 19:54:14.923481 541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 4 candidate_status { last_received { term: 3 index: 697 } } ignore_live_leader: false dest_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" is_pre_election: true
I20260619 19:54:14.924226 1208 tablet_bootstrap.cc:492] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.924409 1208 ts_tablet_manager.cc:1403] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.004s
I20260619 19:54:14.924520 1363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d38b77ff37948e19592b36b6d884fe0" candidate_term: 4 candidate_status { last_received { term: 3 index: 697 } } ignore_live_leader: false dest_uuid: "031619d60e724837bd292c5ce23d0aff" is_pre_election: true
I20260619 19:54:14.925153 2225 leader_election.cc:304] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d38b77ff37948e19592b36b6d884fe0; no voters: 031619d60e724837bd292c5ce23d0aff, 6cc90ee2d59d4dddae6790dd92b20cb5
I20260619 19:54:14.925305 1208 raft_consensus.cc:359] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.925452 1208 raft_consensus.cc:385] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.925500 1208 raft_consensus.cc:740] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.925700 1208 consensus_queue.cc:260] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.926318 1208 ts_tablet_manager.cc:1434] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:14.926795 1208 tablet_bootstrap.cc:492] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:14.926822 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_af8379e2099643ab834cb55af9529eb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.927551 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af8379e2099643ab834cb55af9529eb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.928535 1208 tablet_bootstrap.cc:654] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.928624 3015 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 19:54:14.905553 1994 ts_tablet_manager.cc:1929] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:14.929694 1994 log.cc:1199] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f305a99e3481419196532cb5c62c2500
I20260619 19:54:14.930182 1994 ts_tablet_manager.cc:1950] T f305a99e3481419196532cb5c62c2500 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.931108 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 585) took 1186 ms. Trace:
I20260619 19:54:14.931275 1994 rpcz_store.cc:276] 0619 19:54:13.744212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.745406 (+ 1194us) service_pool.cc:224] Handling call
0619 19:54:14.853537 (+1108131us) ts_tablet_manager.cc:1151] Deleting tablet f305a99e3481419196532cb5c62c2500
0619 19:54:14.853550 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.890404 (+ 36854us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.905486 (+ 15082us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.931088 (+ 25602us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100424}
I20260619 19:54:14.931823 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f305a99e3481419196532cb5c62c2500 (table default.Table_1d74433076a3413f90471ec48b668e5f [id=7020f678d0034cd59f74dce2a0ecf0bf]) successfully deleted
I20260619 19:54:14.932197 1994 tablet_replica.cc:333] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.932439 1994 raft_consensus.cc:2243] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.932605 1994 raft_consensus.cc:2272] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.933652 1994 ts_tablet_manager.cc:1916] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.939234 1994 ts_tablet_manager.cc:1929] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.939510 1994 log.cc:1199] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/e6dcf87d57044279a218cbb21c383352
W20260619 19:54:14.939648 996 leader_election.cc:343] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:14.939899 1994 ts_tablet_manager.cc:1950] T e6dcf87d57044279a218cbb21c383352 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.940703 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 586) took 1196 ms. Trace:
I20260619 19:54:14.940747 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2943333e572e4f1384b78d96a27d9c63" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:14.940852 1994 rpcz_store.cc:276] 0619 19:54:13.744290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.745494 (+ 1204us) service_pool.cc:224] Handling call
0619 19:54:14.932147 (+1186653us) ts_tablet_manager.cc:1151] Deleting tablet e6dcf87d57044279a218cbb21c383352
0619 19:54:14.932157 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.936975 (+ 4818us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.939073 (+ 2098us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.940681 (+ 1608us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179005}
I20260619 19:54:14.941072 915 raft_consensus.cc:2468] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:14.941581 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet e6dcf87d57044279a218cbb21c383352 (table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]) successfully deleted
I20260619 19:54:14.942044 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 590) took 1169 ms. Trace:
I20260619 19:54:14.942162 1994 rpcz_store.cc:276] 0619 19:54:13.772886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.772967 (+ 81us) service_pool.cc:224] Handling call
0619 19:54:14.941904 (+1168937us) ts_tablet_manager.cc:1151] Deleting tablet b57f64f97cdc493ea48e08d897bfc982
0619 19:54:14.941915 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.942026 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168745}
W20260619 19:54:14.942695 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b57f64f97cdc493ea48e08d897bfc982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b57f64f97cdc493ea48e08d897bfc982 already in progress: creating tablet
I20260619 19:54:14.943063 1994 tablet_replica.cc:333] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.943337 1994 raft_consensus.cc:2243] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.943472 1201 tablet_bootstrap.cc:492] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:14.943614 1201 ts_tablet_manager.cc:1403] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260619 19:54:14.943647 1994 raft_consensus.cc:2272] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:14.944267 1994 ts_tablet_manager.cc:1916] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.944411 1201 raft_consensus.cc:359] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.944576 1201 raft_consensus.cc:385] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.944639 1201 raft_consensus.cc:740] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.944862 1201 consensus_queue.cc:260] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.945366 1201 ts_tablet_manager.cc:1434] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:14.945647 1201 tablet_bootstrap.cc:492] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:14.947603 1973 ts_tablet_manager.cc:1929] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.964552 1201 tablet_bootstrap.cc:654] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:14.968250 996 leader_election.cc:304] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.965256 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 266) took 10591 ms. Trace:
I20260619 19:54:14.969942 2026 rpcz_store.cc:276] 0619 19:54:04.373969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.374026 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:14.965111 (+10591085us) ts_tablet_manager.cc:1151] Deleting tablet d6a6ffdcd55d4db6870fe032f72ab3b1
0619 19:54:14.965122 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.965237 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10488448}
I20260619 19:54:14.970418 2993 raft_consensus.cc:2804] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.970515 2993 raft_consensus.cc:493] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.970577 2993 raft_consensus.cc:3060] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.970587 996 leader_election.cc:304] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:14.969826 1200 tablet_bootstrap.cc:492] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:14.973762 2993 raft_consensus.cc:515] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.977030 1200 ts_tablet_manager.cc:1403] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.000s
I20260619 19:54:14.977504 2993 leader_election.cc:290] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.968667 1994 ts_tablet_manager.cc:1929] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:14.977779 3003 raft_consensus.cc:2804] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:14.977864 3003 raft_consensus.cc:493] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:14.977922 3003 raft_consensus.cc:3060] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.979503 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0b53167d2e6c488f9cdb201c78fd2fd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:14.980129 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b53167d2e6c488f9cdb201c78fd2fd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:14.980439 3003 raft_consensus.cc:515] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.980979 3003 leader_election.cc:290] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:14.977782 1994 log.cc:1199] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/eb4b1e87f2e84bcaaa07ff9f687b9e3d
I20260619 19:54:14.981925 1994 ts_tablet_manager.cc:1950] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:14.982234 1200 raft_consensus.cc:359] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.983418 2026 tablet_replica.cc:333] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:14.983665 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:14.983927 915 raft_consensus.cc:3060] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.983727 2026 raft_consensus.cc:2243] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:14.984412 2026 pending_rounds.cc:70] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:14.984560 2026 pending_rounds.cc:77] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657678255820800 op_type: NO_OP noop_request { }
I20260619 19:54:14.984736 2026 raft_consensus.cc:2889] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:14.987547 1200 raft_consensus.cc:385] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:14.987639 1200 raft_consensus.cc:740] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:14.987852 1200 consensus_queue.cc:260] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.988375 1200 ts_tablet_manager.cc:1434] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.011s user 0.000s sys 0.000s
I20260619 19:54:14.982685 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 588) took 1215 ms. Trace:
I20260619 19:54:14.988512 1994 rpcz_store.cc:276] 0619 19:54:13.767086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.767160 (+ 74us) service_pool.cc:224] Handling call
0619 19:54:14.943015 (+1175855us) ts_tablet_manager.cc:1151] Deleting tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
0619 19:54:14.943026 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.947690 (+ 4664us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.968606 (+ 20916us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.982666 (+ 14060us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167891}
I20260619 19:54:14.988922 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 589) took 1217 ms. Trace:
I20260619 19:54:14.989010 1994 rpcz_store.cc:276] 0619 19:54:13.771117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.771188 (+ 71us) service_pool.cc:224] Handling call
0619 19:54:14.988791 (+1217603us) ts_tablet_manager.cc:1151] Deleting tablet a8b0d5d52f264281993fdb86c8658b88
0619 19:54:14.988799 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.988904 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213656}
I20260619 19:54:14.989256 1994 tablet_replica.cc:333] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:14.989421 1994 raft_consensus.cc:2243] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:14.989483 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d (table default.Table_384d87b1154345fd9feaa4bac544af49 [id=282cf765f9e04a38a724e2d4a6f3245c]) successfully deleted
I20260619 19:54:14.989579 1994 raft_consensus.cc:2272] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:14.989809 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a8b0d5d52f264281993fdb86c8658b88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8b0d5d52f264281993fdb86c8658b88 already in progress: creating tablet
I20260619 19:54:14.990149 1994 ts_tablet_manager.cc:1916] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:14.986581 915 raft_consensus.cc:2468] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:14.993779 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2943333e572e4f1384b78d96a27d9c63" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:14.999632 919 raft_consensus.cc:3060] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:14.999704 2026 raft_consensus.cc:2272] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.000391 2026 ts_tablet_manager.cc:1916] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.004022 919 raft_consensus.cc:2468] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:15.020874 1200 tablet_bootstrap.cc:492] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:15.022488 1200 tablet_bootstrap.cc:654] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.026876 996 leader_election.cc:304] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:15.028262 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9bbb285ac65b4d1f976f736071ea68cd" } new_table_name: "default.Table_0792952592fc49f689802e7d04d7a474" modify_external_catalogs: true
I20260619 19:54:15.029960 1201 tablet_bootstrap.cc:492] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:15.030257 1201 ts_tablet_manager.cc:1403] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.085s user 0.001s sys 0.003s
I20260619 19:54:15.031414 1201 raft_consensus.cc:359] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.031744 1201 raft_consensus.cc:385] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.031857 1201 raft_consensus.cc:740] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.032177 1201 consensus_queue.cc:260] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.033011 1201 ts_tablet_manager.cc:1434] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:15.033362 1201 tablet_bootstrap.cc:492] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:15.034878 2966 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 19:54:15.035477 2966 tablet_bootstrap.cc:492] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap complete.
I20260619 19:54:15.036193 1201 tablet_bootstrap.cc:654] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.036895 2966 ts_tablet_manager.cc:1403] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.131s user 0.007s sys 0.004s
I20260619 19:54:15.038010 2966 raft_consensus.cc:359] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:15.038311 2966 raft_consensus.cc:740] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.038764 2996 raft_consensus.cc:2804] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.038699 2966 consensus_queue.cc:260] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:15.038879 2996 raft_consensus.cc:697] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:15.039230 2996 consensus_queue.cc:237] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.039530 2966 ts_tablet_manager.cc:1434] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:15.042011 2026 ts_tablet_manager.cc:1929] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:15.042913 2026 log.cc:1199] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fe14a1f35cf14ca480221ee412c087da
I20260619 19:54:15.043459 2026 ts_tablet_manager.cc:1950] T fe14a1f35cf14ca480221ee412c087da P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:15.044382 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 267) took 10665 ms. Trace:
I20260619 19:54:15.048794 2026 rpcz_store.cc:276] 0619 19:54:04.378918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.379385 (+ 467us) service_pool.cc:224] Handling call
0619 19:54:14.983354 (+10603969us) ts_tablet_manager.cc:1151] Deleting tablet fe14a1f35cf14ca480221ee412c087da
0619 19:54:14.983368 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.005592 (+ 22224us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.041943 (+ 36351us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.044357 (+ 2414us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10504112}
I20260619 19:54:15.049458 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fe14a1f35cf14ca480221ee412c087da (table default.Table_3923e0337ed14a129044a3b03ac340df [id=d0f3320ba06b47b38830db7ad44b766c]) successfully deleted
I20260619 19:54:15.049974 2026 tablet_replica.cc:333] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:15.050230 2026 raft_consensus.cc:2243] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:15.050465 2026 raft_consensus.cc:2272] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.050650 1201 tablet_bootstrap.cc:492] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:15.055029 1201 ts_tablet_manager.cc:1403] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260619 19:54:14.963718 1208 tablet_bootstrap.cc:492] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:14.983914 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:15.055886 1201 raft_consensus.cc:359] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.056053 1201 raft_consensus.cc:385] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.056079 1208 ts_tablet_manager.cc:1403] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.129s user 0.004s sys 0.000s
I20260619 19:54:15.056103 1201 raft_consensus.cc:740] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.055905 2026 ts_tablet_manager.cc:1916] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.056313 1201 consensus_queue.cc:260] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.056770 1201 ts_tablet_manager.cc:1434] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:15.056722 1208 raft_consensus.cc:359] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.056886 1208 raft_consensus.cc:385] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.056957 1208 raft_consensus.cc:740] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.057036 1201 tablet_bootstrap.cc:492] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:15.057138 1208 consensus_queue.cc:260] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:14.054358 2374 rpcz_store.cc:276] 0619 19:54:05.483636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.483714 (+ 78us) service_pool.cc:224] Handling call
0619 19:54:12.446120 (+6962406us) raft_consensus.cc:1471] Updating replica for 317 ops
0619 19:54:12.469977 (+ 23857us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.469981 (+ 4us) write_op.cc:454] Released schema lock
0619 19:54:12.470349 (+ 368us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.470353 (+ 4us) write_op.cc:454] Released schema lock
0619 19:54:12.470568 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:12.470571 (+ 3us) write_op.cc:454] Released schema lock
0619 19:54:12.475339 (+ 4768us) raft_consensus.cc:1534] Early marking committed up to index 380
0619 19:54:12.545796 (+ 70457us) raft_consensus.cc:1539] Triggering prepare for 317 ops
0619 19:54:12.546296 (+ 500us) write_op.cc:270] Start()
0619 19:54:12.546463 (+ 167us) write_op.cc:276] Timestamp: P: 1781898838105197 usec, L: 0
0619 19:54:12.547487 (+ 1024us) write_op.cc:270] Start()
0619 19:54:12.547521 (+ 34us) write_op.cc:276] Timestamp: P: 1781898838209253 usec, L: 0
0619 19:54:12.548342 (+ 821us) write_op.cc:270] Start()
0619 19:54:12.548372 (+ 30us) write_op.cc:276] Timestamp: P: 1781898838210099 usec, L: 0
0619 19:54:12.548955 (+ 583us) write_op.cc:270] Start()
0619 19:54:12.548983 (+ 28us) write_op.cc:276] Timestamp: P: 1781898838213848 usec, L: 0
0619 19:54:12.549522 (+ 539us) write_op.cc:270] Start()
0619 19:54:12.549546 (+ 24us) write_op.cc:276] Timestamp: P: 1781898838221601 usec, L: 0
0619 19:54:12.550082 (+ 536us) write_op.cc:270] Start()
0619 19:54:12.550114 (+ 32us) write_op.cc:276] Timestamp: P: 1781898838222537 usec, L: 0
0619 19:54:12.550693 (+ 579us) write_op.cc:270] Start()
0619 19:54:12.550718 (+ 25us) write_op.cc:276] Timestamp: P: 1781898838223364 usec, L: 0
0619 19:54:12.551231 (+ 513us) write_op.cc:270] Start()
0619 19:54:12.551252 (+ 21us) write_op.cc:276] Timestamp: P: 1781898838223951 usec, L: 0
0619 19:54:12.551761 (+ 509us) write_op.cc:270] Start()
0619 19:54:12.551784 (+ 23us) write_op.cc:276] Timestamp: P: 1781898838228229 usec, L: 0
0619 19:54:12.552750 (+ 966us) write_op.cc:270] Start()
0619 19:54:12.552774 (+ 24us) write_op.cc:276] Timestamp: P: 1781898838231677 usec, L: 0
0619 19:54:12.553328 (+ 554us) write_op.cc:270] Start()
0619 19:54:12.553352 (+ 24us) write_op.cc:276] Timestamp: P: 1781898838421060 usec, L: 0
0619 19:54:12.554542 (+ 1190us) write_op.cc:270] Start()
0619 19:54:12.554567 (+ 25us) write_op.cc:276] Timestamp: P: 1781898838480032 usec, L: 0
0619 19:54:12.554726 (+ 159us) write_op.cc:270] Start()
0619 19:54:12.554745 (+ 19us) write_op.cc:276] Timestamp: P: 1781898838482183 usec, L: 0
0619 19:54:12.554880 (+ 135us) write_op.cc:270] Start()
0619 19:54:12.554898 (+ 18us) write_op.cc:276] Timestamp: P: 1781898838483082 usec, L: 0
0619 19:54:12.555018 (+ 120us) write_op.cc:270] Start()
0619 19:54:12.555034 (+ 16us) write_op.cc:276] Timestamp: P: 1781898838519654 usec, L: 0
0619 19:54:12.555209 (+ 175us) write_op.cc:270] Start()
0619 19:54:12.555239 (+ 30us) write_op.cc:276] Timestamp: P: 1781898838528691 usec, L: 0
0619 19:54:12.555400 (+ 161us) write_op.cc:270] Start()
0619 19:54:12.555420 (+ 20us) write_op.cc:276] Timestamp: P: 1781898838677263 usec, L: 0
0619 19:54:12.555536 (+ 116us) write_op.cc:270] Start()
0619 19:54:12.555552 (+ 16us) write_op.cc:276] Timestamp: P: 1781898838692707 usec, L: 0
0619 19:54:12.555677 (+ 125us) write_op.cc:270] Start()
0619 19:54:12.555706 (+ 29us) write_op.cc:276] Timestamp: P: 1781898838711404 usec, L: 0
0619 19:54:12.555832 (+ 126us) write_op.cc:270] Start()
0619 19:54:12.555849 (+ 17us) write_op.cc:276] Timestamp: P: 1781898838726106 usec, L: 0
0619 19:54:12.556006 (+ 157us) write_op.cc:270] Start()
0619 19:54:12.556050 (+ 44us) write_op.cc:276] Timestamp: P: 1781898838739853 usec, L: 0
0619 19:54:12.556177 (+ 127us) write_op.cc:270] Start()
0619 19:54:12.556195 (+ 18us) write_op.cc:276] Timestamp: P: 1781898838744472 usec, L: 0
0619 19:54:12.556382 (+ 187us) write_op.cc:270] Start()
0619 19:54:12.556402 (+ 20us) write_op.cc:276] Timestamp: P: 1781898838757040 usec, L: 0
0619 19:54:12.556519 (+ 117us) write_op.cc:270] Start()
0619 19:54:12.556539 (+ 20us) write_op.cc:276] Timestamp: P: 1781898838758202 usec, L: 0
0619 19:54:12.556660 (+ 121us) write_op.cc:270] Start()
0619 19:54:12.556684 (+ 24us) write_op.cc:276] Timestamp: P: 1781898838774329 usec, L: 0
0619 19:54:12.556814 (+ 130us) write_op.cc:270] Start()
0619 19:54:12.556830 (+ 16us) write_op.cc:276] Timestamp: P: 1781898838795910 usec, L: 0
0619 19:54:12.556985 (+ 155us) write_op.cc:270] Start()
0619 19:54:12.557004 (+ 19us) write_op.cc:276] Timestamp: P: 1781898838851908 usec, L: 0
0619 19:54:12.557126 (+ 122us) write_op.cc:270] Start()
0619 19:54:12.557144 (+ 18us) write_op.cc:276] Timestamp: P: 1781898838860105 usec, L: 0
0619 19:54:12.557262 (+ 118us) write_op.cc:270] Start()
0619 19:54:12.557278 (+ 16us) write_op.cc:276] Timestamp: P: 1781898838864850 usec, L: 0
0619 19:54:12.557395 (+ 117us) write_op.cc:270] Start()
0619 19:54:12.557413 (+ 18us) write_op.cc:276] Timestamp: P: 1781898838870741 usec, L: 0
0619 19:54:12.557541 (+ 128us) write_op.cc:270] Start()
0619 19:54:12.557559 (+ 18us) write_op.cc:276] Timestamp: P: 1781898838879305 usec, L: 0
0619 19:54:12.557698 (+ 139us) write_op.cc:270] Start()
0619 19:54:12.557715 (+ 17us) write_op.cc:276] Timestamp: P: 1781898838890755 usec, L: 0
0619 19:54:12.557885 (+ 170us) write_op.cc:270] Start()
0619 19:54:12.557903 (+ 18us) write_op.cc:276] Timestamp: P: 1781898838891435 usec, L: 0
0619 19:54:12.558033 (+ 130us) write_op.cc:270] Start()
0619 19:54:12.558050 (+ 17us) write_op.cc:276] Timestamp: P: 1781898838895329 usec, L: 0
0619 19:54:12.558171 (+ 121us) write_op.cc:270] Start()
0619 19:54:12.558188 (+ 17us) write_op.cc:276] Timestamp: P: 1781898838917895 usec, L: 0
0619 19:54:12.558330 (+ 142us) write_op.cc:270] Start()
0619 19:54:12.558358 (+ 28us) write_op.cc:276] Timestamp: P: 1781898838927521 usec, L: 0
0619 19:54:12.558492 (+ 134us) write_op.cc:270] Start()
0619 19:54:12.558511 (+ 19us) write_op.cc:276] Timestamp: P: 1781898838940154 usec, L: 0
0619 19:54:12.558650 (+ 139us) write_op.cc:270] Start()
0619 19:54:12.558673 (+ 23us) write_op.cc:276] Timestamp: P: 1781898838950326 usec, L: 0
0619 19:54:12.558805 (+ 132us) write_op.cc:270] Start()
0619 19:54:12.558824 (+ 19us) write_op.cc:276] Timestamp: P: 1781898838979811 usec, L: 0
0619 19:54:12.558944 (+ 120us) write_op.cc:270] Start()
0619 19:54:12.558961 (+ 17us) write_op.cc:276] Timestamp: P: 1781898838998836 usec, L: 0
0619 19:54:12.559072 (+ 111us) write_op.cc:270] Start()
0619 19:54:12.559088 (+ 16us) write_op.cc:276] Timestamp: P: 1781898839024817 usec, L: 0
0619 19:54:12.567046 (+ 7958us) write_op.cc:270] Start()
0619 19:54:12.567087 (+ 41us) write_op.cc:276] Timestamp: P: 1781898839057017 usec, L: 0
0619 19:54:12.567312 (+ 225us) write_op.cc:270] Start()
0619 19:54:12.567339 (+ 27us) write_op.cc:276] Timestamp: P: 1781898839100766 usec, L: 0
0619 19:54:12.567492 (+ 153us) write_op.cc:270] Start()
0619 19:54:12.567512 (+ 20us) write_op.cc:276] Timestamp: P: 1781898839102838 usec, L: 0
0619 19:54:12.567647 (+ 135us) write_op.cc:270] Start()
0619 19:54:12.567664 (+ 17us) write_op.cc:276] Timestamp: P: 1781898839161675 usec, L: 0
0619 19:54:12.567773 (+ 109us) write_op.cc:270] Start()
0619 19:54:12.567788 (+ 15us) write_op.cc:276] Timestamp: P: 1781898839165070 usec, L: 0
0619 19:54:12.567982 (+ 194us) write_op.cc:270] Start()
0619 19:54:12.568001 (+ 19us) write_op.cc:276] Timestamp: P: 1781898839166870 usec, L: 0
0619 19:54:12.568179 (+ 178us) write_op.cc:270] Start()
0619 19:54:12.568202 (+ 23us) write_op.cc:276] Timestamp: P: 1781898839169683 usec, L: 0
0619 19:54:12.568326 (+ 124us) write_op.cc:270] Start()
0619 19:54:12.568344 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839191462 usec, L: 0
0619 19:54:12.568471 (+ 127us) write_op.cc:270] Start()
0619 19:54:12.568489 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839196863 usec, L: 0
0619 19:54:12.575276 (+ 6787us) write_op.cc:270] Start()
0619 19:54:12.575337 (+ 61us) write_op.cc:276] Timestamp: P: 1781898839205946 usec, L: 0
0619 19:54:12.575566 (+ 229us) write_op.cc:270] Start()
0619 19:54:12.575584 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839285184 usec, L: 0
0619 19:54:12.575706 (+ 122us) write_op.cc:270] Start()
0619 19:54:12.575722 (+ 16us) write_op.cc:276] Timestamp: P: 1781898839287744 usec, L: 0
0619 19:54:12.575829 (+ 107us) write_op.cc:270] Start()
0619 19:54:12.575847 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839333633 usec, L: 0
0619 19:54:12.575975 (+ 128us) write_op.cc:270] Start()
0619 19:54:12.575996 (+ 21us) write_op.cc:276] Timestamp: P: 1781898839356975 usec, L: 0
0619 19:54:12.576685 (+ 689us) write_op.cc:270] Start()
0619 19:54:12.576713 (+ 28us) write_op.cc:276] Timestamp: P: 1781898839358051 usec, L: 0
0619 19:54:12.576974 (+ 261us) write_op.cc:270] Start()
0619 19:54:12.577004 (+ 30us) write_op.cc:276] Timestamp: P: 1781898839358940 usec, L: 0
0619 19:54:12.577203 (+ 199us) write_op.cc:270] Start()
0619 19:54:12.577232 (+ 29us) write_op.cc:276] Timestamp: P: 1781898839469937 usec, L: 0
0619 19:54:12.577400 (+ 168us) write_op.cc:270] Start()
0619 19:54:12.577422 (+ 22us) write_op.cc:276] Timestamp: P: 1781898839538148 usec, L: 0
0619 19:54:12.580057 (+ 2635us) write_op.cc:270] Start()
0619 19:54:12.580093 (+ 36us) write_op.cc:276] Timestamp: P: 1781898839538940 usec, L: 0
0619 19:54:12.580281 (+ 188us) write_op.cc:270] Start()
0619 19:54:12.580303 (+ 22us) write_op.cc:276] Timestamp: P: 1781898839539604 usec, L: 0
0619 19:54:12.580493 (+ 190us) write_op.cc:270] Start()
0619 19:54:12.580514 (+ 21us) write_op.cc:276] Timestamp: P: 1781898839540220 usec, L: 0
0619 19:54:12.580687 (+ 173us) write_op.cc:270] Start()
0619 19:54:12.580708 (+ 21us) write_op.cc:276] Timestamp: P: 1781898839540819 usec, L: 0
0619 19:54:12.580841 (+ 133us) write_op.cc:270] Start()
0619 19:54:12.580861 (+ 20us) write_op.cc:276] Timestamp: P: 1781898839715223 usec, L: 0
0619 19:54:12.581001 (+ 140us) write_op.cc:270] Start()
0619 19:54:12.581019 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839722945 usec, L: 0
0619 19:54:12.581176 (+ 157us) write_op.cc:270] Start()
0619 19:54:12.581199 (+ 23us) write_op.cc:276] Timestamp: P: 1781898839724135 usec, L: 0
0619 19:54:12.581354 (+ 155us) write_op.cc:270] Start()
0619 19:54:12.581375 (+ 21us) write_op.cc:276] Timestamp: P: 1781898839725196 usec, L: 0
0619 19:54:12.581520 (+ 145us) write_op.cc:270] Start()
0619 19:54:12.581541 (+ 21us) write_op.cc:276] Timestamp: P: 1781898839772064 usec, L: 0
0619 19:54:12.581735 (+ 194us) write_op.cc:270] Start()
0619 19:54:12.581758 (+ 23us) write_op.cc:276] Timestamp: P: 1781898839776833 usec, L: 0
0619 19:54:12.581895 (+ 137us) write_op.cc:270] Start()
0619 19:54:12.581914 (+ 19us) write_op.cc:276] Timestamp: P: 1781898839797451 usec, L: 0
0619 19:54:12.582064 (+ 150us) write_op.cc:270] Start()
0619 19:54:12.582084 (+ 20us) write_op.cc:276] Timestamp: P: 1781898839801957 usec, L: 0
0619 19:54:12.582230 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.582250 (+ 20us) write_op.cc:276] Timestamp: P: 1781898839809641 usec, L: 0
0619 19:54:12.582380 (+ 130us) write_op.cc:270] Start()
0619 19:54:12.582399 (+ 19us) write_op.cc:276] Timestamp: P: 1781898839813828 usec, L: 0
0619 19:54:12.589688 (+ 7289us) write_op.cc:270] Start()
0619 19:54:12.589755 (+ 67us) write_op.cc:276] Timestamp: P: 1781898839814974 usec, L: 0
0619 19:54:12.590035 (+ 280us) write_op.cc:270] Start()
0619 19:54:12.590059 (+ 24us) write_op.cc:276] Timestamp: P: 1781898839816053 usec, L: 0
0619 19:54:12.590224 (+ 165us) write_op.cc:270] Start()
0619 19:54:12.590245 (+ 21us) write_op.cc:276] Timestamp: P: 1781898839817071 usec, L: 0
0619 19:54:12.590392 (+ 147us) write_op.cc:270] Start()
0619 19:54:12.590411 (+ 19us) write_op.cc:276] Timestamp: P: 1781898839827487 usec, L: 0
0619 19:54:12.590544 (+ 133us) write_op.cc:270] Start()
0619 19:54:12.590562 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839871080 usec, L: 0
0619 19:54:12.590723 (+ 161us) write_op.cc:270] Start()
0619 19:54:12.590763 (+ 40us) write_op.cc:276] Timestamp: P: 1781898839888000 usec, L: 0
0619 19:54:12.590950 (+ 187us) write_op.cc:270] Start()
0619 19:54:12.590977 (+ 27us) write_op.cc:276] Timestamp: P: 1781898839894931 usec, L: 0
0619 19:54:12.591110 (+ 133us) write_op.cc:270] Start()
0619 19:54:12.591154 (+ 44us) write_op.cc:276] Timestamp: P: 1781898839897697 usec, L: 0
0619 19:54:12.591324 (+ 170us) write_op.cc:270] Start()
0619 19:54:12.591344 (+ 20us) write_op.cc:276] Timestamp: P: 1781898839916950 usec, L: 0
0619 19:54:12.591467 (+ 123us) write_op.cc:270] Start()
0619 19:54:12.591484 (+ 17us) write_op.cc:276] Timestamp: P: 1781898839921866 usec, L: 0
0619 19:54:12.591635 (+ 151us) write_op.cc:270] Start()
0619 19:54:12.591657 (+ 22us) write_op.cc:276] Timestamp: P: 1781898839939377 usec, L: 0
0619 19:54:12.591811 (+ 154us) write_op.cc:270] Start()
0619 19:54:12.591833 (+ 22us) write_op.cc:276] Timestamp: P: 1781898839976402 usec, L: 0
0619 19:54:12.591977 (+ 144us) write_op.cc:270] Start()
0619 19:54:12.592001 (+ 24us) write_op.cc:276] Timestamp: P: 1781898839978266 usec, L: 0
0619 19:54:12.592136 (+ 135us) write_op.cc:270] Start()
0619 19:54:12.592154 (+ 18us) write_op.cc:276] Timestamp: P: 1781898839984858 usec, L: 0
0619 19:54:12.592294 (+ 140us) write_op.cc:270] Start()
0619 19:54:12.592313 (+ 19us) write_op.cc:276] Timestamp: P: 1781898839987631 usec, L: 0
0619 19:54:12.592436 (+ 123us) write_op.cc:270] Start()
0619 19:54:12.592453 (+ 17us) write_op.cc:276] Timestamp: P: 1781898839997351 usec, L: 0
0619 19:54:12.592563 (+ 110us) write_op.cc:270] Start()
0619 19:54:12.592580 (+ 17us) write_op.cc:276] Timestamp: P: 1781898840018705 usec, L: 0
0619 19:54:12.592727 (+ 147us) write_op.cc:270] Start()
0619 19:54:12.592745 (+ 18us) write_op.cc:276] Timestamp: P: 1781898840055684 usec, L: 0
0619 19:54:12.592858 (+ 113us) write_op.cc:270] Start()
0619 19:54:12.592914 (+ 56us) write_op.cc:276] Timestamp: P: 1781898840061507 usec, L: 0
0619 19:54:12.593043 (+ 129us) write_op.cc:270] Start()
0619 19:54:12.593065 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840065791 usec, L: 0
0619 19:54:12.593211 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.593231 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840083787 usec, L: 0
0619 19:54:12.593369 (+ 138us) write_op.cc:270] Start()
0619 19:54:12.593388 (+ 19us) write_op.cc:276] Timestamp: P: 1781898840092193 usec, L: 0
0619 19:54:12.593522 (+ 134us) write_op.cc:270] Start()
0619 19:54:12.593543 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840221885 usec, L: 0
0619 19:54:12.593750 (+ 207us) write_op.cc:270] Start()
0619 19:54:12.593772 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840223240 usec, L: 0
0619 19:54:12.593943 (+ 171us) write_op.cc:270] Start()
0619 19:54:12.593971 (+ 28us) write_op.cc:276] Timestamp: P: 1781898840238784 usec, L: 0
0619 19:54:12.594155 (+ 184us) write_op.cc:270] Start()
0619 19:54:12.594178 (+ 23us) write_op.cc:276] Timestamp: P: 1781898840240659 usec, L: 0
0619 19:54:12.594313 (+ 135us) write_op.cc:270] Start()
0619 19:54:12.594333 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840258506 usec, L: 0
0619 19:54:12.594467 (+ 134us) write_op.cc:270] Start()
0619 19:54:12.594488 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840261028 usec, L: 0
0619 19:54:12.594648 (+ 160us) write_op.cc:270] Start()
0619 19:54:12.594670 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840263420 usec, L: 0
0619 19:54:12.594811 (+ 141us) write_op.cc:270] Start()
0619 19:54:12.594849 (+ 38us) write_op.cc:276] Timestamp: P: 1781898840266055 usec, L: 0
0619 19:54:12.595034 (+ 185us) write_op.cc:270] Start()
0619 19:54:12.595056 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840274076 usec, L: 0
0619 19:54:12.606788 (+ 11732us) write_op.cc:270] Start()
0619 19:54:12.606831 (+ 43us) write_op.cc:276] Timestamp: P: 1781898840274750 usec, L: 0
0619 19:54:12.607059 (+ 228us) write_op.cc:270] Start()
0619 19:54:12.607085 (+ 26us) write_op.cc:276] Timestamp: P: 1781898840275374 usec, L: 0
0619 19:54:12.611672 (+ 4587us) write_op.cc:270] Start()
0619 19:54:12.611710 (+ 38us) write_op.cc:276] Timestamp: P: 1781898840276265 usec, L: 0
0619 19:54:12.611919 (+ 209us) write_op.cc:270] Start()
0619 19:54:12.611940 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840316102 usec, L: 0
0619 19:54:12.612068 (+ 128us) write_op.cc:270] Start()
0619 19:54:12.612087 (+ 19us) write_op.cc:276] Timestamp: P: 1781898840318464 usec, L: 0
0619 19:54:12.612214 (+ 127us) write_op.cc:270] Start()
0619 19:54:12.612246 (+ 32us) write_op.cc:276] Timestamp: P: 1781898840328733 usec, L: 0
0619 19:54:12.612404 (+ 158us) write_op.cc:270] Start()
0619 19:54:12.612424 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840344697 usec, L: 0
0619 19:54:12.612630 (+ 206us) write_op.cc:270] Start()
0619 19:54:12.612653 (+ 23us) write_op.cc:276] Timestamp: P: 1781898840363344 usec, L: 0
0619 19:54:12.612798 (+ 145us) write_op.cc:270] Start()
0619 19:54:12.612819 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840375359 usec, L: 0
0619 19:54:12.612963 (+ 144us) write_op.cc:270] Start()
0619 19:54:12.612983 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840479797 usec, L: 0
0619 19:54:12.613114 (+ 131us) write_op.cc:270] Start()
0619 19:54:12.613133 (+ 19us) write_op.cc:276] Timestamp: P: 1781898840481534 usec, L: 0
0619 19:54:12.613253 (+ 120us) write_op.cc:270] Start()
0619 19:54:12.613270 (+ 17us) write_op.cc:276] Timestamp: P: 1781898840522484 usec, L: 0
0619 19:54:12.617764 (+ 4494us) write_op.cc:270] Start()
0619 19:54:12.617809 (+ 45us) write_op.cc:276] Timestamp: P: 1781898840529847 usec, L: 0
0619 19:54:12.618016 (+ 207us) write_op.cc:270] Start()
0619 19:54:12.618039 (+ 23us) write_op.cc:276] Timestamp: P: 1781898840531224 usec, L: 0
0619 19:54:12.618162 (+ 123us) write_op.cc:270] Start()
0619 19:54:12.618182 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840544485 usec, L: 0
0619 19:54:12.618328 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.618346 (+ 18us) write_op.cc:276] Timestamp: P: 1781898840548418 usec, L: 0
0619 19:54:12.618474 (+ 128us) write_op.cc:270] Start()
0619 19:54:12.618493 (+ 19us) write_op.cc:276] Timestamp: P: 1781898840558977 usec, L: 0
0619 19:54:12.618645 (+ 152us) write_op.cc:270] Start()
0619 19:54:12.618664 (+ 19us) write_op.cc:276] Timestamp: P: 1781898840567393 usec, L: 0
0619 19:54:12.618800 (+ 136us) write_op.cc:270] Start()
0619 19:54:12.618817 (+ 17us) write_op.cc:276] Timestamp: P: 1781898840593939 usec, L: 0
0619 19:54:12.618930 (+ 113us) write_op.cc:270] Start()
0619 19:54:12.618950 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840597903 usec, L: 0
0619 19:54:12.619093 (+ 143us) write_op.cc:270] Start()
0619 19:54:12.619113 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840609391 usec, L: 0
0619 19:54:12.619354 (+ 241us) write_op.cc:270] Start()
0619 19:54:12.619375 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840613571 usec, L: 0
0619 19:54:12.619521 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.619541 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840628045 usec, L: 0
0619 19:54:12.620254 (+ 713us) write_op.cc:270] Start()
0619 19:54:12.620280 (+ 26us) write_op.cc:276] Timestamp: P: 1781898840644053 usec, L: 0
0619 19:54:12.620475 (+ 195us) write_op.cc:270] Start()
0619 19:54:12.620496 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840654619 usec, L: 0
0619 19:54:12.620669 (+ 173us) write_op.cc:270] Start()
0619 19:54:12.620691 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840664633 usec, L: 0
0619 19:54:12.620833 (+ 142us) write_op.cc:270] Start()
0619 19:54:12.620856 (+ 23us) write_op.cc:276] Timestamp: P: 1781898840807596 usec, L: 0
0619 19:54:12.620973 (+ 117us) write_op.cc:270] Start()
0619 19:54:12.620990 (+ 17us) write_op.cc:276] Timestamp: P: 1781898840845744 usec, L: 0
0619 19:54:12.621114 (+ 124us) write_op.cc:270] Start()
0619 19:54:12.621134 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840857073 usec, L: 0
0619 19:54:12.621268 (+ 134us) write_op.cc:270] Start()
0619 19:54:12.621285 (+ 17us) write_op.cc:276] Timestamp: P: 1781898840859374 usec, L: 0
0619 19:54:12.621446 (+ 161us) write_op.cc:270] Start()
0619 19:54:12.621465 (+ 19us) write_op.cc:276] Timestamp: P: 1781898840864161 usec, L: 0
0619 19:54:12.621634 (+ 169us) write_op.cc:270] Start()
0619 19:54:12.621654 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840869681 usec, L: 0
0619 19:54:12.621795 (+ 141us) write_op.cc:270] Start()
0619 19:54:12.621815 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840870299 usec, L: 0
0619 19:54:12.621979 (+ 164us) write_op.cc:270] Start()
0619 19:54:12.621999 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840879160 usec, L: 0
0619 19:54:12.622130 (+ 131us) write_op.cc:270] Start()
0619 19:54:12.622147 (+ 17us) write_op.cc:276] Timestamp: P: 1781898840879927 usec, L: 0
0619 19:54:12.622273 (+ 126us) write_op.cc:270] Start()
0619 19:54:12.622294 (+ 21us) write_op.cc:276] Timestamp: P: 1781898840885046 usec, L: 0
0619 19:54:12.622440 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.622462 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840886141 usec, L: 0
0619 19:54:12.622631 (+ 169us) write_op.cc:270] Start()
0619 19:54:12.622653 (+ 22us) write_op.cc:276] Timestamp: P: 1781898840891182 usec, L: 0
0619 19:54:12.622792 (+ 139us) write_op.cc:270] Start()
0619 19:54:12.622810 (+ 18us) write_op.cc:276] Timestamp: P: 1781898840892644 usec, L: 0
0619 19:54:12.639415 (+ 16605us) write_op.cc:270] Start()
0619 19:54:12.639470 (+ 55us) write_op.cc:276] Timestamp: P: 1781898840914431 usec, L: 0
0619 19:54:12.639740 (+ 270us) write_op.cc:270] Start()
0619 19:54:12.639768 (+ 28us) write_op.cc:276] Timestamp: P: 1781898840916166 usec, L: 0
0619 19:54:12.639920 (+ 152us) write_op.cc:270] Start()
0619 19:54:12.639940 (+ 20us) write_op.cc:276] Timestamp: P: 1781898840935885 usec, L: 0
0619 19:54:12.640093 (+ 153us) write_op.cc:270] Start()
0619 19:54:12.640117 (+ 24us) write_op.cc:276] Timestamp: P: 1781898841022263 usec, L: 0
0619 19:54:12.640239 (+ 122us) write_op.cc:270] Start()
0619 19:54:12.640256 (+ 17us) write_op.cc:276] Timestamp: P: 1781898841057729 usec, L: 0
0619 19:54:12.640399 (+ 143us) write_op.cc:270] Start()
0619 19:54:12.640418 (+ 19us) write_op.cc:276] Timestamp: P: 1781898841069205 usec, L: 0
0619 19:54:12.640591 (+ 173us) write_op.cc:270] Start()
0619 19:54:12.640616 (+ 25us) write_op.cc:276] Timestamp: P: 1781898841072902 usec, L: 0
0619 19:54:12.640760 (+ 144us) write_op.cc:270] Start()
0619 19:54:12.640787 (+ 27us) write_op.cc:276] Timestamp: P: 1781898841074783 usec, L: 0
0619 19:54:12.640937 (+ 150us) write_op.cc:270] Start()
0619 19:54:12.640958 (+ 21us) write_op.cc:276] Timestamp: P: 1781898841086130 usec, L: 0
0619 19:54:12.641096 (+ 138us) write_op.cc:270] Start()
0619 19:54:12.641119 (+ 23us) write_op.cc:276] Timestamp: P: 1781898841086855 usec, L: 0
0619 19:54:12.641265 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.641286 (+ 21us) write_op.cc:276] Timestamp: P: 1781898841087479 usec, L: 0
0619 19:54:12.641432 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.641456 (+ 24us) write_op.cc:276] Timestamp: P: 1781898841177865 usec, L: 0
0619 19:54:12.642065 (+ 609us) write_op.cc:270] Start()
0619 19:54:12.642088 (+ 23us) write_op.cc:276] Timestamp: P: 1781898841265204 usec, L: 0
0619 19:54:12.642210 (+ 122us) write_op.cc:270] Start()
0619 19:54:12.642227 (+ 17us) write_op.cc:276] Timestamp: P: 1781898841301430 usec, L: 0
0619 19:54:12.642327 (+ 100us) write_op.cc:270] Start()
0619 19:54:12.642342 (+ 15us) write_op.cc:276] Timestamp: P: 1781898841321418 usec, L: 0
0619 19:54:12.642454 (+ 112us) write_op.cc:270] Start()
0619 19:54:12.642469 (+ 15us) write_op.cc:276] Timestamp: P: 1781898841322857 usec, L: 0
0619 19:54:12.642590 (+ 121us) write_op.cc:270] Start()
0619 19:54:12.642605 (+ 15us) write_op.cc:276] Timestamp: P: 1781898841323923 usec, L: 0
0619 19:54:12.642733 (+ 128us) write_op.cc:270] Start()
0619 19:54:12.642750 (+ 17us) write_op.cc:276] Timestamp: P: 1781898841325605 usec, L: 0
0619 19:54:12.642857 (+ 107us) write_op.cc:270] Start()
0619 19:54:12.642872 (+ 15us) write_op.cc:276] Timestamp: P: 1781898841326602 usec, L: 0
0619 19:54:12.642985 (+ 113us) write_op.cc:270] Start()
0619 19:54:12.643021 (+ 36us) write_op.cc:276] Timestamp: P: 1781898841395699 usec, L: 0
0619 19:54:12.643118 (+ 97us) write_op.cc:270] Start()
0619 19:54:12.643201 (+ 83us) write_op.cc:276] Timestamp: P: 1781898841396863 usec, L: 0
0619 19:54:12.643355 (+ 154us) write_op.cc:270] Start()
0619 19:54:12.643374 (+ 19us) write_op.cc:276] Timestamp: P: 1781898841536592 usec, L: 0
0619 19:54:12.643511 (+ 137us) write_op.cc:270] Start()
0619 19:54:12.643534 (+ 23us) write_op.cc:276] Timestamp: P: 1781898841544911 usec, L: 0
0619 19:54:12.643672 (+ 138us) write_op.cc:270] Start()
0619 19:54:12.643729 (+ 57us) write_op.cc:276] Timestamp: P: 1781898841545761 usec, L: 0
0619 19:54:12.643915 (+ 186us) write_op.cc:270] Start()
0619 19:54:12.643939 (+ 24us) write_op.cc:276] Timestamp: P: 1781898841562921 usec, L: 0
0619 19:54:12.644074 (+ 135us) write_op.cc:270] Start()
0619 19:54:12.644094 (+ 20us) write_op.cc:276] Timestamp: P: 1781898841574181 usec, L: 0
0619 19:54:12.644234 (+ 140us) write_op.cc:270] Start()
0619 19:54:12.644254 (+ 20us) write_op.cc:276] Timestamp: P: 1781898841602815 usec, L: 0
0619 19:54:12.668989 (+ 24735us) write_op.cc:270] Start()
0619 19:54:12.669035 (+ 46us) write_op.cc:276] Timestamp: P: 1781898841624393 usec, L: 0
0619 19:54:12.669243 (+ 208us) write_op.cc:270] Start()
0619 19:54:12.669266 (+ 23us) write_op.cc:276] Timestamp: P: 1781898841626115 usec, L: 0
0619 19:54:12.669398 (+ 132us) write_op.cc:270] Start()
0619 19:54:12.669415 (+ 17us) write_op.cc:276] Timestamp: P: 1781898841627027 usec, L: 0
0619 19:54:12.670071 (+ 656us) write_op.cc:270] Start()
0619 19:54:12.670098 (+ 27us) write_op.cc:276] Timestamp: P: 1781898841700593 usec, L: 0
0619 19:54:12.670396 (+ 298us) write_op.cc:270] Start()
0619 19:54:12.670429 (+ 33us) write_op.cc:276] Timestamp: P: 1781898841742535 usec, L: 0
0619 19:54:12.670664 (+ 235us) write_op.cc:270] Start()
0619 19:54:12.670687 (+ 23us) write_op.cc:276] Timestamp: P: 1781898841824135 usec, L: 0
0619 19:54:12.670817 (+ 130us) write_op.cc:270] Start()
0619 19:54:12.670835 (+ 18us) write_op.cc:276] Timestamp: P: 1781898841859791 usec, L: 0
0619 19:54:12.670985 (+ 150us) write_op.cc:270] Start()
0619 19:54:12.671003 (+ 18us) write_op.cc:276] Timestamp: P: 1781898841863543 usec, L: 0
0619 19:54:12.671160 (+ 157us) write_op.cc:270] Start()
0619 19:54:12.671181 (+ 21us) write_op.cc:276] Timestamp: P: 1781898842108877 usec, L: 0
0619 19:54:12.671307 (+ 126us) write_op.cc:270] Start()
0619 19:54:12.671325 (+ 18us) write_op.cc:276] Timestamp: P: 1781898842158831 usec, L: 0
0619 19:54:12.671446 (+ 121us) write_op.cc:270] Start()
0619 19:54:12.671463 (+ 17us) write_op.cc:276] Timestamp: P: 1781898842233296 usec, L: 0
0619 19:54:12.671588 (+ 125us) write_op.cc:270] Start()
0619 19:54:12.671620 (+ 32us) write_op.cc:276] Timestamp: P: 1781898842328044 usec, L: 0
0619 19:54:12.671747 (+ 127us) write_op.cc:270] Start()
0619 19:54:12.671798 (+ 51us) write_op.cc:276] Timestamp: P: 1781898842346147 usec, L: 0
0619 19:54:12.671937 (+ 139us) write_op.cc:270] Start()
0619 19:54:12.671954 (+ 17us) write_op.cc:276] Timestamp: P: 1781898842369203 usec, L: 0
0619 19:54:12.672073 (+ 119us) write_op.cc:270] Start()
0619 19:54:12.672090 (+ 17us) write_op.cc:276] Timestamp: P: 1781898842391178 usec, L: 0
0619 19:54:12.672236 (+ 146us) write_op.cc:270] Start()
0619 19:54:12.672255 (+ 19us) write_op.cc:276] Timestamp: P: 1781898842392141 usec, L: 0
0619 19:54:12.672389 (+ 134us) write_op.cc:270] Start()
0619 19:54:12.672408 (+ 19us) write_op.cc:276] Timestamp: P: 1781898842392942 usec, L: 0
0619 19:54:12.672532 (+ 124us) write_op.cc:270] Start()
0619 19:54:12.672550 (+ 18us) write_op.cc:276] Timestamp: P: 1781898842410805 usec, L: 0
0619 19:54:12.672690 (+ 140us) write_op.cc:270] Start()
0619 19:54:12.672707 (+ 17us) write_op.cc:276] Timestamp: P: 1781898842448097 usec, L: 0
0619 19:54:12.672823 (+ 116us) write_op.cc:270] Start()
0619 19:54:12.672842 (+ 19us) write_op.cc:276] Timestamp: P: 1781898842526662 usec, L: 0
0619 19:54:12.672958 (+ 116us) write_op.cc:270] Start()
0619 19:54:12.672973 (+ 15us) write_op.cc:276] Timestamp: P: 1781898842527720 usec, L: 0
0619 19:54:12.673082 (+ 109us) write_op.cc:270] Start()
0619 19:54:12.673097 (+ 15us) write_op.cc:276] Timestamp: P: 1781898842528756 usec, L: 0
0619 19:54:12.673201 (+ 104us) write_op.cc:270] Start()
0619 19:54:12.673218 (+ 17us) write_op.cc:276] Timestamp: P: 1781898842565803 usec, L: 0
0619 19:54:12.673325 (+ 107us) write_op.cc:270] Start()
0619 19:54:12.673340 (+ 15u
I20260619 19:54:15.057633 1208 ts_tablet_manager.cc:1434] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260619 19:54:15.058128 1208 tablet_bootstrap.cc:492] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:15.058552 1201 tablet_bootstrap.cc:654] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.002601 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2943333e572e4f1384b78d96a27d9c63" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:15.054893 2757 raft_consensus.cc:493] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.060284 2757 raft_consensus.cc:515] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.060858 2757 leader_election.cc:290] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.063282 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b365df01054338a056cb0d469bc8db" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:15.064028 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b365df01054338a056cb0d469bc8db" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:15.064996 720 leader_election.cc:304] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.065457 1208 tablet_bootstrap.cc:654] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.066367 2757 raft_consensus.cc:2749] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:15.079814 1973 log.cc:1199] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f6c6ad82f0c94e27b2eb4dbf185fab66
I20260619 19:54:15.080658 2539 raft_consensus.cc:493] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.080852 2539 raft_consensus.cc:515] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.081563 2539 leader_election.cc:290] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:15.082074 1973 ts_tablet_manager.cc:1950] T f6c6ad82f0c94e27b2eb4dbf185fab66 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:15.082522 859 leader_election.cc:343] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: ba0cd4cd0661415d8b2b2339363e7aca
I20260619 19:54:15.083645 996 leader_election.cc:304] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:15.083688 3029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:54:15.083956 3029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: LEADER
I20260619 19:54:15.088114 3003 raft_consensus.cc:2804] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.088280 3003 raft_consensus.cc:697] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:15.088579 3003 consensus_queue.cc:237] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.082203 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0cd4cd0661415d8b2b2339363e7aca" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:15.096951 779 raft_consensus.cc:2468] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:15.097965 858 leader_election.cc:304] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:15.098067 859 consensus_peers.cc:597] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c71f92f4e3040c09b67e287a19eea74. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:15.098328 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 455) took 5242 ms. Trace:
I20260619 19:54:15.098588 2539 raft_consensus.cc:2804] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:15.098726 2539 raft_consensus.cc:493] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:15.098807 2539 raft_consensus.cc:3060] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.101838 2539 raft_consensus.cc:515] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:15.103520 859 leader_election.cc:343] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: ba0cd4cd0661415d8b2b2339363e7aca
I20260619 19:54:15.103593 2539 leader_election.cc:290] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:15.104863 996 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:15.105268 996 leader_election.cc:343] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:15.111421 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7afe86e5d9c341cbadc821203e603af6 consensus state has no leader
I20260619 19:54:15.103700 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0cd4cd0661415d8b2b2339363e7aca" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:15.113965 779 raft_consensus.cc:3060] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.108501 805 tablet_copy_service.cc:342] P b1f5f240547f42ec82f57e6c8af5ea89: Request end of tablet copy session e78a44e2c8824fe7bce462e9d33f660c-26355bc6b5c147a88c14a9f053b4e1f3 received from {username='slave'} at 127.0.105.131:41381
I20260619 19:54:15.119444 805 tablet_copy_service.cc:434] P b1f5f240547f42ec82f57e6c8af5ea89: ending tablet copy session e78a44e2c8824fe7bce462e9d33f660c-26355bc6b5c147a88c14a9f053b4e1f3 on tablet 26355bc6b5c147a88c14a9f053b4e1f3 with peer e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.120198 1208 tablet_bootstrap.cc:492] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:15.120388 1208 ts_tablet_manager.cc:1403] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.002s
I20260619 19:54:15.121289 779 raft_consensus.cc:2468] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:15.122370 858 leader_election.cc:304] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.122987 2539 raft_consensus.cc:2804] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.123265 2539 raft_consensus.cc:697] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:15.123868 2539 consensus_queue.cc:237] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.125339 1973 rpcz_store.cc:276] 0619 19:54:09.856170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.856262 (+ 92us) service_pool.cc:224] Handling call
0619 19:54:14.870093 (+5013831us) ts_tablet_manager.cc:1151] Deleting tablet f6c6ad82f0c94e27b2eb4dbf185fab66
0619 19:54:14.870105 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:14.944576 (+ 74471us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:14.947546 (+ 2970us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.098306 (+150760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5013662}
I20260619 19:54:15.126129 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 456) took 5269 ms. Trace:
I20260619 19:54:15.126467 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f6c6ad82f0c94e27b2eb4dbf185fab66 (table default.Table_d19624f3c0944eaaa5c1417bc0ebca2f [id=1da67532fe5b4fa4991586fa3f7c2dd2]) successfully deleted
I20260619 19:54:15.121295 1208 raft_consensus.cc:359] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.127292 1208 raft_consensus.cc:385] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.127462 1208 raft_consensus.cc:740] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.126294 1973 rpcz_store.cc:276] 0619 19:54:09.856722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.856785 (+ 63us) service_pool.cc:224] Handling call
0619 19:54:15.125982 (+5269197us) ts_tablet_manager.cc:1151] Deleting tablet 90b8468df4a449d088f47b3b150ce54a
0619 19:54:15.125995 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.126110 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5269017}
I20260619 19:54:15.128333 1973 tablet_replica.cc:333] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:15.128583 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 90b8468df4a449d088f47b3b150ce54a because the tablet was not found. No further retry: Not found: Tablet not found: 90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:15.127959 1208 consensus_queue.cc:260] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.130359 1200 tablet_bootstrap.cc:492] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:15.130545 1200 ts_tablet_manager.cc:1403] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.001s
I20260619 19:54:15.132318 1208 ts_tablet_manager.cc:1434] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260619 19:54:15.132970 1208 tablet_bootstrap.cc:492] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:15.141366 1208 tablet_bootstrap.cc:654] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.146531 2026 ts_tablet_manager.cc:1929] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:15.129076 1973 raft_consensus.cc:2243] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:15.149675 1973 raft_consensus.cc:2272] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.150513 1973 ts_tablet_manager.cc:1916] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.150741 2026 log.cc:1199] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d703c5c2820642aab6dd1e500ce1e9fd
I20260619 19:54:15.151225 2026 ts_tablet_manager.cc:1950] T d703c5c2820642aab6dd1e500ce1e9fd P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:15.153780 2539 consensus_queue.cc:1048] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:15.113237 524 master_service.cc:960] ReplaceTablet: received request to replace tablet d2939b8aa0d44ad2a05a933db4ea64be from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:15.161928 1200 raft_consensus.cc:359] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.162144 1200 raft_consensus.cc:385] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.162199 1200 raft_consensus.cc:740] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.162388 1200 consensus_queue.cc:260] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.165408 1994 ts_tablet_manager.cc:1929] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:15.169061 2539 raft_consensus.cc:493] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.169319 2539 raft_consensus.cc:515] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.171070 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c9a91f95bb4bcdafe493bab8c393b4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:15.171283 859 leader_election.cc:343] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 05c9a91f95bb4bcdafe493bab8c393b4
I20260619 19:54:15.171365 778 raft_consensus.cc:2468] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:15.172434 858 leader_election.cc:304] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.172688 2986 raft_consensus.cc:2804] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:15.172771 2986 raft_consensus.cc:493] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:15.172830 2986 raft_consensus.cc:3060] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.173337 2539 leader_election.cc:290] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:15.176288 2986 raft_consensus.cc:515] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:15.177868 859 leader_election.cc:343] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 05c9a91f95bb4bcdafe493bab8c393b4
I20260619 19:54:15.178229 2986 leader_election.cc:290] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:15.178756 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05c9a91f95bb4bcdafe493bab8c393b4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:15.178946 778 raft_consensus.cc:3060] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.181620 778 raft_consensus.cc:2468] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:15.182803 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 275) took 10732 ms. Trace:
I20260619 19:54:15.183248 858 leader_election.cc:304] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.187678 2986 raft_consensus.cc:2804] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.187868 2986 raft_consensus.cc:697] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:15.188199 2986 consensus_queue.cc:237] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.191443 2026 rpcz_store.cc:276] 0619 19:54:04.449985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.450053 (+ 68us) service_pool.cc:224] Handling call
0619 19:54:15.049921 (+10599868us) ts_tablet_manager.cc:1151] Deleting tablet d703c5c2820642aab6dd1e500ce1e9fd
0619 19:54:15.049929 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.115121 (+ 65192us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.146452 (+ 31331us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.182778 (+ 36326us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10570529}
I20260619 19:54:15.193248 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d703c5c2820642aab6dd1e500ce1e9fd (table default.Table_7babf9e56d174c6abc66c591fff1eace [id=3000203e95cc423cb4ab88f7c33f76c8]) successfully deleted
I20260619 19:54:15.193770 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 269) took 10762 ms. Trace:
I20260619 19:54:15.194607 2026 rpcz_store.cc:276] 0619 19:54:04.431324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.451691 (+ 20367us) service_pool.cc:224] Handling call
0619 19:54:15.193644 (+10741953us) ts_tablet_manager.cc:1151] Deleting tablet 4cd6b786bd844781af7fdc5849e90009
0619 19:54:15.193655 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.193754 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10690132}
I20260619 19:54:15.195394 1994 log.cc:1199] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:54:15.196025 1994 ts_tablet_manager.cc:1950] T d0a9c96d9c034a4a8a4d05d8518ebcec P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:15.196206 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 4cd6b786bd844781af7fdc5849e90009 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd6b786bd844781af7fdc5849e90009 already in progress: creating tablet
I20260619 19:54:15.196854 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 593) took 1361 ms. Trace:
I20260619 19:54:15.197048 1994 rpcz_store.cc:276] 0619 19:54:13.835823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.835874 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:14.989211 (+1153337us) ts_tablet_manager.cc:1151] Deleting tablet d0a9c96d9c034a4a8a4d05d8518ebcec
0619 19:54:14.989220 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.086559 (+ 97339us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.165343 (+ 78784us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.196832 (+ 31489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1152948}
I20260619 19:54:15.184137 1200 ts_tablet_manager.cc:1434] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260619 19:54:15.200354 1200 tablet_bootstrap.cc:492] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:15.202164 1973 ts_tablet_manager.cc:1929] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:15.203569 1200 tablet_bootstrap.cc:654] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.206735 1208 tablet_bootstrap.cc:492] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:15.212785 1208 ts_tablet_manager.cc:1403] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.080s user 0.007s sys 0.000s
I20260619 19:54:15.214435 2962 raft_consensus.cc:493] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.214651 2962 raft_consensus.cc:515] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.215339 2962 leader_election.cc:290] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:15.216087 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e65ca84182d40c280ec2b0555c0de86" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:15.216270 1057 raft_consensus.cc:2468] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:15.217343 859 leader_election.cc:304] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:15.217895 2962 raft_consensus.cc:2804] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:15.218747 1208 raft_consensus.cc:359] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.218982 1208 raft_consensus.cc:385] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.219103 1208 raft_consensus.cc:740] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.219632 779 raft_consensus.cc:3060] T 97b365df01054338a056cb0d469bc8db P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.219687 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e65ca84182d40c280ec2b0555c0de86" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:15.219491 1208 consensus_queue.cc:260] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.220336 1208 ts_tablet_manager.cc:1434] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260619 19:54:15.220606 1208 tablet_bootstrap.cc:492] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:15.222579 1208 tablet_bootstrap.cc:654] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.224723 1973 log.cc:1199] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/3091dd1a525a4f779c68b8b77afa5b26
I20260619 19:54:15.224969 2993 raft_consensus.cc:493] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.225119 2993 raft_consensus.cc:515] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.225261 1973 ts_tablet_manager.cc:1950] T 3091dd1a525a4f779c68b8b77afa5b26 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:15.225755 2993 leader_election.cc:290] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.226023 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 457) took 5322 ms. Trace:
I20260619 19:54:15.226140 1973 rpcz_store.cc:276] 0619 19:54:09.903732 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.903806 (+ 74us) service_pool.cc:224] Handling call
0619 19:54:15.128245 (+5224439us) ts_tablet_manager.cc:1151] Deleting tablet 3091dd1a525a4f779c68b8b77afa5b26
0619 19:54:15.128261 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.197549 (+ 69288us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.202091 (+ 4542us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.226003 (+ 23912us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5224145}
I20260619 19:54:15.226598 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 467) took 5057 ms. Trace:
I20260619 19:54:15.226678 1973 rpcz_store.cc:276] 0619 19:54:10.169329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.177652 (+ 8323us) service_pool.cc:224] Handling call
0619 19:54:15.226423 (+5048771us) ts_tablet_manager.cc:1151] Deleting tablet 7d1b35a09aad46039677eb3d800b0051
0619 19:54:15.226436 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.226579 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5048511}
I20260619 19:54:15.227059 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 470) took 5018 ms. Trace:
I20260619 19:54:15.227196 1973 rpcz_store.cc:276] 0619 19:54:10.208495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.208858 (+ 363us) service_pool.cc:224] Handling call
0619 19:54:15.226924 (+5018066us) ts_tablet_manager.cc:1151] Deleting tablet ac80d8fb9d874148bc8b0c508448804c
0619 19:54:15.226935 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.227032 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5017872}
I20260619 19:54:15.227816 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]) successfully deleted
W20260619 19:54:15.228152 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7d1b35a09aad46039677eb3d800b0051 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d1b35a09aad46039677eb3d800b0051 already in progress: creating tablet
W20260619 19:54:15.228397 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ac80d8fb9d874148bc8b0c508448804c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac80d8fb9d874148bc8b0c508448804c already in progress: creating tablet
I20260619 19:54:15.228722 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d703c5c2820642aab6dd1e500ce1e9fd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:15.229305 1973 tablet_replica.cc:333] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:15.229403 996 leader_election.cc:343] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.229753 1973 raft_consensus.cc:2243] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:15.230278 1973 raft_consensus.cc:2272] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.232652 1973 ts_tablet_manager.cc:1916] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.233714 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
I20260619 19:54:15.233829 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 595) took 1372 ms. Trace:
I20260619 19:54:15.233925 1994 rpcz_store.cc:276] 0619 19:54:13.861863 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.861945 (+ 82us) service_pool.cc:224] Handling call
0619 19:54:15.233672 (+1371727us) ts_tablet_manager.cc:1151] Deleting tablet f96563f57f844df4814397f76ec42007
0619 19:54:15.233687 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.233808 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1371486}
W20260619 19:54:15.234503 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f96563f57f844df4814397f76ec42007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96563f57f844df4814397f76ec42007 already in progress: creating tablet
I20260619 19:54:15.234588 1994 tablet_replica.cc:333] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:15.234799 1994 raft_consensus.cc:2243] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:15.236182 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 284) took 10718 ms. Trace:
W20260619 19:54:15.236311 858 leader_election.cc:343] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.236359 2026 rpcz_store.cc:276] 0619 19:54:04.517601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.527306 (+ 9705us) service_pool.cc:224] Handling call
0619 19:54:15.236007 (+10708701us) ts_tablet_manager.cc:1151] Deleting tablet 01fe4b37c74b4fb496f2842407c65eb1
0619 19:54:15.236021 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.236155 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10708402}
I20260619 19:54:15.236780 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 282) took 10720 ms. Trace:
I20260619 19:54:15.236867 2026 rpcz_store.cc:276] 0619 19:54:04.516487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.535079 (+ 18592us) service_pool.cc:224] Handling call
0619 19:54:15.236632 (+10701553us) ts_tablet_manager.cc:1151] Deleting tablet e68808ad4f64475782f8fba579fdb8bd
0619 19:54:15.236645 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.236735 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10694831}
I20260619 19:54:15.237195 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 270) took 10805 ms. Trace:
W20260619 19:54:15.237970 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 01fe4b37c74b4fb496f2842407c65eb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01fe4b37c74b4fb496f2842407c65eb1 already in progress: creating tablet
W20260619 19:54:15.238325 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e68808ad4f64475782f8fba579fdb8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e68808ad4f64475782f8fba579fdb8bd already in progress: creating tablet
I20260619 19:54:15.239583 2986 raft_consensus.cc:493] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:15.242951 523 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
W20260619 19:54:15.244604 531 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:53243 (request call id 214) took 915 ms (client timeout 1000 ms). Trace:
I20260619 19:54:15.244782 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_017d2f2270454e479030dd691d1d89b6" } new_table_name: "default.Table_e9eedbb5ebff4371b97b696680fc8213" modify_external_catalogs: true
W20260619 19:54:15.244733 531 rpcz_store.cc:269] 0619 19:54:14.328937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.342481 (+ 13544us) service_pool.cc:224] Handling call
0619 19:54:15.244535 (+902054us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":191360}
I20260619 19:54:15.245206 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_683e56047bab4803ac1a7aacc234fe1d" } new_table_name: "default.Table_308efb096a454e3ead472405b6f7f2b1" modify_external_catalogs: true
I20260619 19:54:15.246115 1994 pending_rounds.cc:70] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:15.246415 1994 pending_rounds.cc:77] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657710243184640 op_type: NO_OP noop_request { }
I20260619 19:54:15.246791 1994 raft_consensus.cc:2889] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:15.247081 1994 raft_consensus.cc:2272] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.249325 1208 tablet_bootstrap.cc:492] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:15.249503 1208 ts_tablet_manager.cc:1403] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260619 19:54:15.250519 1208 raft_consensus.cc:359] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.250699 1208 raft_consensus.cc:385] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.250769 1208 raft_consensus.cc:740] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:54:15.251788 529 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 259) took 995 ms (client timeout 1000 ms). Trace:
W20260619 19:54:15.251892 529 rpcz_store.cc:269] 0619 19:54:14.256450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.291577 (+ 35127us) service_pool.cc:224] Handling call
0619 19:54:15.251721 (+960144us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260619 19:54:15.251899 1208 consensus_queue.cc:260] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.252400 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f7b3d16eaff643bbba63fc88e5983ccd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:15.252537 1208 ts_tablet_manager.cc:1434] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260619 19:54:15.252918 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7b3d16eaff643bbba63fc88e5983ccd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.255977 1208 tablet_bootstrap.cc:492] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:15.263273 2539 raft_consensus.cc:493] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
W20260619 19:54:15.263805 996 leader_election.cc:343] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: d703c5c2820642aab6dd1e500ce1e9fd
I20260619 19:54:15.264037 996 leader_election.cc:304] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.264333 2993 raft_consensus.cc:2749] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:15.266994 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 73029f4bc97349da9d5d2fae4321cd5f
I20260619 19:54:15.267491 528 catalog_manager.cc:6784] ReplaceTablet: tablet 73029f4bc97349da9d5d2fae4321cd5f deleted and replaced by tablet 6763e5bd260242b7a4c12eaf6a57507f
I20260619 19:54:15.267874 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7960e324594b4ee68f9f29a77162cc92" } modify_external_catalogs: true
I20260619 19:54:15.268049 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7960e324594b4ee68f9f29a77162cc92" } modify_external_catalogs: true
I20260619 19:54:15.269363 1201 tablet_bootstrap.cc:492] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:15.269542 1201 ts_tablet_manager.cc:1403] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.213s user 0.017s sys 0.044s
I20260619 19:54:15.269742 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6763e5bd260242b7a4c12eaf6a57507f) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.270285 2962 raft_consensus.cc:493] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:15.270455 1208 tablet_bootstrap.cc:654] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.273289 1994 ts_tablet_manager.cc:1916] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.279294 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 9c977ca621224d7ab73a9e9f39540c86
I20260619 19:54:15.280004 1973 ts_tablet_manager.cc:1929] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:15.280180 1973 log.cc:1199] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/bf175c80483346788a148b7277b9ca9d
I20260619 19:54:15.280632 1973 ts_tablet_manager.cc:1950] T bf175c80483346788a148b7277b9ca9d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:15.281222 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c977ca621224d7ab73a9e9f39540c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.283622 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 821d6be6e89a42069fb8dbc3d2d749a5 (DEFAULT_TABLE table=default.Table_92f1a8c127b447be96dc51e3fe3fde03 [id=aa3a2331d9e7446cbe18ee59937ebf2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.284085 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821d6be6e89a42069fb8dbc3d2d749a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.286352 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74e17caefca44171b451258424497769 consensus state has no leader
I20260619 19:54:15.288057 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 7593abd3688249bbaa61e7b5869d9119 (DEFAULT_TABLE table=default.Table_0c58e59a4fc14af398679e836a1a2433 [id=7582d03c883a4d5880c3c6368bb4131b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.288108 1024 tablet_service.cc:1511] Processing CreateTablet for tablet fc9d0fb18c1340b1b3f9ad90ae5564ea (DEFAULT_TABLE table=default.Table_46c39532c40e4235962d782243d0c66a [id=909d49b6ebbd443998d3965e3c4e77a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.288515 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb0c341ae1443518936737c62db4eab (DEFAULT_TABLE table=default.Table_7a29dba5616749f5bb313c159dee8c31 [id=b8157b6d30434fb5a9e469d9bc6b8218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.288722 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 30b658370f0441308187450419866008 (DEFAULT_TABLE table=default.Table_4cd176000f724dec9824ba9d399a5126 [id=bb90aefa02d84ab89d04f718f3ad88be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.288995 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f (DEFAULT_TABLE table=default.Table_31824e64fa474d55b20d52c779cb886f [id=5935fadbfd9f43aeadb40f03504352fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.288512 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7593abd3688249bbaa61e7b5869d9119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.289839 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b658370f0441308187450419866008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.290066 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.294423 1994 ts_tablet_manager.cc:1929] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:15.295274 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb0c341ae1443518936737c62db4eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.297899 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9d0fb18c1340b1b3f9ad90ae5564ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.298764 1200 tablet_bootstrap.cc:492] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:15.298906 1200 ts_tablet_manager.cc:1403] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.000s
I20260619 19:54:15.299647 1200 raft_consensus.cc:359] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.299844 1200 raft_consensus.cc:385] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.299897 1200 raft_consensus.cc:740] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.300096 1200 consensus_queue.cc:260] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.300568 1200 ts_tablet_manager.cc:1434] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:15.300827 1200 tablet_bootstrap.cc:492] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:15.302531 1200 tablet_bootstrap.cc:654] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.306895 1994 log.cc:1199] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/710fae36dd674b1786aa75013284684e
I20260619 19:54:15.309058 1994 ts_tablet_manager.cc:1950] T 710fae36dd674b1786aa75013284684e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:15.309667 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a1c42c4e323a434bac1f6cb25a1a0281 (DEFAULT_TABLE table=default.Table_0c7c9744697942fab3cbfc5fb0ea59ec [id=17515310c99d4ba68b73ba9d8eff08be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.312242 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c42c4e323a434bac1f6cb25a1a0281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.317611 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 598) took 1155 ms. Trace:
I20260619 19:54:15.319605 1994 rpcz_store.cc:276] 0619 19:54:14.161888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.161965 (+ 77us) service_pool.cc:224] Handling call
0619 19:54:15.234532 (+1072567us) ts_tablet_manager.cc:1151] Deleting tablet 710fae36dd674b1786aa75013284684e
0619 19:54:15.234543 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.289246 (+ 54703us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.294373 (+ 5127us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.317588 (+ 23215us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072274}
I20260619 19:54:15.321033 1994 tablet_replica.cc:333] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:15.320972 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 710fae36dd674b1786aa75013284684e (table default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c [id=a60f9d6abee04893a759c7913479216f]) successfully deleted
I20260619 19:54:15.321780 1994 raft_consensus.cc:2243] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:15.323043 1994 raft_consensus.cc:2272] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.322710 1024 tablet_service.cc:1511] Processing CreateTablet for tablet b512a5f3ee474bb7ac4bbac1f85b423f (DEFAULT_TABLE table=default.Table_3e72a44fedb84151ad4de6d4c8c4e528 [id=f1876db77d694eedb503565b55a519a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.326231 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b512a5f3ee474bb7ac4bbac1f85b423f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.327795 1994 ts_tablet_manager.cc:1916] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.331992 2026 rpcz_store.cc:276] 0619 19:54:04.431490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.433533 (+ 2043us) service_pool.cc:224] Handling call
0619 19:54:15.237081 (+10803548us) ts_tablet_manager.cc:1151] Deleting tablet f658e85be0c843f2b02e4567a80521c4
0619 19:54:15.237089 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.237155 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10680974}
I20260619 19:54:15.333273 2986 raft_consensus.cc:515] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:15.334296 1201 raft_consensus.cc:359] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.334566 2539 raft_consensus.cc:515] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } }
I20260619 19:54:15.334810 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 651d1426dd7a4bc2917708a94fc28764 (DEFAULT_TABLE table=default.Table_cfacb03642c548889f249faa410f2c4a [id=df83abe8ebd64de484eb1df76791d378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.334903 2953 raft_consensus.cc:493] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:15.334980 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 3b1fbb31c1084a4aa851a7f7a2ad942f (DEFAULT_TABLE table=default.Table_9a0efe4dd74748209603d2df2323ea2c [id=3d4ad22a5eff4848a8ee51f486e83789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.335417 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651d1426dd7a4bc2917708a94fc28764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.335405 2962 raft_consensus.cc:3060] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.335372 900 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.338140 2962 raft_consensus.cc:515] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.338807 2962 leader_election.cc:290] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:15.335394 1201 raft_consensus.cc:385] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.339480 1201 raft_consensus.cc:740] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.339707 1201 consensus_queue.cc:260] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.340008 2953 raft_consensus.cc:515] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:15.340582 2953 leader_election.cc:290] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:15.341394 2956 catalog_manager.cc:1294] Loaded cluster ID: 3fe1a4c0d78240dabc44a1fe456bf881
I20260619 19:54:15.341499 2956 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: loading cluster ID for follower catalog manager: success
I20260619 19:54:15.342307 900 tablet_service.cc:1558] Processing DeleteTablet for tablet fe14a1f35cf14ca480221ee412c087da with delete_type TABLET_DATA_DELETED (replaced by tablet d84c4053cd194a27b86d9a924137dc15) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.342439 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6763e5bd260242b7a4c12eaf6a57507f) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.343302 900 tablet_service.cc:1511] Processing CreateTablet for tablet 821d6be6e89a42069fb8dbc3d2d749a5 (DEFAULT_TABLE table=default.Table_92f1a8c127b447be96dc51e3fe3fde03 [id=aa3a2331d9e7446cbe18ee59937ebf2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.343514 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7593abd3688249bbaa61e7b5869d9119 (DEFAULT_TABLE table=default.Table_0c58e59a4fc14af398679e836a1a2433 [id=7582d03c883a4d5880c3c6368bb4131b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.343710 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821d6be6e89a42069fb8dbc3d2d749a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.343986 896 tablet_service.cc:1511] Processing CreateTablet for tablet 30b658370f0441308187450419866008 (DEFAULT_TABLE table=default.Table_4cd176000f724dec9824ba9d399a5126 [id=bb90aefa02d84ab89d04f718f3ad88be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.344296 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b658370f0441308187450419866008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.344717 903 tablet_service.cc:1511] Processing CreateTablet for tablet b512a5f3ee474bb7ac4bbac1f85b423f (DEFAULT_TABLE table=default.Table_3e72a44fedb84151ad4de6d4c8c4e528 [id=f1876db77d694eedb503565b55a519a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.344904 899 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb0c341ae1443518936737c62db4eab (DEFAULT_TABLE table=default.Table_7a29dba5616749f5bb313c159dee8c31 [id=b8157b6d30434fb5a9e469d9bc6b8218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.345039 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b512a5f3ee474bb7ac4bbac1f85b423f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.345305 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb0c341ae1443518936737c62db4eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.345762 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7593abd3688249bbaa61e7b5869d9119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.346506 902 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f (DEFAULT_TABLE table=default.Table_31824e64fa474d55b20d52c779cb886f [id=5935fadbfd9f43aeadb40f03504352fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.346834 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.346947 898 tablet_service.cc:1511] Processing CreateTablet for tablet 902c3c6be80941589b11df1bf400ff6f (DEFAULT_TABLE table=default.Table_cb2387c2679545209ee18439765a87e2 [id=67adf1ca48774b76ad8dbf6f84d9bc9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.347350 891 tablet_service.cc:1511] Processing CreateTablet for tablet a1c42c4e323a434bac1f6cb25a1a0281 (DEFAULT_TABLE table=default.Table_0c7c9744697942fab3cbfc5fb0ea59ec [id=17515310c99d4ba68b73ba9d8eff08be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.347453 884 tablet_service.cc:1511] Processing CreateTablet for tablet fc9d0fb18c1340b1b3f9ad90ae5564ea (DEFAULT_TABLE table=default.Table_46c39532c40e4235962d782243d0c66a [id=909d49b6ebbd443998d3965e3c4e77a6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.347513 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet f658e85be0c843f2b02e4567a80521c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f658e85be0c843f2b02e4567a80521c4 already in progress: creating tablet
I20260619 19:54:15.347687 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c42c4e323a434bac1f6cb25a1a0281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.348398 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 285) took 10764 ms. Trace:
I20260619 19:54:15.348469 894 tablet_service.cc:1511] Processing CreateTablet for tablet 3b1fbb31c1084a4aa851a7f7a2ad942f (DEFAULT_TABLE table=default.Table_9a0efe4dd74748209603d2df2323ea2c [id=3d4ad22a5eff4848a8ee51f486e83789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.348517 2026 rpcz_store.cc:276] 0619 19:54:04.567794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.568390 (+ 596us) service_pool.cc:224] Handling call
0619 19:54:15.332308 (+10763918us) ts_tablet_manager.cc:1151] Deleting tablet 2718b9619524430388f0760485d8e4be
0619 19:54:15.332321 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.332430 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10763704}
I20260619 19:54:15.348821 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b1fbb31c1084a4aa851a7f7a2ad942f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.348976 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 287) took 10655 ms. Trace:
I20260619 19:54:15.349169 2986 leader_election.cc:290] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:15.349502 1201 ts_tablet_manager.cc:1434] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.080s user 0.001s sys 0.001s
I20260619 19:54:15.349809 1201 tablet_bootstrap.cc:492] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:15.350188 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9d0fb18c1340b1b3f9ad90ae5564ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.349087 2026 rpcz_store.cc:276] 0619 19:54:04.693254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.693336 (+ 82us) service_pool.cc:224] Handling call
0619 19:54:15.348812 (+10655476us) ts_tablet_manager.cc:1151] Deleting tablet 910cf00e57404f1097800e84a2070b26
0619 19:54:15.348821 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.348922 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10655240}
I20260619 19:54:15.351862 897 tablet_service.cc:1511] Processing CreateTablet for tablet df8513e281cb44d1986e7c54376e1bdc (DEFAULT_TABLE table=default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d [id=9b48e5a870494378ad36993648df8b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.352200 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8513e281cb44d1986e7c54376e1bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.346503 885 tablet_service.cc:1511] Processing CreateTablet for tablet 651d1426dd7a4bc2917708a94fc28764 (DEFAULT_TABLE table=default.Table_cfacb03642c548889f249faa410f2c4a [id=df83abe8ebd64de484eb1df76791d378]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.353011 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2718b9619524430388f0760485d8e4be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2718b9619524430388f0760485d8e4be already in progress: creating tablet
W20260619 19:54:15.353431 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 910cf00e57404f1097800e84a2070b26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 910cf00e57404f1097800e84a2070b26 already in progress: creating tablet
I20260619 19:54:15.354099 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 902c3c6be80941589b11df1bf400ff6f (DEFAULT_TABLE table=default.Table_cb2387c2679545209ee18439765a87e2 [id=67adf1ca48774b76ad8dbf6f84d9bc9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.355043 1030 tablet_service.cc:1511] Processing CreateTablet for tablet df8513e281cb44d1986e7c54376e1bdc (DEFAULT_TABLE table=default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d [id=9b48e5a870494378ad36993648df8b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.355724 2026 tablet_replica.cc:333] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:15.356293 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c977ca621224d7ab73a9e9f39540c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.358042 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651d1426dd7a4bc2917708a94fc28764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.358264 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4772b406460b4227a29fa7a6e671c0a5 (DEFAULT_TABLE table=default.Table_6a2d2bb3927d4217b9a2e9f2958673d0 [id=d20295d393e94211b378d76a6e0f01ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.363905 2539 leader_election.cc:290] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:15.364908 1201 tablet_bootstrap.cc:654] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.365654 2026 raft_consensus.cc:2243] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:15.310930 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6763e5bd260242b7a4c12eaf6a57507f) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.311118 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c977ca621224d7ab73a9e9f39540c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.311558 759 tablet_service.cc:1511] Processing CreateTablet for tablet 821d6be6e89a42069fb8dbc3d2d749a5 (DEFAULT_TABLE table=default.Table_92f1a8c127b447be96dc51e3fe3fde03 [id=aa3a2331d9e7446cbe18ee59937ebf2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.318173 754 tablet_service.cc:1511] Processing CreateTablet for tablet fc9d0fb18c1340b1b3f9ad90ae5564ea (DEFAULT_TABLE table=default.Table_46c39532c40e4235962d782243d0c66a [id=909d49b6ebbd443998d3965e3c4e77a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.379346 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821d6be6e89a42069fb8dbc3d2d749a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.379631 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9d0fb18c1340b1b3f9ad90ae5564ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.382867 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c09597d5c21c43feba411b6bb62c2a70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:15.318926 762 tablet_service.cc:1511] Processing CreateTablet for tablet 7593abd3688249bbaa61e7b5869d9119 (DEFAULT_TABLE table=default.Table_0c58e59a4fc14af398679e836a1a2433 [id=7582d03c883a4d5880c3c6368bb4131b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.383508 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7593abd3688249bbaa61e7b5869d9119. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.383540 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c09597d5c21c43feba411b6bb62c2a70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.318994 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb0c341ae1443518936737c62db4eab (DEFAULT_TABLE table=default.Table_7a29dba5616749f5bb313c159dee8c31 [id=b8157b6d30434fb5a9e469d9bc6b8218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.384181 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb0c341ae1443518936737c62db4eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.385016 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b6487d191e234b36b6b524ee98f4a71e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:15.385572 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6487d191e234b36b6b524ee98f4a71e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.319331 760 tablet_service.cc:1511] Processing CreateTablet for tablet 30b658370f0441308187450419866008 (DEFAULT_TABLE table=default.Table_4cd176000f724dec9824ba9d399a5126 [id=bb90aefa02d84ab89d04f718f3ad88be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.387385 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b658370f0441308187450419866008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.390516 1200 tablet_bootstrap.cc:492] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:15.390655 1200 ts_tablet_manager.cc:1403] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.090s user 0.007s sys 0.001s
I20260619 19:54:15.319710 761 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f (DEFAULT_TABLE table=default.Table_31824e64fa474d55b20d52c779cb886f [id=5935fadbfd9f43aeadb40f03504352fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.391448 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.319976 755 tablet_service.cc:1511] Processing CreateTablet for tablet a1c42c4e323a434bac1f6cb25a1a0281 (DEFAULT_TABLE table=default.Table_0c7c9744697942fab3cbfc5fb0ea59ec [id=17515310c99d4ba68b73ba9d8eff08be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.395454 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c42c4e323a434bac1f6cb25a1a0281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.398157 751 tablet_service.cc:1511] Processing CreateTablet for tablet 4772b406460b4227a29fa7a6e671c0a5 (DEFAULT_TABLE table=default.Table_6a2d2bb3927d4217b9a2e9f2958673d0 [id=d20295d393e94211b378d76a6e0f01ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.323160 748 tablet_service.cc:1511] Processing CreateTablet for tablet b512a5f3ee474bb7ac4bbac1f85b423f (DEFAULT_TABLE table=default.Table_3e72a44fedb84151ad4de6d4c8c4e528 [id=f1876db77d694eedb503565b55a519a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.333014 746 tablet_service.cc:1511] Processing CreateTablet for tablet 3b1fbb31c1084a4aa851a7f7a2ad942f (DEFAULT_TABLE table=default.Table_9a0efe4dd74748209603d2df2323ea2c [id=3d4ad22a5eff4848a8ee51f486e83789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.334509 757 tablet_service.cc:1511] Processing CreateTablet for tablet 651d1426dd7a4bc2917708a94fc28764 (DEFAULT_TABLE table=default.Table_cfacb03642c548889f249faa410f2c4a [id=df83abe8ebd64de484eb1df76791d378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.337250 750 tablet_service.cc:1511] Processing CreateTablet for tablet 902c3c6be80941589b11df1bf400ff6f (DEFAULT_TABLE table=default.Table_cb2387c2679545209ee18439765a87e2 [id=67adf1ca48774b76ad8dbf6f84d9bc9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.339120 763 tablet_service.cc:1511] Processing CreateTablet for tablet df8513e281cb44d1986e7c54376e1bdc (DEFAULT_TABLE table=default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d [id=9b48e5a870494378ad36993648df8b4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.341349 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e65ca84182d40c280ec2b0555c0de86" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:15.403951 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5375b8c78544de92c47cb56a9b8c25 (DEFAULT_TABLE table=default.Table_20608453192e425a99f62a98fb413a8d [id=fed1a8fdd49540e8b3d9d2f4153e02d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.406225 1200 raft_consensus.cc:359] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.406464 1200 raft_consensus.cc:385] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.406533 1200 raft_consensus.cc:740] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.408346 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f87a0e3970cc4123bc7a75db2a63eab1 (DEFAULT_TABLE table=default.Table_801d5b341fe94df38040e5987a924d1a [id=4b83351b5a1f432c97189b78c770c907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.409976 1994 ts_tablet_manager.cc:1929] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:15.411687 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b512a5f3ee474bb7ac4bbac1f85b423f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.412034 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4772b406460b4227a29fa7a6e671c0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.412231 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b1fbb31c1084a4aa851a7f7a2ad942f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.412603 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902c3c6be80941589b11df1bf400ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.412669 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902c3c6be80941589b11df1bf400ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.412992 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651d1426dd7a4bc2917708a94fc28764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.413425 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8513e281cb44d1986e7c54376e1bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.417625 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a977e889c36b434388fc7a3a5cd42e8c
W20260619 19:54:15.418083 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 148cf851ef5f4ed18ce82ee94d567d55 consensus state has no leader
I20260619 19:54:15.420079 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 801f08f4daa842238460506ccd0c466f
I20260619 19:54:15.441870 751 tablet_service.cc:1511] Processing CreateTablet for tablet dc706f266c844f86943116e18777dedd (DEFAULT_TABLE table=default.Table_7fc3a132e7904368aaeb4545946fed07 [id=f83a25668e1a48178f5d543a9f181f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.442463 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc706f266c844f86943116e18777dedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.451514 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_700ad3760841471bae364a646e4d85d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:15.452080 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 801f08f4daa842238460506ccd0c466f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:15.452322 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_700ad3760841471bae364a646e4d85d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.452455 761 tablet_service.cc:1511] Processing CreateTablet for tablet f87a0e3970cc4123bc7a75db2a63eab1 (DEFAULT_TABLE table=default.Table_801d5b341fe94df38040e5987a924d1a [id=4b83351b5a1f432c97189b78c770c907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.452561 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:15.452800 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87a0e3970cc4123bc7a75db2a63eab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.452817 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9911df524f8948ea8ecce55df0fdd0d6 (table default.Table_3f5d1b351c6045268f3010117cd2a78c [id=1150e278fd3646d9b0897243ff2524d4]). Expected version 1 got 0
I20260619 19:54:15.453094 530 catalog_manager.cc:5696] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:15.453577 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_289e9a40dfe544978d2b24059317037e [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 2 got 0
I20260619 19:54:15.453825 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:15.454188 530 catalog_manager.cc:5696] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:15.454582 530 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 8614b0ab1a3749a1a0aa441574f79ab1 (table default.Table_5b2e48a604b14d41b144c467b1738da5 [id=07abbfb4efc94a4a9104ba6600121313]). Expected version 1 got 0
I20260619 19:54:15.454736 762 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5375b8c78544de92c47cb56a9b8c25 (DEFAULT_TABLE table=default.Table_20608453192e425a99f62a98fb413a8d [id=fed1a8fdd49540e8b3d9d2f4153e02d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.455462 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3972f5248f49219df9c10b5471ad88 (DEFAULT_TABLE table=default.Table_f3d6d26aa74247d4b6d348c88b60d2af [id=f10a17fb2c724d76998e9beffcd67a7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.455989 750 tablet_service.cc:1558] Processing DeleteTablet for tablet a977e889c36b434388fc7a3a5cd42e8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.456318 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5375b8c78544de92c47cb56a9b8c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.459375 750 tablet_service.cc:1511] Processing CreateTablet for tablet 45d2aec1a22d4bf0b32899b05f1a6e6a (DEFAULT_TABLE table=default.Table_db398321a2c040db8d9c4f88816f3398 [id=499d9e65c81944ca8dfb49daecee8965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.459800 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d2aec1a22d4bf0b32899b05f1a6e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.460076 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d1d23b9d751c48ad858a35771b0ded61
I20260619 19:54:15.460598 527 catalog_manager.cc:6784] ReplaceTablet: tablet d1d23b9d751c48ad858a35771b0ded61 deleted and replaced by tablet 579567f970874a36b1b89e7d5ff70a1f
I20260619 19:54:15.460731 527 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:37030 (request call id 763) took 1049 ms. Trace:
I20260619 19:54:15.460856 527 rpcz_store.cc:276] 0619 19:54:14.411367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.463099 (+ 51732us) service_pool.cc:224] Handling call
0619 19:54:14.486969 (+ 23870us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570dc54b 00007fd74db38107 00007fd74db37e35 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:15.460697 (+973728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:15.275714 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:15.275802 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:15.275807 (+ 5us) write_op.cc:435] Acquired schema lock
0619 19:54:15.275809 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:15.275905 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:15.275914 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:15.275918 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:15.275979 (+ 61us) tablet.cc:701] Row locks acquired
0619 19:54:15.275981 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:15.276012 (+ 31us) write_op.cc:270] Start()
0619 19:54:15.276037 (+ 25us) write_op.cc:276] Timestamp: P: 1781898855275981 usec, L: 0
0619 19:54:15.276040 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 19:54:15.276182 (+ 142us) log.cc:844] Serialized 628 byte log entry
0619 19:54:15.449187 (+173005us) op_driver.cc:464] REPLICATION: finished
0619 19:54:15.455849 (+ 6662us) write_op.cc:301] APPLY: starting
0619 19:54:15.455869 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:15.455917 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:15.455951 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:15.456135 (+ 184us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:15.456197 (+ 62us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:15.456206 (+ 9us) write_op.cc:312] APPLY: finished
0619 19:54:15.456339 (+ 133us) log.cc:844] Serialized 29 byte log entry
0619 19:54:15.459800 (+ 3461us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:15.459825 (+ 25us) write_op.cc:454] Released schema lock
0619 19:54:15.459834 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:15.459924 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:15.459927 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":53812992,"child_traces":[["op",{"apply.queue_time_us":6581,"apply.run_cpu_time_us":729,"apply.run_wall_time_us":4072,"num_ops":2,"prepare.queue_time_us":313,"prepare.run_cpu_time_us":527,"prepare.run_wall_time_us":526,"replication_time_us":173113}]]}
I20260619 19:54:15.461707 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e7da0319526a4bb4bbd15f494f7ce2cd" } new_table_name: "default.Table_15292b79d02e4cc393e24ec7842d26d2" modify_external_catalogs: true
I20260619 19:54:15.462548 757 tablet_service.cc:1511] Processing CreateTablet for tablet e9aaa1b125c546b99dd6a8bf938f7287 (DEFAULT_TABLE table=default.Table_71366a598b944511b0e6d86f5c594dc4 [id=c233bffdf08144a88833826a4901c34f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.463146 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9aaa1b125c546b99dd6a8bf938f7287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.467577 746 tablet_service.cc:1511] Processing CreateTablet for tablet 636c1e4878bb4c5e903811e82e68a5a3 (DEFAULT_TABLE table=default.Table_aafc46bf4f274dd28db7b2d0c62e70eb [id=eefc4ffa84e140c3aa627e52739550cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.468219 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636c1e4878bb4c5e903811e82e68a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.468901 858 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:15.471287 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d1d23b9d751c48ad858a35771b0ded61 with delete_type TABLET_DATA_DELETED (replaced by tablet 579567f970874a36b1b89e7d5ff70a1f) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.471668 755 tablet_service.cc:1511] Processing CreateTablet for tablet c791c14822324686bb4f4f31a87b7183 (DEFAULT_TABLE table=default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e [id=56bb94c7e5c04840bbcbb43954921d32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.472023 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c791c14822324686bb4f4f31a87b7183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.477223 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ed116f9d309a45dfa9fb175247502448
I20260619 19:54:15.478318 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f6ce69e12fd643ea88c26d941424c2ab
I20260619 19:54:15.478611 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3972f5248f49219df9c10b5471ad88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.478806 526 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:37030 (request call id 762) took 1084 ms. Trace:
I20260619 19:54:15.478920 526 rpcz_store.cc:276] 0619 19:54:14.394244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.444036 (+ 49792us) service_pool.cc:224] Handling call
0619 19:54:14.464515 (+ 20479us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570d06b6 00007fd74db2d486 00007fd74db2d1b5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:14.464857 (+ 342us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0619 19:54:14.464992 (+ 135us) catalog_manager.cc:2840] Modifying in-memory table state
0619 19:54:14.465054 (+ 62us) catalog_manager.cc:2849] Locking tablets
0619 19:54:15.282339 (+817285us) catalog_manager.cc:2863] Removing table and tablets from system table
0619 19:54:15.478150 (+195811us) catalog_manager.cc:2881] Removing table from by-name map
0619 19:54:15.478222 (+ 72us) catalog_manager.cc:2897] Committing in-memory state
0619 19:54:15.478253 (+ 31us) catalog_manager.cc:2901] Aborting table tasks
0619 19:54:15.478773 (+ 520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:15.381753 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:15.381841 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:15.381845 (+ 4us) write_op.cc:435] Acquired schema lock
0619 19:54:15.381847 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:15.381931 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:15.381939 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:15.381943 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0619 19:54:15.382058 (+ 115us) tablet.cc:701] Row locks acquired
0619 19:54:15.382060 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:15.382088 (+ 28us) write_op.cc:270] Start()
0619 19:54:15.382112 (+ 24us) write_op.cc:276] Timestamp: P: 1781898855382046 usec, L: 0
0619 19:54:15.382116 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:15.382238 (+ 122us) log.cc:844] Serialized 731 byte log entry
0619 19:54:15.475330 (+ 93092us) op_driver.cc:464] REPLICATION: finished
0619 19:54:15.476557 (+ 1227us) write_op.cc:301] APPLY: starting
0619 19:54:15.476568 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:15.476600 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:15.476634 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:15.476684 (+ 50us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:15.476710 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0619 19:54:15.476717 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:15.476767 (+ 50us) log.cc:844] Serialized 29 byte log entry
0619 19:54:15.476806 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:15.476819 (+ 13us) write_op.cc:454] Released schema lock
0619 19:54:15.476824 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":46530304,"child_traces":[["op",{"apply.queue_time_us":1194,"apply.run_cpu_time_us":321,"apply.run_wall_time_us":321,"num_ops":2,"prepare.queue_time_us":98851,"prepare.run_cpu_time_us":529,"prepare.run_wall_time_us":528,"replication_time_us":93201}]]}
I20260619 19:54:15.479910 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d2939b8aa0d44ad2a05a933db4ea64be
I20260619 19:54:15.480361 524 catalog_manager.cc:6784] ReplaceTablet: tablet d2939b8aa0d44ad2a05a933db4ea64be deleted and replaced by tablet 9ff01c0de8a540d0a024a4924199ba54
I20260619 19:54:15.480594 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 32ecd267aa34469cad9db0745178013b from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:15.483415 2920 raft_consensus.cc:493] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.483548 2920 raft_consensus.cc:515] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.484193 2920 leader_election.cc:290] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:15.485268 720 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fb6bc52ee1fa4ac8967f937e59b4550c
I20260619 19:54:15.486632 1994 log.cc:1199] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/88c9073ef30d456d8dc8609ddf1335ce
I20260619 19:54:15.487020 1994 ts_tablet_manager.cc:1950] T 88c9073ef30d456d8dc8609ddf1335ce P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:15.488091 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 471) took 5257 ms. Trace:
I20260619 19:54:15.488169 1973 rpcz_store.cc:276] 0619 19:54:10.231101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.231168 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:15.229244 (+4998076us) ts_tablet_manager.cc:1151] Deleting tablet bf175c80483346788a148b7277b9ca9d
0619 19:54:15.229257 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.267025 (+ 37768us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.279915 (+ 12890us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.488073 (+208158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4997853}
I20260619 19:54:15.488713 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 472) took 5201 ms. Trace:
I20260619 19:54:15.488731 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet bf175c80483346788a148b7277b9ca9d (table default.Table_87768bcb7d2347faa2a8624f28911b02 [id=14dbea33ca974c8fa94e99d0d9f79272]) successfully deleted
I20260619 19:54:15.488786 1973 rpcz_store.cc:276] 0619 19:54:10.287253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.287464 (+ 211us) service_pool.cc:224] Handling call
0619 19:54:15.488585 (+5201121us) ts_tablet_manager.cc:1151] Deleting tablet 46c2a94a4d794f2aa94b77885812831f
0619 19:54:15.488595 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.488695 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5200891}
I20260619 19:54:15.489230 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 478) took 4875 ms. Trace:
I20260619 19:54:15.489297 1973 rpcz_store.cc:276] 0619 19:54:10.614141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.615326 (+ 1185us) service_pool.cc:224] Handling call
0619 19:54:15.489113 (+4873787us) ts_tablet_manager.cc:1151] Deleting tablet c3c0937d5fea430da4dbdf9381157268
0619 19:54:15.489121 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.489218 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4873620}
W20260619 19:54:15.489452 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 46c2a94a4d794f2aa94b77885812831f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46c2a94a4d794f2aa94b77885812831f already in progress: creating tablet
I20260619 19:54:15.489656 1973 tablet_replica.cc:333] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:15.489727 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c3c0937d5fea430da4dbdf9381157268 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3c0937d5fea430da4dbdf9381157268 already in progress: creating tablet
I20260619 19:54:15.489857 1973 raft_consensus.cc:2243] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:15.490023 1973 raft_consensus.cc:2272] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.490736 1973 ts_tablet_manager.cc:1916] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.490962 763 tablet_service.cc:1558] Processing DeleteTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff01c0de8a540d0a024a4924199ba54) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.496851 760 tablet_service.cc:1558] Processing DeleteTablet for tablet f6ce69e12fd643ea88c26d941424c2ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.497886 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902c3c6be80941589b11df1bf400ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.501864 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8513e281cb44d1986e7c54376e1bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.503960 2026 raft_consensus.cc:2272] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:15.505049 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 99839.6us
I20260619 19:54:15.506474 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4772b406460b4227a29fa7a6e671c0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.506508 2920 raft_consensus.cc:493] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.506636 2920 raft_consensus.cc:515] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.507275 2920 leader_election.cc:290] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.507887 895 tablet_service.cc:1511] Processing CreateTablet for tablet f87a0e3970cc4123bc7a75db2a63eab1 (DEFAULT_TABLE table=default.Table_801d5b341fe94df38040e5987a924d1a [id=4b83351b5a1f432c97189b78c770c907]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.508265 720 leader_election.cc:343] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: eb4b1e87f2e84bcaaa07ff9f687b9e3d
I20260619 19:54:15.509174 888 tablet_service.cc:1511] Processing CreateTablet for tablet 4772b406460b4227a29fa7a6e671c0a5 (DEFAULT_TABLE table=default.Table_6a2d2bb3927d4217b9a2e9f2958673d0 [id=d20295d393e94211b378d76a6e0f01ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.510015 2026 ts_tablet_manager.cc:1916] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.511220 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 801f08f4daa842238460506ccd0c466f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.512645 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5375b8c78544de92c47cb56a9b8c25 (DEFAULT_TABLE table=default.Table_20608453192e425a99f62a98fb413a8d [id=fed1a8fdd49540e8b3d9d2f4153e02d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.517283 893 tablet_service.cc:1558] Processing DeleteTablet for tablet a977e889c36b434388fc7a3a5cd42e8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.519657 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b54c9d239a4342bd959810ee017b8dcc (DEFAULT_TABLE table=default.Table_e73233a773d74ae2b28e0a7f5480cb61 [id=c362c1d1c98142bdae3e1e4449755fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.423349 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet a977e889c36b434388fc7a3a5cd42e8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.423502 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 801f08f4daa842238460506ccd0c466f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.441762 1025 tablet_service.cc:1511] Processing CreateTablet for tablet dc706f266c844f86943116e18777dedd (DEFAULT_TABLE table=default.Table_7fc3a132e7904368aaeb4545946fed07 [id=f83a25668e1a48178f5d543a9f181f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.447592 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3972f5248f49219df9c10b5471ad88 (DEFAULT_TABLE table=default.Table_f3d6d26aa74247d4b6d348c88b60d2af [id=f10a17fb2c724d76998e9beffcd67a7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.456048 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 45d2aec1a22d4bf0b32899b05f1a6e6a (DEFAULT_TABLE table=default.Table_db398321a2c040db8d9c4f88816f3398 [id=499d9e65c81944ca8dfb49daecee8965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.459470 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e9aaa1b125c546b99dd6a8bf938f7287 (DEFAULT_TABLE table=default.Table_71366a598b944511b0e6d86f5c594dc4 [id=c233bffdf08144a88833826a4901c34f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.464133 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d1d23b9d751c48ad858a35771b0ded61 with delete_type TABLET_DATA_DELETED (replaced by tablet 579567f970874a36b1b89e7d5ff70a1f) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.464496 1022 tablet_service.cc:1511] Processing CreateTablet for tablet c791c14822324686bb4f4f31a87b7183 (DEFAULT_TABLE table=default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e [id=56bb94c7e5c04840bbcbb43954921d32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.467077 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 636c1e4878bb4c5e903811e82e68a5a3 (DEFAULT_TABLE table=default.Table_aafc46bf4f274dd28db7b2d0c62e70eb [id=eefc4ffa84e140c3aa627e52739550cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.483259 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet ed116f9d309a45dfa9fb175247502448 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.483259 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet f6ce69e12fd643ea88c26d941424c2ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.484790 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff01c0de8a540d0a024a4924199ba54) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.525120 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 8e36f7c1d0de49359bf7a113465bc241 (DEFAULT_TABLE table=default.Table_768684129cfe44258358f47422cf89a5 [id=ea722ed6a32146faac1213653b12352e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.412367 1200 consensus_queue.cc:260] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.528249 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87a0e3970cc4123bc7a75db2a63eab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.529042 1200 ts_tablet_manager.cc:1434] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.138s user 0.002s sys 0.002s
I20260619 19:54:15.529866 1200 tablet_bootstrap.cc:492] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:15.530808 2920 raft_consensus.cc:493] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.530949 2920 raft_consensus.cc:515] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.531629 2920 leader_election.cc:290] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:15.532618 720 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 710fae36dd674b1786aa75013284684e
W20260619 19:54:15.535199 858 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
W20260619 19:54:15.535449 858 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 950b8e74d12f46a68ba5eae3186c87a9
W20260619 19:54:15.535558 858 leader_election.cc:343] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:15.535878 858 consensus_peers.cc:597] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3091dd1a525a4f779c68b8b77afa5b26. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:15.526208 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b1fbb31c1084a4aa851a7f7a2ad942f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.536583 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5375b8c78544de92c47cb56a9b8c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.539448 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc706f266c844f86943116e18777dedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.539773 3003 consensus_queue.cc:1048] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:15.541245 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87a0e3970cc4123bc7a75db2a63eab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.559267 760 tablet_service.cc:1511] Processing CreateTablet for tablet 8e36f7c1d0de49359bf7a113465bc241 (DEFAULT_TABLE table=default.Table_768684129cfe44258358f47422cf89a5 [id=ea722ed6a32146faac1213653b12352e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.559886 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e36f7c1d0de49359bf7a113465bc241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.559888 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e36f7c1d0de49359bf7a113465bc241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.560123 893 tablet_service.cc:1511] Processing CreateTablet for tablet dc706f266c844f86943116e18777dedd (DEFAULT_TABLE table=default.Table_7fc3a132e7904368aaeb4545946fed07 [id=f83a25668e1a48178f5d543a9f181f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.566119 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 904dd2aac07347a5979f6607bbe5665f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:15.568639 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5375b8c78544de92c47cb56a9b8c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.568645 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e63e4a6a46584565bd00b07e52fa0580" } new_table_name: "default.Table_d602ef9e9e5648128426b910a80e1f39" modify_external_catalogs: true
I20260619 19:54:15.570225 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1af8c578eef1461093d09e3c7c8724d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:15.570812 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1af8c578eef1461093d09e3c7c8724d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.574378 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1972a7767fba46dc9ae98720aa394465 (DEFAULT_TABLE table=default.Table_8efe29b385694713822116a243538ddf [id=d8a6f8d54acc41ee8ebe9461c7c87170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.574501 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc706f266c844f86943116e18777dedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.574791 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4772b406460b4227a29fa7a6e671c0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.574750 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b54e41ea7f3743c0a2b7d330cdfc13a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:15.575047 894 tablet_service.cc:1511] Processing CreateTablet for tablet 45d2aec1a22d4bf0b32899b05f1a6e6a (DEFAULT_TABLE table=default.Table_db398321a2c040db8d9c4f88816f3398 [id=499d9e65c81944ca8dfb49daecee8965]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.575335 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b54e41ea7f3743c0a2b7d330cdfc13a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.575446 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1972a7767fba46dc9ae98720aa394465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.575574 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d2aec1a22d4bf0b32899b05f1a6e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.580500 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 1972a7767fba46dc9ae98720aa394465 (DEFAULT_TABLE table=default.Table_8efe29b385694713822116a243538ddf [id=d8a6f8d54acc41ee8ebe9461c7c87170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.581089 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1972a7767fba46dc9ae98720aa394465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.581291 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3972f5248f49219df9c10b5471ad88 (DEFAULT_TABLE table=default.Table_f3d6d26aa74247d4b6d348c88b60d2af [id=f10a17fb2c724d76998e9beffcd67a7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.591984 3003 raft_consensus.cc:493] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.592171 3003 raft_consensus.cc:515] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.592806 3003 leader_election.cc:290] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.594014 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb4005068684928b3b27ff73b108d1b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:15.594558 996 leader_election.cc:343] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.599859 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 66c1f0b4b7f84a07a83dbdcad28f6cf7 (DEFAULT_TABLE table=default.Table_9ef0500c485d406db28f8f004310209d [id=ed368eeb7af648359f9cb9a9c992e897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.600344 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c1f0b4b7f84a07a83dbdcad28f6cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.602944 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3972f5248f49219df9c10b5471ad88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.603317 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9aaa1b125c546b99dd6a8bf938f7287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.607331 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c791c14822324686bb4f4f31a87b7183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.611292 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d2aec1a22d4bf0b32899b05f1a6e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.611280 763 tablet_service.cc:1511] Processing CreateTablet for tablet 66c1f0b4b7f84a07a83dbdcad28f6cf7 (DEFAULT_TABLE table=default.Table_9ef0500c485d406db28f8f004310209d [id=ed368eeb7af648359f9cb9a9c992e897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.611897 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c1f0b4b7f84a07a83dbdcad28f6cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.613063 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 5aedb6bce1c94f84b7123efc6426fe84 (DEFAULT_TABLE table=default.Table_2980de0b77f148a6ad1e15416b842ea0 [id=6959b113e9e4460abe9b7e6b9b76ac3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.613452 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aedb6bce1c94f84b7123efc6426fe84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.619036 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_289e9a40dfe544978d2b24059317037e [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 2 got 0
I20260619 19:54:15.619441 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet c08fc0181e5642d0a2b7967ff30d4eaa (table default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72]). Expected version 1 got 0
I20260619 19:54:15.619767 531 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:15.624854 751 tablet_service.cc:1511] Processing CreateTablet for tablet 5aedb6bce1c94f84b7123efc6426fe84 (DEFAULT_TABLE table=default.Table_2980de0b77f148a6ad1e15416b842ea0 [id=6959b113e9e4460abe9b7e6b9b76ac3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.624938 3003 raft_consensus.cc:493] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.625100 3003 raft_consensus.cc:515] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.625771 3003 leader_election.cc:290] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.626477 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911df524f8948ea8ecce55df0fdd0d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:15.627050 996 leader_election.cc:343] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.628950 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aedb6bce1c94f84b7123efc6426fe84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.630162 746 tablet_service.cc:1511] Processing CreateTablet for tablet b54c9d239a4342bd959810ee017b8dcc (DEFAULT_TABLE table=default.Table_e73233a773d74ae2b28e0a7f5480cb61 [id=c362c1d1c98142bdae3e1e4449755fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.632309 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_2ab8893f3373415f8d95cd7478479821 [id=02f9b7422ad049e19c6d57b58f7fbc96] alter complete (version 2)
I20260619 19:54:15.632939 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54c9d239a4342bd959810ee017b8dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.634639 900 tablet_service.cc:1511] Processing CreateTablet for tablet c791c14822324686bb4f4f31a87b7183 (DEFAULT_TABLE table=default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e [id=56bb94c7e5c04840bbcbb43954921d32]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.635098 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 61088.8us
I20260619 19:54:15.637763 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4780d09f6e8b40728b0b4d4cb0982ba5 (DEFAULT_TABLE table=default.Table_638366ccda344409a3c5e2b40dc5255b [id=aa0f5610b77b4dfb9932e0fe536d3492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.638223 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4780d09f6e8b40728b0b4d4cb0982ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.638686 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3972f5248f49219df9c10b5471ad88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.639802 884 tablet_service.cc:1558] Processing DeleteTablet for tablet d1d23b9d751c48ad858a35771b0ded61 with delete_type TABLET_DATA_DELETED (replaced by tablet 579567f970874a36b1b89e7d5ff70a1f) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.640426 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911df524f8948ea8ecce55df0fdd0d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:15.640636 915 raft_consensus.cc:2468] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:15.646766 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636c1e4878bb4c5e903811e82e68a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.647441 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0e1e116f7d49f78d5f651070ae0974 (DEFAULT_TABLE table=default.Table_ecc39f19974445339140abe391370170 [id=b361d2c5666844848a992a190cad33a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.647819 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0e1e116f7d49f78d5f651070ae0974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.648068 759 tablet_service.cc:1511] Processing CreateTablet for tablet ec8ede6902b041a99e737b487f94a5f2 (DEFAULT_TABLE table=default.Table_eb8e60da5ccb4beaac79c304b660a4ae [id=63a0edc738904b35b70d6cb002b29c78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.648260 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ec8ede6902b041a99e737b487f94a5f2 (DEFAULT_TABLE table=default.Table_eb8e60da5ccb4beaac79c304b660a4ae [id=63a0edc738904b35b70d6cb002b29c78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.648543 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8ede6902b041a99e737b487f94a5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.648660 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8ede6902b041a99e737b487f94a5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.652951 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb4005068684928b3b27ff73b108d1b" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:15.653306 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54c9d239a4342bd959810ee017b8dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.654584 996 leader_election.cc:304] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.654652 751 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0e1e116f7d49f78d5f651070ae0974 (DEFAULT_TABLE table=default.Table_ecc39f19974445339140abe391370170 [id=b361d2c5666844848a992a190cad33a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.655019 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0e1e116f7d49f78d5f651070ae0974. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.655160 996 leader_election.cc:343] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.655282 996 leader_election.cc:304] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.655637 2996 raft_consensus.cc:2804] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:15.655731 2996 raft_consensus.cc:493] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:15.655823 2996 raft_consensus.cc:3060] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.658537 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 599) took 1470 ms. Trace:
I20260619 19:54:15.658659 1994 rpcz_store.cc:276] 0619 19:54:14.187802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.187875 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:15.320979 (+1133104us) ts_tablet_manager.cc:1151] Deleting tablet 88c9073ef30d456d8dc8609ddf1335ce
0619 19:54:15.320991 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.331060 (+ 10069us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.409906 (+ 78846us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.658484 (+248578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1132802}
I20260619 19:54:15.658825 2996 raft_consensus.cc:515] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.659392 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 88c9073ef30d456d8dc8609ddf1335ce (table default.Table_81965bd42e674af7a540c53e595dc804 [id=47800ee54fac40698e9f6cbf26219788]) successfully deleted
I20260619 19:54:15.659634 3003 raft_consensus.cc:2749] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:15.660722 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ed116f9d309a45dfa9fb175247502448 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.661494 2996 leader_election.cc:290] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.662340 899 tablet_service.cc:1511] Processing CreateTablet for tablet e9aaa1b125c546b99dd6a8bf938f7287 (DEFAULT_TABLE table=default.Table_71366a598b944511b0e6d86f5c594dc4 [id=c233bffdf08144a88833826a4901c34f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.662653 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911df524f8948ea8ecce55df0fdd0d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:15.662819 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b4ef64f800ac4d4e81ab6ff213b6838f (DEFAULT_TABLE table=default.Table_6cc0e4d20ac744bbb5c762479e4e1f47 [id=5721cb48d4ba48c28a950e92121f965c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.663295 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c791c14822324686bb4f4f31a87b7183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.663301 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ef64f800ac4d4e81ab6ff213b6838f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.664687 754 tablet_service.cc:1511] Processing CreateTablet for tablet b4ef64f800ac4d4e81ab6ff213b6838f (DEFAULT_TABLE table=default.Table_6cc0e4d20ac744bbb5c762479e4e1f47 [id=5721cb48d4ba48c28a950e92121f965c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.665062 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ef64f800ac4d4e81ab6ff213b6838f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.667600 996 leader_election.cc:343] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.668267 1208 tablet_bootstrap.cc:492] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:15.668404 1208 ts_tablet_manager.cc:1403] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.413s user 0.045s sys 0.106s
W20260619 19:54:15.668875 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8d8a5ed6a874739b2195f8caa74ae9b has no consensus state
I20260619 19:54:15.670118 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9aaa1b125c546b99dd6a8bf938f7287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.670207 1208 raft_consensus.cc:359] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.670377 1208 raft_consensus.cc:385] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:15.670480 1208 raft_consensus.cc:740] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:15.670732 1208 consensus_queue.cc:260] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.671271 1208 ts_tablet_manager.cc:1434] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260619 19:54:15.675185 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b719a071d63b4664b397926a5f99ec7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:15.675879 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b719a071d63b4664b397926a5f99ec7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.677726 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1ae79f8cc1b945ff951cd84a52a2cb01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:15.678310 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ae79f8cc1b945ff951cd84a52a2cb01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.679679 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911df524f8948ea8ecce55df0fdd0d6" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:15.679859 915 raft_consensus.cc:3060] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.680042 885 tablet_service.cc:1558] Processing DeleteTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff01c0de8a540d0a024a4924199ba54) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.680517 1208 tablet_bootstrap.cc:492] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:15.682113 1208 tablet_bootstrap.cc:654] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.687048 1200 tablet_bootstrap.cc:654] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:15.688165 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 370447us
I20260619 19:54:15.692776 915 raft_consensus.cc:2468] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:15.695618 996 leader_election.cc:304] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.696516 3003 raft_consensus.cc:2804] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.696695 3003 raft_consensus.cc:697] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:15.696993 3003 consensus_queue.cc:237] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.699800 776 raft_consensus.cc:3060] T 5aaf38b6b7b14298ae0e73bc421de988 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.703084 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e65ca84182d40c280ec2b0555c0de86" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:15.703329 1055 raft_consensus.cc:3060] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:15.703766 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet d3e84f5ef3ef4ff0b557d65fb5eae97a (table default.Table_ae96d6ef6aca4cafb6a48fc012ae4c06 [id=7ea73c05d7e54bfe8f3c2acc34670ccc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d3e84f5ef3ef4ff0b557d65fb5eae97a consensus state has no leader
W20260619 19:54:15.704927 859 leader_election.cc:343] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 950b8e74d12f46a68ba5eae3186c87a9
I20260619 19:54:15.705199 859 leader_election.cc:304] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.705623 2909 raft_consensus.cc:2749] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:15.706643 1055 raft_consensus.cc:2468] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:15.707940 859 leader_election.cc:304] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.708423 2909 raft_consensus.cc:2804] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.708544 2909 raft_consensus.cc:697] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
W20260619 19:54:15.708945 859 leader_election.cc:343] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:15.709106 859 leader_election.cc:304] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:15.709473 859 raft_consensus.cc:2686] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:54:15.709812 859 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:15.710003 859 leader_election.cc:304] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:15.710346 2953 raft_consensus.cc:493] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.710477 2953 raft_consensus.cc:515] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.711971 1994 tablet_replica.cc:333] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:15.712211 1994 raft_consensus.cc:2243] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:15.712383 885 tablet_service.cc:1511] Processing CreateTablet for tablet 636c1e4878bb4c5e903811e82e68a5a3 (DEFAULT_TABLE table=default.Table_aafc46bf4f274dd28db7b2d0c62e70eb [id=eefc4ffa84e140c3aa627e52739550cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.712591 1994 raft_consensus.cc:2272] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.712704 898 tablet_service.cc:1558] Processing DeleteTablet for tablet f6ce69e12fd643ea88c26d941424c2ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:15.720417 3003 raft_consensus.cc:493] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.720695 3003 raft_consensus.cc:515] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.721418 3003 leader_election.cc:290] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.721683 755 tablet_service.cc:1558] Processing DeleteTablet for tablet ed116f9d309a45dfa9fb175247502448 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:14 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.727602 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4780d09f6e8b40728b0b4d4cb0982ba5 (DEFAULT_TABLE table=default.Table_638366ccda344409a3c5e2b40dc5255b [id=aa0f5610b77b4dfb9932e0fe536d3492]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.728710 720 consensus_peers.cc:597] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0a9c96d9c034a4a8a4d05d8518ebcec. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:15.711304 2909 consensus_queue.cc:237] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.729735 1994 ts_tablet_manager.cc:1916] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.730662 898 tablet_service.cc:1511] Processing CreateTablet for tablet b54c9d239a4342bd959810ee017b8dcc (DEFAULT_TABLE table=default.Table_e73233a773d74ae2b28e0a7f5480cb61 [id=c362c1d1c98142bdae3e1e4449755fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.732029 2026 ts_tablet_manager.cc:1929] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:15.732223 2026 log.cc:1199] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/365c0bb1e9ac480e96e7f4d604048663
I20260619 19:54:15.732338 3064 tablet.cc:1724] T 83452ce6b5b3479b98ea312db05dc651 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:15.734186 884 tablet_service.cc:1511] Processing CreateTablet for tablet 8e36f7c1d0de49359bf7a113465bc241 (DEFAULT_TABLE table=default.Table_768684129cfe44258358f47422cf89a5 [id=ea722ed6a32146faac1213653b12352e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.735364 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 636c1e4878bb4c5e903811e82e68a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.737380 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54c9d239a4342bd959810ee017b8dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.738143 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e36f7c1d0de49359bf7a113465bc241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.733469 2953 leader_election.cc:290] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:15.742002 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 43557.7us
I20260619 19:54:15.743317 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:15.744436 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:15.744150 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 92ca1721fd3c4bcea2fa43780a570dc7 (DEFAULT_TABLE table=default.Table_5df77d322daf403ba382436b5192ca95 [id=f09db531def54719949b02965ec0c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.745584 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ca1721fd3c4bcea2fa43780a570dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.745685 895 tablet_service.cc:1511] Processing CreateTablet for tablet 5aedb6bce1c94f84b7123efc6426fe84 (DEFAULT_TABLE table=default.Table_2980de0b77f148a6ad1e15416b842ea0 [id=6959b113e9e4460abe9b7e6b9b76ac3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.747602 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aedb6bce1c94f84b7123efc6426fe84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.748188 750 tablet_service.cc:1511] Processing CreateTablet for tablet c52eaeef941140ecb8d1045c88c7231b (DEFAULT_TABLE table=default.Table_4647d0fd20864186920dcfb257dfc867 [id=0ccd76f8e1614b5eb9526063daf54e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.748632 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52eaeef941140ecb8d1045c88c7231b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.746312 858 leader_election.cc:343] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.749151 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1972a7767fba46dc9ae98720aa394465 (DEFAULT_TABLE table=default.Table_8efe29b385694713822116a243538ddf [id=d8a6f8d54acc41ee8ebe9461c7c87170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.752202 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1972a7767fba46dc9ae98720aa394465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.759119 2026 ts_tablet_manager.cc:1950] T 365c0bb1e9ac480e96e7f4d604048663 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:15.746338 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c52eaeef941140ecb8d1045c88c7231b (DEFAULT_TABLE table=default.Table_4647d0fd20864186920dcfb257dfc867 [id=0ccd76f8e1614b5eb9526063daf54e7f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.755082 996 leader_election.cc:343] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.760450 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52eaeef941140ecb8d1045c88c7231b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.761473 901 tablet_service.cc:1511] Processing CreateTablet for tablet 4780d09f6e8b40728b0b4d4cb0982ba5 (DEFAULT_TABLE table=default.Table_638366ccda344409a3c5e2b40dc5255b [id=aa0f5610b77b4dfb9932e0fe536d3492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.762578 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4780d09f6e8b40728b0b4d4cb0982ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.762014 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 286) took 11114 ms. Trace:
I20260619 19:54:15.763470 2026 rpcz_store.cc:276] 0619 19:54:04.647188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.647377 (+ 189us) service_pool.cc:224] Handling call
0619 19:54:15.351844 (+10704467us) ts_tablet_manager.cc:1151] Deleting tablet 365c0bb1e9ac480e96e7f4d604048663
0619 19:54:15.351852 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.570527 (+218675us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.584699 (+ 14172us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.761995 (+177296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10639812}
I20260619 19:54:15.764006 2026 tablet_replica.cc:333] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:15.763923 1022 tablet_service.cc:1511] Processing CreateTablet for tablet ec63a0062ba24760b0ebcb08b5fa2699 (DEFAULT_TABLE table=default.Table_4f89735ef1c44028bfb7e954222cd7ea [id=8c8a33ff85884939bc3d65a9def10649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.764304 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63a0062ba24760b0ebcb08b5fa2699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.771760 1024 tablet_service.cc:1511] Processing CreateTablet for tablet a2c5a1bc7b4243f19d08a27249e23a52 (DEFAULT_TABLE table=default.Table_19bc418b3c714dd09369d232f417db60 [id=bee345f6db96404cb9edfd320cb757b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.775604 754 tablet_service.cc:1511] Processing CreateTablet for tablet dea574d64d5f4a619bb1f3ffd53fe3f1 (DEFAULT_TABLE table=default.Table_99391b7e2a8246d8a5c13ab7e94001e0 [id=c3d8ee2b3fcf494c841aae2384e56e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.775671 751 tablet_service.cc:1511] Processing CreateTablet for tablet 6dcc6a33ac96439d9409ec194b40ab5f (DEFAULT_TABLE table=default.Table_4310c3d1b2cf4ad0841fee7480e05bf5 [id=af86bb18a53b4533a6d11a8f62c4413f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.776028 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea574d64d5f4a619bb1f3ffd53fe3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.776234 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dcc6a33ac96439d9409ec194b40ab5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.783308 2026 raft_consensus.cc:2243] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:15.783751 2026 pending_rounds.cc:70] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:15.774605 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 6dcc6a33ac96439d9409ec194b40ab5f (DEFAULT_TABLE table=default.Table_4310c3d1b2cf4ad0841fee7480e05bf5 [id=af86bb18a53b4533a6d11a8f62c4413f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.784214 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c5a1bc7b4243f19d08a27249e23a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.784382 2026 pending_rounds.cc:77] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657703960301568 op_type: NO_OP noop_request { }
I20260619 19:54:15.784660 2026 raft_consensus.cc:2889] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:15.784926 2026 raft_consensus.cc:2272] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:15.785279 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dcc6a33ac96439d9409ec194b40ab5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.786293 2026 ts_tablet_manager.cc:1916] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:15.791894 761 tablet_service.cc:1511] Processing CreateTablet for tablet a2c5a1bc7b4243f19d08a27249e23a52 (DEFAULT_TABLE table=default.Table_19bc418b3c714dd09369d232f417db60 [id=bee345f6db96404cb9edfd320cb757b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.793592 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:15.793856 919 raft_consensus.cc:2468] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
W20260619 19:54:15.794381 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet deba56eb121e4aa6b8ad7b13951723aa consensus state has no leader
I20260619 19:54:15.794350 996 leader_election.cc:304] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.794853 3003 raft_consensus.cc:2804] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:15.794974 3003 raft_consensus.cc:493] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:15.795090 3003 raft_consensus.cc:3060] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.796483 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:15.797600 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1b4977d0526047a79425bc05e1582c45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:15.798137 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b4977d0526047a79425bc05e1582c45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.799003 3003 raft_consensus.cc:515] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.800529 3003 leader_election.cc:290] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.800917 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 32ecd267aa34469cad9db0745178013b
I20260619 19:54:15.801342 524 catalog_manager.cc:6784] ReplaceTablet: tablet 32ecd267aa34469cad9db0745178013b deleted and replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9
I20260619 19:54:15.801719 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fa04a3fc676f423db521f04052e2b148" } new_table_name: "default.Table_e18351855dab4ebabc6be0205a47e823" modify_external_catalogs: true
I20260619 19:54:15.802979 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 904dd2aac07347a5979f6607bbe5665f
I20260619 19:54:15.803628 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1b9c1d7cb147402292e27bb7ca37bf1b" } modify_external_catalogs: true
I20260619 19:54:15.803813 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1b9c1d7cb147402292e27bb7ca37bf1b" } modify_external_catalogs: true
I20260619 19:54:15.806456 523 catalog_manager.cc:6784] ReplaceTablet: tablet 904dd2aac07347a5979f6607bbe5665f deleted and replaced by tablet 73fa6438bb734872a22cf1e8aa80470e
I20260619 19:54:15.806780 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9f0ad99a69364bddb17a16eb224030b1" } new_table_name: "default.Table_8525cd90863645549faee9c678faf387" modify_external_catalogs: true
I20260619 19:54:15.806943 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ecd267aa34469cad9db0745178013b with delete_type TABLET_DATA_DELETED (replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.807395 755 tablet_service.cc:1511] Processing CreateTablet for tablet 34206a3e10fe4c82bfc7666c8327d707 (DEFAULT_TABLE table=default.Table_633f3214b3e74337a37d4e0000d6e0c2 [id=a1dd5f5c01bb42ecb7a033f58ad13855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.807775 776 raft_consensus.cc:3060] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:15.811331 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:15.811703 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:15.812325 996 leader_election.cc:343] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:15.812970 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 904dd2aac07347a5979f6607bbe5665f with delete_type TABLET_DATA_DELETED (replaced by tablet 73fa6438bb734872a22cf1e8aa80470e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.813460 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c5a1bc7b4243f19d08a27249e23a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.816649 3003 consensus_queue.cc:1048] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:15.819679 897 tablet_service.cc:1511] Processing CreateTablet for tablet 66c1f0b4b7f84a07a83dbdcad28f6cf7 (DEFAULT_TABLE table=default.Table_9ef0500c485d406db28f8f004310209d [id=ed368eeb7af648359f9cb9a9c992e897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.820371 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 904dd2aac07347a5979f6607bbe5665f with delete_type TABLET_DATA_DELETED (replaced by tablet 73fa6438bb734872a22cf1e8aa80470e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.820786 1039 tablet_service.cc:1511] Processing CreateTablet for tablet d6bf3909a44147049c854f574bc1ecbb (DEFAULT_TABLE table=default.Table_906aa3cdbfd5474989f1f99803b0751d [id=280448d3981e41f2a647493013bf2731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.821131 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bf3909a44147049c854f574bc1ecbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.823391 1038 tablet_service.cc:1511] Processing CreateTablet for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 (DEFAULT_TABLE table=default.Table_c008f33c8ae74120a621a08954129d2a [id=732c6ab4beeb4783aaa145bab23c6d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.823738 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.828063 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 837a69f9153c4bf8836804017c8bac40 (DEFAULT_TABLE table=default.Table_d436621459c84358a9670595540687ab [id=4eaf2375f47a43dd9ca3608c5d5de842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.828420 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837a69f9153c4bf8836804017c8bac40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.836114 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:15.836556 919 raft_consensus.cc:3060] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:15.843977 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c1f0b4b7f84a07a83dbdcad28f6cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.846066 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ecd267aa34469cad9db0745178013b with delete_type TABLET_DATA_DELETED (replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.846222 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_194296d408ce42ee8dfb04120cc3af1c [id=55b6b9eae3ed41a487ea1b9468cd518f] alter complete (version 1)
I20260619 19:54:15.858029 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.858273 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c9073ef30d456d8dc8609ddf1335ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.858486 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.860594 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ea03e6d6e7a0411082726e31877628b0 (DEFAULT_TABLE table=default.Table_ac203b76f07042c79ac356c1c30c2156 [id=c6d53538763b4173b13e2e2ba4dc69c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.861268 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea03e6d6e7a0411082726e31877628b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.755888 3065 tablet.cc:1724] T 83452ce6b5b3479b98ea312db05dc651 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:15.865481 919 raft_consensus.cc:2468] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:15.776558 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 3136118e1a5847f0a39fcb14bbc46a64 (DEFAULT_TABLE table=default.Table_4620c53896b8420b963ab245b2cbaccc [id=06fc10407770459c8a1bf03e8c3c3a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.774642 1031 tablet_service.cc:1511] Processing CreateTablet for tablet dea574d64d5f4a619bb1f3ffd53fe3f1 (DEFAULT_TABLE table=default.Table_99391b7e2a8246d8a5c13ab7e94001e0 [id=c3d8ee2b3fcf494c841aae2384e56e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.861304 1037 tablet_service.cc:1511] Processing CreateTablet for tablet a9a3817cb82644f2a3500d42d3adc39c (DEFAULT_TABLE table=default.Table_8f83f7609f9844b9bfdd44150af8b18a [id=5e2eedd32f2d44c08784c4b7972be699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.866523 996 leader_election.cc:304] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:15.867157 2996 raft_consensus.cc:2804] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:15.867327 2996 raft_consensus.cc:697] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:15.867679 2996 consensus_queue.cc:237] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.880973 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34206a3e10fe4c82bfc7666c8327d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.862867 1059 raft_consensus.cc:1217] T 26355bc6b5c147a88c14a9f053b4e1f3 P e78a44e2c8824fe7bce462e9d33f660c [term 2 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[2.1-2.1] Dedup: 2.1->[]
I20260619 19:54:15.822429 752 tablet_service.cc:1511] Processing CreateTablet for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 (DEFAULT_TABLE table=default.Table_c008f33c8ae74120a621a08954129d2a [id=732c6ab4beeb4783aaa145bab23c6d92]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:15.827015 720 consensus_peers.cc:597] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:15.887821 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 60840.7us
I20260619 19:54:15.831707 751 tablet_service.cc:1511] Processing CreateTablet for tablet a9a3817cb82644f2a3500d42d3adc39c (DEFAULT_TABLE table=default.Table_8f83f7609f9844b9bfdd44150af8b18a [id=5e2eedd32f2d44c08784c4b7972be699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.848656 754 tablet_service.cc:1511] Processing CreateTablet for tablet d6bf3909a44147049c854f574bc1ecbb (DEFAULT_TABLE table=default.Table_906aa3cdbfd5474989f1f99803b0751d [id=280448d3981e41f2a647493013bf2731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.851653 749 tablet_service.cc:1558] Processing DeleteTablet for tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.889173 749 tablet_service.cc:1511] Processing CreateTablet for tablet 837a69f9153c4bf8836804017c8bac40 (DEFAULT_TABLE table=default.Table_d436621459c84358a9670595540687ab [id=4eaf2375f47a43dd9ca3608c5d5de842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.851838 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f305a99e3481419196532cb5c62c2500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.851926 756 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.889883 756 tablet_service.cc:1511] Processing CreateTablet for tablet 12912f0b782f40f8aa614d05286cd157 (DEFAULT_TABLE table=default.Table_fa8fcf4efbb044c6882855c7eff0f4d9 [id=10c8498a5c83457bbef10a2bf3fd51d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.889894 758 tablet_service.cc:1511] Processing CreateTablet for tablet ea03e6d6e7a0411082726e31877628b0 (DEFAULT_TABLE table=default.Table_ac203b76f07042c79ac356c1c30c2156 [id=c6d53538763b4173b13e2e2ba4dc69c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.852008 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.890520 765 tablet_service.cc:1511] Processing CreateTablet for tablet fe7054f91f1c416d983239faefb7d017 (DEFAULT_TABLE table=default.Table_969ed8e28890403b8254ffb6146ad41a [id=2363e003fb4e4143b08125fc8d15a8f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.851953 747 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.852226 764 tablet_service.cc:1558] Processing DeleteTablet for tablet fb6bc52ee1fa4ac8967f937e59b4550c with delete_type TABLET_DATA_DELETED (replaced by tablet 0476b1447f984f548d06e71cdda6a875) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.852569 753 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca with delete_type TABLET_DATA_DELETED (replaced by tablet 910cf00e57404f1097800e84a2070b26) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:15.870167 2757 raft_consensus.cc:493] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:15.891173 2757 raft_consensus.cc:515] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:15.892012 2757 leader_election.cc:290] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:15.893429 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.894413 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12912f0b782f40f8aa614d05286cd157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.889736 1033 tablet_service.cc:1511] Processing CreateTablet for tablet fe7054f91f1c416d983239faefb7d017 (DEFAULT_TABLE table=default.Table_969ed8e28890403b8254ffb6146ad41a [id=2363e003fb4e4143b08125fc8d15a8f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.776249 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb901a33f434f6898d85d87f852f858 (DEFAULT_TABLE table=default.Table_47777facbac0455db73ae3e21ce363ea [id=13a54bc3bdb04d96afdbbc9daf0a6781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.897951 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7054f91f1c416d983239faefb7d017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.866401 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3136118e1a5847f0a39fcb14bbc46a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.898754 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea574d64d5f4a619bb1f3ffd53fe3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.899273 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea03e6d6e7a0411082726e31877628b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.901088 2953 raft_consensus.cc:493] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:15.901269 2953 raft_consensus.cc:515] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:15.903445 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb901a33f434f6898d85d87f852f858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.903726 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837a69f9153c4bf8836804017c8bac40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.904621 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a3817cb82644f2a3500d42d3adc39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.907294 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bf3909a44147049c854f574bc1ecbb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:15.911886 720 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: e6dcf87d57044279a218cbb21c383352
I20260619 19:54:15.876466 763 tablet_service.cc:1511] Processing CreateTablet for tablet 3136118e1a5847f0a39fcb14bbc46a64 (DEFAULT_TABLE table=default.Table_4620c53896b8420b963ab245b2cbaccc [id=06fc10407770459c8a1bf03e8c3c3a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.881652 757 tablet_service.cc:1511] Processing CreateTablet for tablet ec63a0062ba24760b0ebcb08b5fa2699 (DEFAULT_TABLE table=default.Table_4f89735ef1c44028bfb7e954222cd7ea [id=8c8a33ff85884939bc3d65a9def10649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.914141 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7054f91f1c416d983239faefb7d017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.914475 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63a0062ba24760b0ebcb08b5fa2699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.917205 1200 tablet_bootstrap.cc:492] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:15.919754 1200 ts_tablet_manager.cc:1403] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.390s user 0.004s sys 0.001s
I20260619 19:54:15.813947 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb901a33f434f6898d85d87f852f858 (DEFAULT_TABLE table=default.Table_47777facbac0455db73ae3e21ce363ea [id=13a54bc3bdb04d96afdbbc9daf0a6781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.924419 765 tablet_service.cc:1511] Processing CreateTablet for tablet d6fd3f8ae7ae4e509ee42463279be2b2 (DEFAULT_TABLE table=default.Table_e8fd08c12eb04674bc5cafd9bb81fca6 [id=9b9070af5388443da65ca3d02de8a1d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.920624 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 34206a3e10fe4c82bfc7666c8327d707 (DEFAULT_TABLE table=default.Table_633f3214b3e74337a37d4e0000d6e0c2 [id=a1dd5f5c01bb42ecb7a033f58ad13855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.921350 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 12912f0b782f40f8aa614d05286cd157 (DEFAULT_TABLE table=default.Table_fa8fcf4efbb044c6882855c7eff0f4d9 [id=10c8498a5c83457bbef10a2bf3fd51d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.922791 1023 tablet_service.cc:1511] Processing CreateTablet for tablet d6fd3f8ae7ae4e509ee42463279be2b2 (DEFAULT_TABLE table=default.Table_e8fd08c12eb04674bc5cafd9bb81fca6 [id=9b9070af5388443da65ca3d02de8a1d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.925608 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34206a3e10fe4c82bfc7666c8327d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.925796 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd3f8ae7ae4e509ee42463279be2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.922791 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 4b35985fed5949889ef6cd321ea38e7b (DEFAULT_TABLE table=default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.930667 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b35985fed5949889ef6cd321ea38e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.931303 756 tablet_service.cc:1511] Processing CreateTablet for tablet 4b35985fed5949889ef6cd321ea38e7b (DEFAULT_TABLE table=default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.931784 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12912f0b782f40f8aa614d05286cd157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.942178 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 267319f83f5440cb986952279320648f (DEFAULT_TABLE table=default.Table_54d709f23afb40979d6661097264021d [id=c746b2f4a50f461aaed225866dac8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.943032 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267319f83f5440cb986952279320648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.943567 758 tablet_service.cc:1511] Processing CreateTablet for tablet 267319f83f5440cb986952279320648f (DEFAULT_TABLE table=default.Table_54d709f23afb40979d6661097264021d [id=c746b2f4a50f461aaed225866dac8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.946382 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb1c6e2c00848539217ffb4c3f57231 (DEFAULT_TABLE table=default.Table_76a61e7b4ba448518ff8dc334fbffdbb [id=ce62d08f8f724adca51e441d46dc5de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.947926 2956 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: acquiring CA information for follower catalog manager: success
I20260619 19:54:15.952081 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb1c6e2c00848539217ffb4c3f57231 (DEFAULT_TABLE table=default.Table_76a61e7b4ba448518ff8dc334fbffdbb [id=ce62d08f8f724adca51e441d46dc5de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.953110 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a3817cb82644f2a3500d42d3adc39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.953877 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd3f8ae7ae4e509ee42463279be2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.954264 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b35985fed5949889ef6cd321ea38e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.957219 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb901a33f434f6898d85d87f852f858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.958360 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb1c6e2c00848539217ffb4c3f57231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.958791 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb1c6e2c00848539217ffb4c3f57231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.962879 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3136118e1a5847f0a39fcb14bbc46a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.963783 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4780d09f6e8b40728b0b4d4cb0982ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.964802 760 tablet_service.cc:1511] Processing CreateTablet for tablet 92ca1721fd3c4bcea2fa43780a570dc7 (DEFAULT_TABLE table=default.Table_5df77d322daf403ba382436b5192ca95 [id=f09db531def54719949b02965ec0c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.977994 903 tablet_service.cc:1511] Processing CreateTablet for tablet b4ef64f800ac4d4e81ab6ff213b6838f (DEFAULT_TABLE table=default.Table_6cc0e4d20ac744bbb5c762479e4e1f47 [id=5721cb48d4ba48c28a950e92121f965c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.978734 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ef64f800ac4d4e81ab6ff213b6838f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.979341 3047 raft_consensus.cc:2749] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:15.979871 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 270038us
I20260619 19:54:15.986737 754 tablet_service.cc:1511] Processing CreateTablet for tablet c34d1212487348ceae8c58e5c09740cc (DEFAULT_TABLE table=default.Table_97b547a957704426af6c457046bbcf5d [id=ef1b52a9b1fd4b30b10d68ac9e881abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.972173 1023 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec79ccfa8054a4bab2641d42c25b81b (DEFAULT_TABLE table=default.Table_dce56a19d6f24028956f0904bad88cd5 [id=d9e476d02b9f43d18edb3b857aff0d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.002964 1023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec79ccfa8054a4bab2641d42c25b81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.005550 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:16.009928 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d7d3ab2751649f4b9fe54b88bb1eca2 consensus state has no leader
I20260619 19:54:15.978775 1039 tablet_service.cc:1511] Processing CreateTablet for tablet c34d1212487348ceae8c58e5c09740cc (DEFAULT_TABLE table=default.Table_97b547a957704426af6c457046bbcf5d [id=ef1b52a9b1fd4b30b10d68ac9e881abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.010874 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34d1212487348ceae8c58e5c09740cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.015599 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1261a735922542a1a6c149986f236c1a
I20260619 19:54:16.019896 2953 leader_election.cc:290] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:16.022740 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15b81edd27d14611b3a66c547117c532 consensus state has no leader
W20260619 19:54:16.023067 858 consensus_peers.cc:597] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:16.023376 858 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 983faf8557814093bc427291711f3fce
I20260619 19:54:16.023599 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet 1261a735922542a1a6c149986f236c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:15.979625 1200 raft_consensus.cc:359] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.024312 1200 raft_consensus.cc:385] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:16.024422 1200 raft_consensus.cc:740] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:16.024710 1200 consensus_queue.cc:260] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.025696 1200 ts_tablet_manager.cc:1434] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.103s user 0.002s sys 0.000s
I20260619 19:54:16.026029 1200 tablet_bootstrap.cc:492] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:16.027679 1200 tablet_bootstrap.cc:654] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:15.997148 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 1d776f839c3347bd8a357acc2ac8ed4a (DEFAULT_TABLE table=default.Table_66ad26c218e448178939af5aded44176 [id=4375ba0b8f5d463ebb1cad02e2de12e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:15.782860 1994 ts_tablet_manager.cc:1929] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260619 19:54:16.000386 996 consensus_peers.cc:597] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.037299 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d776f839c3347bd8a357acc2ac8ed4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:15.979261 749 tablet_service.cc:1511] Processing CreateTablet for tablet 1d776f839c3347bd8a357acc2ac8ed4a (DEFAULT_TABLE table=default.Table_66ad26c218e448178939af5aded44176 [id=4375ba0b8f5d463ebb1cad02e2de12e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.040961 891 tablet_service.cc:1511] Processing CreateTablet for tablet ec8ede6902b041a99e737b487f94a5f2 (DEFAULT_TABLE table=default.Table_eb8e60da5ccb4beaac79c304b660a4ae [id=63a0edc738904b35b70d6cb002b29c78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.041445 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8ede6902b041a99e737b487f94a5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.041749 1994 log.cc:1199] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:54:16.042524 1994 ts_tablet_manager.cc:1950] T 5fb6712fc0994154aa5022ec16cec1ae P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:16.044348 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 600) took 1788 ms. Trace:
I20260619 19:54:16.044564 1994 rpcz_store.cc:276] 0619 19:54:14.255843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.255916 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:15.686050 (+1430134us) ts_tablet_manager.cc:1151] Deleting tablet 5fb6712fc0994154aa5022ec16cec1ae
0619 19:54:15.711463 (+ 25413us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.780103 (+ 68640us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:15.782813 (+ 2710us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.044322 (+261509us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1429867}
I20260619 19:54:16.045490 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 601) took 1747 ms. Trace:
I20260619 19:54:16.045652 1994 rpcz_store.cc:276] 0619 19:54:14.297627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.324758 (+ 27131us) service_pool.cc:224] Handling call
0619 19:54:16.045362 (+1720604us) ts_tablet_manager.cc:1151] Deleting tablet c47b97e1eeed4f20bfe001fa48dc0471
0619 19:54:16.045372 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.045474 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720373}
I20260619 19:54:16.046214 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 603) took 1695 ms. Trace:
I20260619 19:54:16.047159 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]) successfully deleted
W20260619 19:54:16.047539 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c47b97e1eeed4f20bfe001fa48dc0471 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c47b97e1eeed4f20bfe001fa48dc0471 already in progress: creating tablet
I20260619 19:54:16.046344 1994 rpcz_store.cc:276] 0619 19:54:14.350292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.350356 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:16.046097 (+1695741us) ts_tablet_manager.cc:1151] Deleting tablet 8fd9525ba72d45b089442a6e6a73cc74
0619 19:54:16.046106 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.046198 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1695554}
I20260619 19:54:16.049242 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 602) took 1702 ms. Trace:
I20260619 19:54:16.049527 1994 rpcz_store.cc:276] 0619 19:54:14.346580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.353052 (+ 6472us) service_pool.cc:224] Handling call
0619 19:54:16.049126 (+1696074us) ts_tablet_manager.cc:1151] Deleting tablet 988e0a8b1b5b4f7cb68674af923454cf
0619 19:54:16.049136 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.049225 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1695853}
I20260619 19:54:16.050170 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 604) took 1692 ms. Trace:
W20260619 19:54:16.050241 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8fd9525ba72d45b089442a6e6a73cc74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fd9525ba72d45b089442a6e6a73cc74 already in progress: creating tablet
I20260619 19:54:16.050305 1994 rpcz_store.cc:276] 0619 19:54:14.358063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.358569 (+ 506us) service_pool.cc:224] Handling call
0619 19:54:16.050065 (+1691496us) ts_tablet_manager.cc:1151] Deleting tablet e84dba59116149e5aeb65d79a4d2e5fc
0619 19:54:16.050074 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.050156 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1691265}
W20260619 19:54:16.050530 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 988e0a8b1b5b4f7cb68674af923454cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 988e0a8b1b5b4f7cb68674af923454cf already in progress: creating tablet
I20260619 19:54:16.050707 1994 tablet_replica.cc:333] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:16.050932 1994 raft_consensus.cc:2243] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:16.050997 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e84dba59116149e5aeb65d79a4d2e5fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e84dba59116149e5aeb65d79a4d2e5fc already in progress: creating tablet
I20260619 19:54:16.051764 1994 raft_consensus.cc:2272] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.052410 1994 ts_tablet_manager.cc:1916] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:16.053647 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2418879ae8fc4eadb945b509d8234ae2" } new_table_name: "default.Table_246afc7a4df84db6831cb1c61e31ca7d" modify_external_catalogs: true
I20260619 19:54:16.055372 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_60d77a600a084c169d2df6057f58806c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.056003 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60d77a600a084c169d2df6057f58806c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.057478 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f2841116a1194e7b970b38e4beabd0c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.058070 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2841116a1194e7b970b38e4beabd0c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.059424 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_54c93ff3c68a4245bf89e0de176cb1fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.060237 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54c93ff3c68a4245bf89e0de176cb1fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.061584 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_06f356714778440cbb5c03887dbb5727" } modify_external_catalogs: true
I20260619 19:54:16.061790 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_06f356714778440cbb5c03887dbb5727" } modify_external_catalogs: true
I20260619 19:54:16.062120 900 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0e1e116f7d49f78d5f651070ae0974 (DEFAULT_TABLE table=default.Table_ecc39f19974445339140abe391370170 [id=b361d2c5666844848a992a190cad33a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.062649 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0e1e116f7d49f78d5f651070ae0974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.064477 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8882bd0a559b4556aef7a3175c2707fd" } modify_external_catalogs: true
I20260619 19:54:16.066884 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8882bd0a559b4556aef7a3175c2707fd" } modify_external_catalogs: true
I20260619 19:54:16.067340 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5b2e48a604b14d41b144c467b1738da5" } modify_external_catalogs: true
I20260619 19:54:16.068864 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5b2e48a604b14d41b144c467b1738da5" } modify_external_catalogs: true
I20260619 19:54:16.069406 2996 raft_consensus.cc:493] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:16.069563 2996 raft_consensus.cc:515] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.071182 2996 leader_election.cc:290] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:16.072233 859 consensus_peers.cc:597] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74f39941c13847d79e2b2c3ddd176533. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:16.072990 859 consensus_peers.cc:597] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88c9073ef30d456d8dc8609ddf1335ce. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.073669 859 leader_election.cc:304] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.073711 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4b40caf0c68a4611900cb6b9df5e3e68" } modify_external_catalogs: true
I20260619 19:54:16.073982 2953 raft_consensus.cc:2749] T e7a19f43793b4440b7a9d2652a75e6bd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.074422 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4b40caf0c68a4611900cb6b9df5e3e68" } modify_external_catalogs: true
I20260619 19:54:16.075933 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77de42bb514452a8dc6a4a71289dc59" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:16.066480 524 catalog_manager.cc:5696] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:16.076224 2953 raft_consensus.cc:493] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:16.076362 2953 raft_consensus.cc:515] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.076424 524 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9911df524f8948ea8ecce55df0fdd0d6 (table default.Table_3f5d1b351c6045268f3010117cd2a78c [id=1150e278fd3646d9b0897243ff2524d4]). Expected version 1 got 0
I20260619 19:54:16.077010 2953 leader_election.cc:290] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:16.077590 996 leader_election.cc:343] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:16.080956 899 tablet_service.cc:1511] Processing CreateTablet for tablet c52eaeef941140ecb8d1045c88c7231b (DEFAULT_TABLE table=default.Table_4647d0fd20864186920dcfb257dfc867 [id=0ccd76f8e1614b5eb9526063daf54e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.081634 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52eaeef941140ecb8d1045c88c7231b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.018502 2757 raft_consensus.cc:493] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:16.086354 2757 raft_consensus.cc:515] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.038125 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 1261a735922542a1a6c149986f236c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:16.039192 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec79ccfa8054a4bab2641d42c25b81b (DEFAULT_TABLE table=default.Table_dce56a19d6f24028956f0904bad88cd5 [id=d9e476d02b9f43d18edb3b857aff0d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.070834 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77de42bb514452a8dc6a4a71289dc59" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:16.088029 996 leader_election.cc:343] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:16.088169 996 leader_election.cc:304] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:16.088438 2996 raft_consensus.cc:2749] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:16.088774 859 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 983faf8557814093bc427291711f3fce
I20260619 19:54:16.091240 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 904dd2aac07347a5979f6607bbe5665f with delete_type TABLET_DATA_DELETED (replaced by tablet 73fa6438bb734872a22cf1e8aa80470e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.091710 890 tablet_service.cc:1511] Processing CreateTablet for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 (DEFAULT_TABLE table=default.Table_c008f33c8ae74120a621a08954129d2a [id=732c6ab4beeb4783aaa145bab23c6d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.093843 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.093945 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ecd267aa34469cad9db0745178013b with delete_type TABLET_DATA_DELETED (replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.093979 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb6bc52ee1fa4ac8967f937e59b4550c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:16.094179 917 raft_consensus.cc:2393] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:16.094307 889 tablet_service.cc:1511] Processing CreateTablet for tablet fe7054f91f1c416d983239faefb7d017 (DEFAULT_TABLE table=default.Table_969ed8e28890403b8254ffb6146ad41a [id=2363e003fb4e4143b08125fc8d15a8f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.094808 887 tablet_service.cc:1511] Processing CreateTablet for tablet a9a3817cb82644f2a3500d42d3adc39c (DEFAULT_TABLE table=default.Table_8f83f7609f9844b9bfdd44150af8b18a [id=5e2eedd32f2d44c08784c4b7972be699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.095279 1994 ts_tablet_manager.cc:1929] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:16.095387 1994 log.cc:1199] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/ca6d7f30c5a84106bebebc42eedee654
I20260619 19:54:16.095731 1994 ts_tablet_manager.cc:1950] T ca6d7f30c5a84106bebebc42eedee654 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:16.096030 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:16.096264 913 raft_consensus.cc:2393] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:16.098435 886 tablet_service.cc:1511] Processing CreateTablet for tablet d6bf3909a44147049c854f574bc1ecbb (DEFAULT_TABLE table=default.Table_906aa3cdbfd5474989f1f99803b0751d [id=280448d3981e41f2a647493013bf2731]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.098604 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7054f91f1c416d983239faefb7d017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.099809 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a3817cb82644f2a3500d42d3adc39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.093809 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6dcc6a33ac96439d9409ec194b40ab5f (DEFAULT_TABLE table=default.Table_4310c3d1b2cf4ad0841fee7480e05bf5 [id=af86bb18a53b4533a6d11a8f62c4413f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.100878 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dcc6a33ac96439d9409ec194b40ab5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.101263 923 raft_consensus.cc:1275] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Refusing update from remote peer b1f5f240547f42ec82f57e6c8af5ea89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260619 19:54:16.101951 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0476b1447f984f548d06e71cdda6a875 consensus state has no leader
I20260619 19:54:16.104023 1994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33622 (request call id 606) took 1564 ms. Trace:
I20260619 19:54:16.104136 1994 rpcz_store.cc:276] 0619 19:54:14.539540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.539595 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:16.050657 (+1511062us) ts_tablet_manager.cc:1151] Deleting tablet ca6d7f30c5a84106bebebc42eedee654
0619 19:54:16.050669 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.058310 (+ 7641us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.095217 (+ 36907us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.103988 (+ 8771us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407798}
I20260619 19:54:16.104725 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet ca6d7f30c5a84106bebebc42eedee654 (table default.Table_247be2054e924a3885a4822bb5c4c2d3 [id=cb0dfc15d9414ae3b63638e94c05c0a5]) successfully deleted
W20260619 19:54:16.107322 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 73029f4bc97349da9d5d2fae4321cd5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73029f4bc97349da9d5d2fae4321cd5f already in progress: creating tablet
I20260619 19:54:16.107465 1994 tablet_replica.cc:333] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:16.107789 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 9c977ca621224d7ab73a9e9f39540c86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c977ca621224d7ab73a9e9f39540c86 already in progress: creating tablet
W20260619 19:54:16.108043 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a977e889c36b434388fc7a3a5cd42e8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a977e889c36b434388fc7a3a5cd42e8c already in progress: creating tablet
I20260619 19:54:16.108361 1994 raft_consensus.cc:2243] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:16.114956 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a3aea512fc0e4621ae8d112053e1e4b8" } new_table_name: "default.Table_c273513e138d49f4a69189b55f41c410" modify_external_catalogs: true
I20260619 19:54:16.110602 1994 raft_consensus.cc:2272] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.115700 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 365c0bb1e9ac480e96e7f4d604048663 (table default.Table_280eef239dc74f4fb396427d2ca18a6f [id=c03d7a64db6041eab96f911cc605a472]) successfully deleted
I20260619 19:54:16.116142 1994 ts_tablet_manager.cc:1916] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:16.116873 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8e63481f54594e328268b598ebc19996"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.117816 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e63481f54594e328268b598ebc19996 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.118407 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3136118e1a5847f0a39fcb14bbc46a64 (DEFAULT_TABLE table=default.Table_4620c53896b8420b963ab245b2cbaccc [id=06fc10407770459c8a1bf03e8c3c3a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.118999 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3136118e1a5847f0a39fcb14bbc46a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.121974 888 tablet_service.cc:1511] Processing CreateTablet for tablet dea574d64d5f4a619bb1f3ffd53fe3f1 (DEFAULT_TABLE table=default.Table_99391b7e2a8246d8a5c13ab7e94001e0 [id=c3d8ee2b3fcf494c841aae2384e56e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.122547 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea574d64d5f4a619bb1f3ffd53fe3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.123605 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb901a33f434f6898d85d87f852f858 (DEFAULT_TABLE table=default.Table_47777facbac0455db73ae3e21ce363ea [id=13a54bc3bdb04d96afdbbc9daf0a6781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.124136 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb901a33f434f6898d85d87f852f858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.129381 884 tablet_service.cc:1511] Processing CreateTablet for tablet 92ca1721fd3c4bcea2fa43780a570dc7 (DEFAULT_TABLE table=default.Table_5df77d322daf403ba382436b5192ca95 [id=f09db531def54719949b02965ec0c7c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.129997 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ca1721fd3c4bcea2fa43780a570dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.137122 2953 raft_consensus.cc:493] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:16.137372 2953 raft_consensus.cc:515] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.138203 2953 leader_election.cc:290] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:16.139019 3048 raft_consensus.cc:493] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:16.139196 3048 raft_consensus.cc:515] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:16.139823 3048 leader_election.cc:290] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:16.143841 895 tablet_service.cc:1511] Processing CreateTablet for tablet 34206a3e10fe4c82bfc7666c8327d707 (DEFAULT_TABLE table=default.Table_633f3214b3e74337a37d4e0000d6e0c2 [id=a1dd5f5c01bb42ecb7a033f58ad13855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.144616 1200 tablet_bootstrap.cc:492] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:16.144814 1200 ts_tablet_manager.cc:1403] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.119s user 0.002s sys 0.000s
I20260619 19:54:16.145193 901 tablet_service.cc:1511] Processing CreateTablet for tablet ec63a0062ba24760b0ebcb08b5fa2699 (DEFAULT_TABLE table=default.Table_4f89735ef1c44028bfb7e954222cd7ea [id=8c8a33ff85884939bc3d65a9def10649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.145866 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63a0062ba24760b0ebcb08b5fa2699. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.146585 1200 raft_consensus.cc:359] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.146904 1200 raft_consensus.cc:385] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:16.146999 1200 raft_consensus.cc:740] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:16.150599 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6bf3909a44147049c854f574bc1ecbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.151470 1200 consensus_queue.cc:260] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.154031 2757 leader_election.cc:290] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:16.154522 2757 raft_consensus.cc:493] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:16.154667 2757 raft_consensus.cc:515] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.154749 896 tablet_service.cc:1511] Processing CreateTablet for tablet a2c5a1bc7b4243f19d08a27249e23a52 (DEFAULT_TABLE table=default.Table_19bc418b3c714dd09369d232f417db60 [id=bee345f6db96404cb9edfd320cb757b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.154950 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ca1721fd3c4bcea2fa43780a570dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.155341 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c5a1bc7b4243f19d08a27249e23a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.155711 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34d1212487348ceae8c58e5c09740cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.168862 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267319f83f5440cb986952279320648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.180959 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34206a3e10fe4c82bfc7666c8327d707. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:16.181907 720 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b2902c7f67a1402987315ee426ddf1d2
I20260619 19:54:16.185657 2757 leader_election.cc:290] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:16.187323 720 leader_election.cc:343] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:16.190274 891 tablet_service.cc:1511] Processing CreateTablet for tablet ea03e6d6e7a0411082726e31877628b0 (DEFAULT_TABLE table=default.Table_ac203b76f07042c79ac356c1c30c2156 [id=c6d53538763b4173b13e2e2ba4dc69c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.193320 1994 ts_tablet_manager.cc:1929] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:16.194172 885 tablet_service.cc:1511] Processing CreateTablet for tablet 267319f83f5440cb986952279320648f (DEFAULT_TABLE table=default.Table_54d709f23afb40979d6661097264021d [id=c746b2f4a50f461aaed225866dac8ac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.194651 2956 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2d38b77ff37948e19592b36b6d884fe0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 19:54:16.195454 1994 log.cc:1199] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/801f08f4daa842238460506ccd0c466f
I20260619 19:54:16.196096 1994 ts_tablet_manager.cc:1950] T 801f08f4daa842238460506ccd0c466f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:16.190274 903 tablet_service.cc:1511] Processing CreateTablet for tablet 12912f0b782f40f8aa614d05286cd157 (DEFAULT_TABLE table=default.Table_fa8fcf4efbb044c6882855c7eff0f4d9 [id=10c8498a5c83457bbef10a2bf3fd51d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.199506 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 28a09107b11d480dba8c456fc8753ad1 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:16.199944 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]) successfully deleted
I20260619 19:54:16.203776 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3f5d1b351c6045268f3010117cd2a78c" } new_table_name: "default.Table_02e64fc0947b45c6a2eb8c87da0582d3" modify_external_catalogs: true
I20260619 19:54:16.149884 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dcf87d57044279a218cbb21c383352" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:16.205344 914 raft_consensus.cc:2468] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:16.089210 859 leader_election.cc:304] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.205622 2953 raft_consensus.cc:2749] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:16.205900 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 117130us
W20260619 19:54:16.206563 859 leader_election.cc:343] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:16.207209 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet dc5235127fb54d3dba90c9f9f8c134b4
W20260619 19:54:16.209399 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d1d23b9d751c48ad858a35771b0ded61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1d23b9d751c48ad858a35771b0ded61 already in progress: creating tablet
I20260619 19:54:16.209434 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet dc5235127fb54d3dba90c9f9f8c134b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:16.209807 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ed116f9d309a45dfa9fb175247502448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed116f9d309a45dfa9fb175247502448 already in progress: creating tablet
I20260619 19:54:16.210067 1994 tablet_replica.cc:333] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:16.210146 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f6ce69e12fd643ea88c26d941424c2ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6ce69e12fd643ea88c26d941424c2ab already in progress: creating tablet
I20260619 19:54:16.210523 1994 raft_consensus.cc:2243] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:16.210440 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d2939b8aa0d44ad2a05a933db4ea64be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2939b8aa0d44ad2a05a933db4ea64be already in progress: creating tablet
W20260619 19:54:16.210867 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 904dd2aac07347a5979f6607bbe5665f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 904dd2aac07347a5979f6607bbe5665f already in progress: creating tablet
W20260619 19:54:16.211191 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 32ecd267aa34469cad9db0745178013b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32ecd267aa34469cad9db0745178013b already in progress: creating tablet
I20260619 19:54:16.213207 1994 raft_consensus.cc:2272] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.214036 1994 ts_tablet_manager.cc:1916] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:16.215596 2996 consensus_queue.cc:1048] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:16.216440 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c85407a4d392498290eae64df5f85edf
I20260619 19:54:16.217558 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea03e6d6e7a0411082726e31877628b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.218580 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c85407a4d392498290eae64df5f85edf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.219017 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267319f83f5440cb986952279320648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.221634 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c322c38aae114a428f64a476a2ae9b5f
I20260619 19:54:16.224545 2996 raft_consensus.cc:493] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:16.224730 2996 raft_consensus.cc:515] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:16.225829 859 consensus_peers.cc:597] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba0cd4cd0661415d8b2b2339363e7aca. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.226261 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841d03189e84deaa036f235946e877a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:16.226569 859 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: e6dcf87d57044279a218cbb21c383352
W20260619 19:54:16.226884 859 leader_election.cc:343] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 991c877feeae43c580d9471c25c4424c
W20260619 19:54:16.226868 996 leader_election.cc:343] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:16.227015 2996 leader_election.cc:290] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:16.229590 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d776f839c3347bd8a357acc2ac8ed4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.229913 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec79ccfa8054a4bab2641d42c25b81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.230571 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_42b8fb62dbca4677a979f1e290505350"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.231351 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42b8fb62dbca4677a979f1e290505350 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.232661 3065 tablet.cc:1724] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:16.233023 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c19cfd75d3aa41fdb8d781b26abca8d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:16.234437 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c322c38aae114a428f64a476a2ae9b5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:16.227125 859 consensus_peers.cc:597] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05c9a91f95bb4bcdafe493bab8c393b4. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.230016 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12912f0b782f40f8aa614d05286cd157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.248898 1200 ts_tablet_manager.cc:1434] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.104s user 0.005s sys 0.000s
I20260619 19:54:16.252791 1200 tablet_bootstrap.cc:492] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:16.254323 1200 tablet_bootstrap.cc:654] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:16.268524 1994 ts_tablet_manager.cc:1929] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:16.268808 1994 log.cc:1199] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d703c5c2820642aab6dd1e500ce1e9fd
I20260619 19:54:16.269281 1994 ts_tablet_manager.cc:1950] T d703c5c2820642aab6dd1e500ce1e9fd P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:16.272503 859 consensus_peers.cc:597] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcaeebaaa93c479bafff14d312d526ec. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:16.274622 1994 tablet_replica.cc:333] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:16.274886 1994 raft_consensus.cc:2243] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:16.275101 1994 raft_consensus.cc:2272] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.279911 1994 ts_tablet_manager.cc:1916] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:16.280652 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 175807us
I20260619 19:54:16.288002 776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:16.288235 776 raft_consensus.cc:2468] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:16.288251 778 raft_consensus.cc:1275] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260619 19:54:16.289145 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dcf87d57044279a218cbb21c383352" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:16.289319 778 raft_consensus.cc:2468] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:16.292279 719 leader_election.cc:304] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.292567 3082 raft_consensus.cc:3060] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:16.294902 1973 ts_tablet_manager.cc:1929] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:16.295289 1973 log.cc:1199] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/8bc11c632b514118856ea4c11b431142
I20260619 19:54:16.297160 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7a0a87856cb047c79adf3896f5edd0ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:16.298158 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dc77ad8e7c564a6d844b4947a687fde0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.306730 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc77ad8e7c564a6d844b4947a687fde0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.295461 3082 raft_consensus.cc:2749] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:16.309623 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c19cfd75d3aa41fdb8d781b26abca8d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.310045 751 tablet_service.cc:1558] Processing DeleteTablet for tablet dc5235127fb54d3dba90c9f9f8c134b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:16.310731 1994 ts_tablet_manager.cc:1929] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:16.310892 1994 log.cc:1199] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/dc5235127fb54d3dba90c9f9f8c134b4
I20260619 19:54:16.312858 1973 ts_tablet_manager.cc:1950] T 8bc11c632b514118856ea4c11b431142 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:16.313374 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 483) took 5697 ms. Trace:
I20260619 19:54:16.313542 1973 rpcz_store.cc:276] 0619 19:54:10.615730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.615775 (+ 45us) service_pool.cc:224] Handling call
0619 19:54:15.489611 (+4873836us) ts_tablet_manager.cc:1151] Deleting tablet 8bc11c632b514118856ea4c11b431142
0619 19:54:15.489622 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:15.928037 (+438415us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.294818 (+366781us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.313353 (+ 18535us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4873680}
W20260619 19:54:16.314110 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a0a87856cb047c79adf3896f5edd0ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.314150 1994 ts_tablet_manager.cc:1950] T dc5235127fb54d3dba90c9f9f8c134b4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:16.297576 719 leader_election.cc:343] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: eb4b1e87f2e84bcaaa07ff9f687b9e3d
I20260619 19:54:16.315320 719 leader_election.cc:304] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.316363 3082 raft_consensus.cc:2749] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.316836 719 leader_election.cc:304] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.319020 3082 raft_consensus.cc:3060] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:16.319887 1200 tablet_bootstrap.cc:492] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:16.321666 2847 mvcc.cc:204] Tried to move back new op lower bound from 7298657670887989248 to 7298657629823053824. Current Snapshot: MvccSnapshot[applied={T|T < 7298657670887989248 or (T in {7298657670887989248})}]
I20260619 19:54:16.322521 2941 consensus_queue.cc:1048] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260619 19:54:16.323650 1200 ts_tablet_manager.cc:1403] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.000s
I20260619 19:54:16.324626 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_19a8a86fcf0842b998d5a19f7d199f35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:16.325433 719 leader_election.cc:304] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.327013 2941 raft_consensus.cc:2804] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:16.327082 2941 raft_consensus.cc:493] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260619 19:54:16.329226 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19a8a86fcf0842b998d5a19f7d199f35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:16.329339 1208 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.646s user 0.042s sys 0.097s
I20260619 19:54:16.329671 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:16.329896 919 raft_consensus.cc:2393] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:16.330305 858 leader_election.cc:304] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.330538 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d703c5c2820642aab6dd1e500ce1e9fd (table default.Table_7babf9e56d174c6abc66c591fff1eace [id=3000203e95cc423cb4ab88f7c33f76c8]) successfully deleted
I20260619 19:54:16.331039 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 8bc11c632b514118856ea4c11b431142 (table default.Table_7a804e38bb484833a00aecd12f4ad7e0 [id=814802093a404dadb94baac5b9037087]) successfully deleted
W20260619 19:54:16.331327 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 88c9073ef30d456d8dc8609ddf1335ce because the tablet was not found. No further retry: Not found: Tablet not found: 88c9073ef30d456d8dc8609ddf1335ce
W20260619 19:54:16.332103 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 710fae36dd674b1786aa75013284684e because the tablet was not found. No further retry: Not found: Tablet not found: 710fae36dd674b1786aa75013284684e
I20260619 19:54:16.335677 525 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_b8d9dd9528624489b3bef8c57d2df87f [id=b0c20277b82e48e096fc0ea8d3053c55] alter complete (version 2)
I20260619 19:54:16.336548 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 8c10ee4d02fa48fdb10e3e5110f85cad from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:16.337141 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_76a9d0b007c44fccb350af13ab0b2092" } new_table_name: "default.Table_cb61a4cd0fb34e5fac83fbb8e82629a6" modify_external_catalogs: true
W20260619 19:54:16.332397 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1261a735922542a1a6c149986f236c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1261a735922542a1a6c149986f236c1a already in progress: creating tablet
I20260619 19:54:16.341585 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet dc5235127fb54d3dba90c9f9f8c134b4 (table default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703]) successfully deleted
W20260619 19:54:16.341892 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c85407a4d392498290eae64df5f85edf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c85407a4d392498290eae64df5f85edf already in progress: creating tablet
W20260619 19:54:16.342252 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c322c38aae114a428f64a476a2ae9b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c322c38aae114a428f64a476a2ae9b5f already in progress: creating tablet
I20260619 19:54:16.345326 2953 raft_consensus.cc:2804] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:16.345460 2953 raft_consensus.cc:493] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:16.345546 2953 raft_consensus.cc:3060] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:16.337698 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:16.351157 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e80cab5977d47aeba48ad866fdf975a" } modify_external_catalogs: true
I20260619 19:54:16.351385 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5e80cab5977d47aeba48ad866fdf975a" } modify_external_catalogs: true
I20260619 19:54:16.356549 2539 consensus_queue.cc:1048] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260619 19:54:16.357645 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c09597d5c21c43feba411b6bb62c2a70" } new_table_name: "default.Table_063722268d314b36997cd6b451eae90d" modify_external_catalogs: true
I20260619 19:54:16.357959 858 leader_election.cc:304] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.358640 3048 raft_consensus.cc:2804] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:16.358708 3048 raft_consensus.cc:493] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:16.358758 3048 raft_consensus.cc:3060] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:16.359313 858 leader_election.cc:343] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 991c877feeae43c580d9471c25c4424c
I20260619 19:54:16.360450 858 leader_election.cc:304] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.363561 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8c17003f48694476bc969f54bde35f6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:16.326689 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c322c38aae114a428f64a476a2ae9b5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:16.363966 1208 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.681s user 0.042s sys 0.097s
I20260619 19:54:16.364190 1973 tablet_replica.cc:333] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:16.364220 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c17003f48694476bc969f54bde35f6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.364370 1973 raft_consensus.cc:2243] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:16.364748 1973 raft_consensus.cc:2272] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.365888 1973 ts_tablet_manager.cc:1916] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:16.368745 3082 raft_consensus.cc:2749] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.369072 2996 raft_consensus.cc:493] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:16.369221 2996 raft_consensus.cc:515] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.369951 2996 leader_election.cc:290] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:16.370553 1201 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.577s user 0.002s sys 0.027s
W20260619 19:54:16.370687 1201 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.577s user 0.002s sys 0.027s
I20260619 19:54:16.370743 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54231986cca44258942dbc3373870b2" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:16.371309 996 leader_election.cc:343] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:16.327158 2941 raft_consensus.cc:3060] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:16.373205 1201 tablet_bootstrap.cc:492] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:16.373431 1201 ts_tablet_manager.cc:1403] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 1.024s user 0.002s sys 0.031s
I20260619 19:54:16.376353 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_aca707b5ab0b4a5aa81637909810fae3" } new_table_name: "default.Table_90f44db33056470a9a5f6623abe6f491" modify_external_catalogs: true
I20260619 19:54:16.377274 719 leader_election.cc:304] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.380434 2539 raft_consensus.cc:2749] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:16.380987 2539 consensus_queue.cc:1048] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:16.381213 755 tablet_service.cc:1558] Processing DeleteTablet for tablet c85407a4d392498290eae64df5f85edf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:16.382396 2539 consensus_queue.cc:1048] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:16.382720 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 798c54ef8cde4020903153f72d6e3b1a consensus state has no leader
I20260619 19:54:16.383033 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 79bcc998cf6c4d3e851a437ccd2edb92 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:16.379696 2941 raft_consensus.cc:515] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.386927 3082 raft_consensus.cc:3060] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:16.387702 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 54851.3us
W20260619 19:54:16.391199 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8bc6173a84f4a5091c9f865cd0037fb has no consensus state
I20260619 19:54:16.391659 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0bdd74281c9e4f359f9e8ee4ffa72755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.393033 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bdd74281c9e4f359f9e8ee4ffa72755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.394438 2026 ts_tablet_manager.cc:1929] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:16.394361 2941 leader_election.cc:290] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:16.398919 1208 tablet_bootstrap.cc:492] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:16.399081 1208 ts_tablet_manager.cc:1403] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.719s user 0.042s sys 0.097s
I20260619 19:54:16.403054 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841d03189e84deaa036f235946e877a" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:16.413331 996 leader_election.cc:343] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:16.413592 996 leader_election.cc:304] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:16.414300 2996 raft_consensus.cc:2749] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.407384 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dcf87d57044279a218cbb21c383352" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:16.411741 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a54231986cca44258942dbc3373870b2" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:16.422821 720 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: e6dcf87d57044279a218cbb21c383352
W20260619 19:54:16.423441 996 leader_election.cc:343] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:16.423607 996 leader_election.cc:304] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:16.424526 2996 raft_consensus.cc:2749] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.426347 1200 raft_consensus.cc:359] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.431387 1200 raft_consensus.cc:385] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:16.431770 1200 raft_consensus.cc:740] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:16.443403 528 catalog_manager.cc:5696] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:16.443945 528 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:16.444216 528 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9911df524f8948ea8ecce55df0fdd0d6 (table default.Table_3f5d1b351c6045268f3010117cd2a78c [id=1150e278fd3646d9b0897243ff2524d4]). Expected version 1 got 0
I20260619 19:54:16.444932 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8614b0ab1a3749a1a0aa441574f79ab1
I20260619 19:54:16.460626 923 raft_consensus.cc:1275] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Refusing update from remote peer e78a44e2c8824fe7bce462e9d33f660c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:54:16.459913 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb1c6e2c00848539217ffb4c3f57231 (DEFAULT_TABLE table=default.Table_76a61e7b4ba448518ff8dc334fbffdbb [id=ce62d08f8f724adca51e441d46dc5de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.456291 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 2c512a30b4fa48fb89bc1ea968ad6536 (DEFAULT_TABLE table=default.Table_1af8c578eef1461093d09e3c7c8724d1 [id=7e9e2d1b8b6d4116a108ffac5a3511d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.469257 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c512a30b4fa48fb89bc1ea968ad6536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.469112 1200 consensus_queue.cc:260] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.470068 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7786a591827046899d2a6dcb0024ea06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.470660 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7786a591827046899d2a6dcb0024ea06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.472151 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0c7c9744697942fab3cbfc5fb0ea59ec" } modify_external_catalogs: true
I20260619 19:54:16.472326 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0c7c9744697942fab3cbfc5fb0ea59ec" } modify_external_catalogs: true
I20260619 19:54:16.473562 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e69c58bd08a44109a5918cbb26e3c33e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.474105 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e69c58bd08a44109a5918cbb26e3c33e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.456511 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet a54231986cca44258942dbc3373870b2 with delete_type TABLET_DATA_DELETED (replaced by tablet d6bc861cb7d941f380671105fd338538) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.456736 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 437cebe83301488d9cd7d1b9a1ebef15 (DEFAULT_TABLE table=default.Table_cc7858b6eabf4a87957b2964dd1cfde4 [id=074ebc0b2ae44a90ac1e81311018e976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.456902 1031 tablet_service.cc:1511] Processing CreateTablet for tablet f81d5bad8efe4c6b9b13f4d8fdc664cb (DEFAULT_TABLE table=default.Table_227f6683e0654c1a8d6b3993255ae331 [id=8e51cc51a9564081b445288138159402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.475541 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437cebe83301488d9cd7d1b9a1ebef15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.475688 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81d5bad8efe4c6b9b13f4d8fdc664cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.456736 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa7699279c2462dbb396d260723693a (DEFAULT_TABLE table=default.Table_b6487d191e234b36b6b524ee98f4a71e [id=40aafbe8f30d4a0aac7ac20fd5fb36e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.479414 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa7699279c2462dbb396d260723693a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.479593 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97f0e0bd83a94191a3339611d258d716" } modify_external_catalogs: true
I20260619 19:54:16.479790 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97f0e0bd83a94191a3339611d258d716" } modify_external_catalogs: true
I20260619 19:54:16.457508 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7383ecadaef04d0bab70889940bbb485 (DEFAULT_TABLE table=default.Table_b719a071d63b4664b397926a5f99ec7b [id=c9482af3b35e4bb3a42e1cba36970e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.481449 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7383ecadaef04d0bab70889940bbb485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.483280 1994 tablet_replica.cc:333] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:16.483484 1994 raft_consensus.cc:2243] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:16.456462 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 84986ae33a33426293a1a2c13c0a70fa (DEFAULT_TABLE table=default.Table_1b4977d0526047a79425bc05e1582c45 [id=cdf7557087db44aca4829b13803d714a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.483901 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84986ae33a33426293a1a2c13c0a70fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.465091 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 08344646a1db48f8bd0a41b0cc88ac70 (DEFAULT_TABLE table=default.Table_5a155405123a4e39958b742564b7817e [id=8abc904e579744d08c190bb9441e6718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.486183 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08344646a1db48f8bd0a41b0cc88ac70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.465559 2996 consensus_queue.cc:1048] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:16.460301 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.461247 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a9fdf28d4ee349f0b8529bd777063861 (DEFAULT_TABLE table=default.Table_1ae79f8cc1b945ff951cd84a52a2cb01 [id=bcf1af0b66c04a00b76b7504d31aad53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.498037 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fdf28d4ee349f0b8529bd777063861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.463717 763 tablet_service.cc:1511] Processing CreateTablet for tablet a9fdf28d4ee349f0b8529bd777063861 (DEFAULT_TABLE table=default.Table_1ae79f8cc1b945ff951cd84a52a2cb01 [id=bcf1af0b66c04a00b76b7504d31aad53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.506321 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fdf28d4ee349f0b8529bd777063861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.510321 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 0937ce43ca3e4b899d9198e0db3f7a3f (DEFAULT_TABLE table=default.Table_b59b55dfe04f45c98219770cd72e72a3 [id=addf240392bd4b17b66bc256e9bc1585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.515424 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 (DEFAULT_TABLE table=default.Table_5062c62488f6467a9fbcb70bea9f24f1 [id=3ff222773cf34801bbb0d0abc4955716]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.520841 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38fa2f7e9b54b1bb3c659334f43f8d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:16.521457 902 consensus_meta.cc:287] T 5c8a5b81449c4b4bbcd22bf6cb7c522f P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 1.053s user 0.023s sys 0.002s
W20260619 19:54:16.521920 3086 log.cc:927] Time spent T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
I20260619 19:54:16.522002 2953 raft_consensus.cc:515] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.524345 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d8d8a5ed6a874739b2195f8caa74ae9b (DEFAULT_TABLE table=default.Table_15292b79d02e4cc393e24ec7842d26d2 [id=472c098d0c8e45098130756df8d9e505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.524708 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d8a5ed6a874739b2195f8caa74ae9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.525074 2953 leader_election.cc:290] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:16.525300 919 raft_consensus.cc:2393] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 2: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:16.525473 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0937ce43ca3e4b899d9198e0db3f7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.522207 1201 raft_consensus.cc:359] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.525863 1201 raft_consensus.cc:385] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:16.525936 1201 raft_consensus.cc:740] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:54:16.526930 859 leader_election.cc:343] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:16.528563 902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 615) took 1185 ms. Trace:
I20260619 19:54:16.525971 1994 raft_consensus.cc:2272] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.540215 1994 ts_tablet_manager.cc:1916] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:16.532243 3065 tablet.cc:1724] T a6b5f1da20614838aac1a0175ad4a67d P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:16.532737 996 consensus_peers.cc:597] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.535615 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 8a331d2baf5d4f3081f9eab3589fddbd (DEFAULT_TABLE table=default.Table_82c02ca7771f4f82b3e8c9d066e7463e [id=907e940ff16844f793d2e8d8c666098f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.543071 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a331d2baf5d4f3081f9eab3589fddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.551265 422 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task38CK2r/build/asan/bin/kudu pid 1820
I20260619 19:54:16.557119 1994 ts_tablet_manager.cc:1929] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:16.565107 1022 tablet_service.cc:1511] Processing CreateTablet for tablet ddfe76640e5641fdb02ef53fddd8df2a (DEFAULT_TABLE table=default.Table_72cf4d7f1df6437590fc200e5936fa21 [id=51c7c5bc74a4428b85bac8ea15aab27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.569720 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfe76640e5641fdb02ef53fddd8df2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.528998 2026 log.cc:1199] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/f305a99e3481419196532cb5c62c2500
I20260619 19:54:16.532722 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0cd4cd0661415d8b2b2339363e7aca with delete_type TABLET_DATA_DELETED (replaced by tablet 910cf00e57404f1097800e84a2070b26) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.575527 901 tablet_service.cc:1511] Processing CreateTablet for tablet 1d776f839c3347bd8a357acc2ac8ed4a (DEFAULT_TABLE table=default.Table_66ad26c218e448178939af5aded44176 [id=4375ba0b8f5d463ebb1cad02e2de12e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.541204 3048 raft_consensus.cc:515] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.576328 917 raft_consensus.cc:2393] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:16.526161 1201 consensus_queue.cc:260] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.576575 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e342499619514c8997ab8f1b4cbd5950 (DEFAULT_TABLE table=default.Table_0d241bec13be41218abdee2d77a73f53 [id=2506e6d2f5e24fdebed70cb78181ac3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.577013 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e342499619514c8997ab8f1b4cbd5950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.565927 903 tablet_service.cc:1511] Processing CreateTablet for tablet 837a69f9153c4bf8836804017c8bac40 (DEFAULT_TABLE table=default.Table_d436621459c84358a9670595540687ab [id=4eaf2375f47a43dd9ca3608c5d5de842]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:16.568840 859 consensus_peers.cc:597] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca6d7f30c5a84106bebebc42eedee654. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.577741 902 rpcz_store.cc:276] 0619 19:54:15.343040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.346316 (+ 3276us) service_pool.cc:224] Handling call
0619 19:54:15.346666 (+ 350us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:15.346686 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:15.468179 (+121493us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.528350 (+1060171us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:16.528540 (+ 190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:16.581703 1994 log.cc:1199] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/a54231986cca44258942dbc3373870b2
I20260619 19:54:16.586067 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2054a94d62164467843a0f47465f4e82 (DEFAULT_TABLE table=default.Table_baff15c587f7449cbc53a0c38dbf8c32 [id=c0cd86425dc84f8dbec09b1af920759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.586539 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054a94d62164467843a0f47465f4e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.572722 892 tablet_service.cc:1511] Processing CreateTablet for tablet 4b35985fed5949889ef6cd321ea38e7b (DEFAULT_TABLE table=default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.573854 890 tablet_service.cc:1558] Processing DeleteTablet for tablet e6dcf87d57044279a218cbb21c383352 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:53:59 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.573944 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb1c6e2c00848539217ffb4c3f57231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.588688 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:16.588995 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d776f839c3347bd8a357acc2ac8ed4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.573979 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 05c9a91f95bb4bcdafe493bab8c393b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.593086 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837a69f9153c4bf8836804017c8bac40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.593356 902 tablet_service.cc:1511] Processing CreateTablet for tablet c34d1212487348ceae8c58e5c09740cc (DEFAULT_TABLE table=default.Table_97b547a957704426af6c457046bbcf5d [id=ef1b52a9b1fd4b30b10d68ac9e881abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.593717 1973 ts_tablet_manager.cc:1929] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:16.598829 2026 ts_tablet_manager.cc:1950] T f305a99e3481419196532cb5c62c2500 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:16.601184 1973 log.cc:1199] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:16.602308 3048 leader_election.cc:290] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:16.602885 859 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: e6dcf87d57044279a218cbb21c383352
I20260619 19:54:16.605499 1201 ts_tablet_manager.cc:1434] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.232s user 0.002s sys 0.002s
I20260619 19:54:16.610752 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 6c05b4794d58476895ff0ad66be80fff (DEFAULT_TABLE table=default.Table_d25b06554eb1441c8dc2fa9030209fa8 [id=6fe1bfe274634734a4721d02045e73fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.617149 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec79ccfa8054a4bab2641d42c25b81b (DEFAULT_TABLE table=default.Table_dce56a19d6f24028956f0904bad88cd5 [id=d9e476d02b9f43d18edb3b857aff0d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.619089 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 1261a735922542a1a6c149986f236c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.619803 898 tablet_service.cc:1558] Processing DeleteTablet for tablet dc5235127fb54d3dba90c9f9f8c134b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.573076 887 tablet_service.cc:1511] Processing CreateTablet for tablet d6fd3f8ae7ae4e509ee42463279be2b2 (DEFAULT_TABLE table=default.Table_e8fd08c12eb04674bc5cafd9bb81fca6 [id=9b9070af5388443da65ca3d02de8a1d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.621299 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c85407a4d392498290eae64df5f85edf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.623955 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c322c38aae114a428f64a476a2ae9b5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.624428 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:16.624809 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c05b4794d58476895ff0ad66be80fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.630199 898 tablet_service.cc:1511] Processing CreateTablet for tablet a9fdf28d4ee349f0b8529bd777063861 (DEFAULT_TABLE table=default.Table_1ae79f8cc1b945ff951cd84a52a2cb01 [id=bcf1af0b66c04a00b76b7504d31aad53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.631381 1973 ts_tablet_manager.cc:1950] T 9f33c2c00b414fbebf1965510e1e2b96 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:16.632508 1208 raft_consensus.cc:359] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.632930 1208 raft_consensus.cc:385] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:16.633085 1208 raft_consensus.cc:740] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:16.633363 1208 consensus_queue.cc:260] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.637370 1208 ts_tablet_manager.cc:1434] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.238s user 0.000s sys 0.002s
I20260619 19:54:16.638257 3082 raft_consensus.cc:2749] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.539422 1200 ts_tablet_manager.cc:1434] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.216s user 0.002s sys 0.000s
I20260619 19:54:16.623425 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a5dc0f846a734f8596d5ee0ad03a2533 (DEFAULT_TABLE table=default.Table_b54e41ea7f3743c0a2b7d330cdfc13a3 [id=58308a2bd3f14689836d7ec3a6740fe4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:16.624347 996 consensus_peers.cc:597] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:16.639036 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa7699279c2462dbb396d260723693a (DEFAULT_TABLE table=default.Table_b6487d191e234b36b6b524ee98f4a71e [id=40aafbe8f30d4a0aac7ac20fd5fb36e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.639036 754 tablet_service.cc:1511] Processing CreateTablet for tablet f81d5bad8efe4c6b9b13f4d8fdc664cb (DEFAULT_TABLE table=default.Table_227f6683e0654c1a8d6b3993255ae331 [id=8e51cc51a9564081b445288138159402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.639526 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc0f846a734f8596d5ee0ad03a2533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.640365 759 tablet_service.cc:1511] Processing CreateTablet for tablet 437cebe83301488d9cd7d1b9a1ebef15 (DEFAULT_TABLE table=default.Table_cc7858b6eabf4a87957b2964dd1cfde4 [id=074ebc0b2ae44a90ac1e81311018e976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.640388 751 tablet_service.cc:1511] Processing CreateTablet for tablet 08344646a1db48f8bd0a41b0cc88ac70 (DEFAULT_TABLE table=default.Table_5a155405123a4e39958b742564b7817e [id=8abc904e579744d08c190bb9441e6718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.640439 752 tablet_service.cc:1511] Processing CreateTablet for tablet 84986ae33a33426293a1a2c13c0a70fa (DEFAULT_TABLE table=default.Table_1b4977d0526047a79425bc05e1582c45 [id=cdf7557087db44aca4829b13803d714a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.640645 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 710fae36dd674b1786aa75013284684e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:16.640897 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0937ce43ca3e4b899d9198e0db3f7a3f (DEFAULT_TABLE table=default.Table_b59b55dfe04f45c98219770cd72e72a3 [id=addf240392bd4b17b66bc256e9bc1585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.640930 748 tablet_service.cc:1511] Processing CreateTablet for tablet 2c512a30b4fa48fb89bc1ea968ad6536 (DEFAULT_TABLE table=default.Table_1af8c578eef1461093d09e3c7c8724d1 [id=7e9e2d1b8b6d4116a108ffac5a3511d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.641402 749 tablet_service.cc:1511] Processing CreateTablet for tablet d8d8a5ed6a874739b2195f8caa74ae9b (DEFAULT_TABLE table=default.Table_15292b79d02e4cc393e24ec7842d26d2 [id=472c098d0c8e45098130756df8d9e505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.641680 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7383ecadaef04d0bab70889940bbb485 (DEFAULT_TABLE table=default.Table_b719a071d63b4664b397926a5f99ec7b [id=c9482af3b35e4bb3a42e1cba36970e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.641921 765 tablet_service.cc:1511] Processing CreateTablet for tablet 8a331d2baf5d4f3081f9eab3589fddbd (DEFAULT_TABLE table=default.Table_82c02ca7771f4f82b3e8c9d066e7463e [id=907e940ff16844f793d2e8d8c666098f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.643610 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d8a5ed6a874739b2195f8caa74ae9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.644440 753 tablet_service.cc:1511] Processing CreateTablet for tablet e342499619514c8997ab8f1b4cbd5950 (DEFAULT_TABLE table=default.Table_0d241bec13be41218abdee2d77a73f53 [id=2506e6d2f5e24fdebed70cb78181ac3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.644801 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e342499619514c8997ab8f1b4cbd5950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.645049 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2054a94d62164467843a0f47465f4e82 (DEFAULT_TABLE table=default.Table_baff15c587f7449cbc53a0c38dbf8c32 [id=c0cd86425dc84f8dbec09b1af920759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.645323 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054a94d62164467843a0f47465f4e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.648032 1200 tablet_bootstrap.cc:492] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:16.648243 755 tablet_service.cc:1511] Processing CreateTablet for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 (DEFAULT_TABLE table=default.Table_5062c62488f6467a9fbcb70bea9f24f1 [id=3ff222773cf34801bbb0d0abc4955716]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.648563 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38fa2f7e9b54b1bb3c659334f43f8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.649448 1200 tablet_bootstrap.cc:654] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:16.649829 746 tablet_service.cc:1511] Processing CreateTablet for tablet ddfe76640e5641fdb02ef53fddd8df2a (DEFAULT_TABLE table=default.Table_72cf4d7f1df6437590fc200e5936fa21 [id=51c7c5bc74a4428b85bac8ea15aab27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.650147 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfe76640e5641fdb02ef53fddd8df2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.650985 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6c05b4794d58476895ff0ad66be80fff (DEFAULT_TABLE table=default.Table_d25b06554eb1441c8dc2fa9030209fa8 [id=6fe1bfe274634734a4721d02045e73fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.651324 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c05b4794d58476895ff0ad66be80fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.652630 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 66f145a7e9214376bc07e0f8d2b82ba2 (DEFAULT_TABLE table=default.Table_97afba45159d435bae3025f31b4472e1 [id=e6755357afce4e388874a25c48ee2ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.653030 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f145a7e9214376bc07e0f8d2b82ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.655894 749 tablet_service.cc:1511] Processing CreateTablet for tablet f17221015b624191b0e6fbdb55d87595 (DEFAULT_TABLE table=default.Table_700ad3760841471bae364a646e4d85d9 [id=11eb9a7baad14371824f029400186748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.656459 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17221015b624191b0e6fbdb55d87595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.662200 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 3d262f57d4bd4d469005873c954d1a7a (DEFAULT_TABLE table=default.Table_ba0fc2cf64384072b2f81f7a30526192 [id=936d83b658654ce3b4d440b2db9d125e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.662714 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d262f57d4bd4d469005873c954d1a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.665280 764 tablet_service.cc:1511] Processing CreateTablet for tablet a5dc0f846a734f8596d5ee0ad03a2533 (DEFAULT_TABLE table=default.Table_b54e41ea7f3743c0a2b7d330cdfc13a3 [id=58308a2bd3f14689836d7ec3a6740fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.665782 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc0f846a734f8596d5ee0ad03a2533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.667474 3048 raft_consensus.cc:493] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:16.667618 3048 raft_consensus.cc:515] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:16.668201 3048 leader_election.cc:290] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:16.669708 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4023cceb8d9447c9952951c1d6bcdf00" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:16.669929 777 raft_consensus.cc:3060] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:54:16.671883 859 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:16.674788 777 raft_consensus.cc:2468] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 2.
I20260619 19:54:16.676440 1200 tablet_bootstrap.cc:492] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:16.676656 3089 tablet.cc:1724] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:16.678069 1200 ts_tablet_manager.cc:1403] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260619 19:54:16.684054 1200 raft_consensus.cc:359] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.684381 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa7699279c2462dbb396d260723693a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.684998 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0937ce43ca3e4b899d9198e0db3f7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.685702 1208 tablet_bootstrap.cc:492] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:16.686744 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e4b2802ecd504e0a8b743e432bfc3fab (DEFAULT_TABLE table=default.Table_3501993f2f45498d8b39e29320e10e04 [id=0fcd3cdc60cd4c33bc173c67273891f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.687294 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b2802ecd504e0a8b743e432bfc3fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.684245 1200 raft_consensus.cc:385] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:54:16.697679 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 140de873b1094bf4ac9fa29507722300 consensus state has no leader
I20260619 19:54:16.697765 1200 raft_consensus.cc:740] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:16.699054 1200 consensus_queue.cc:260] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:16.705421 1200 ts_tablet_manager.cc:1434] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260619 19:54:16.707509 1200 tablet_bootstrap.cc:492] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:16.712800 1200 tablet_bootstrap.cc:654] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:16.715026 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8b2950a5d623472892aa182117131970" } modify_external_catalogs: true
I20260619 19:54:16.715301 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8b2950a5d623472892aa182117131970" } modify_external_catalogs: true
I20260619 19:54:16.715943 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b35985fed5949889ef6cd321ea38e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.716770 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec79ccfa8054a4bab2641d42c25b81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.717810 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34d1212487348ceae8c58e5c09740cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.718747 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9a0efe4dd74748209603d2df2323ea2c" } new_table_name: "default.Table_5bb390fdc5da4195aad76300af23656b" modify_external_catalogs: true
I20260619 19:54:16.720167 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 79bcc998cf6c4d3e851a437ccd2edb92
I20260619 19:54:16.720707 530 catalog_manager.cc:6784] ReplaceTablet: tablet 79bcc998cf6c4d3e851a437ccd2edb92 deleted and replaced by tablet 695da0cfd6e54682b6fad1f3a2ff0ac9
I20260619 19:54:16.704598 1031 tablet_service.cc:1511] Processing CreateTablet for tablet b7ff86ab886e433f9f7b82e70a035415 (DEFAULT_TABLE table=default.Table_f7b3d16eaff643bbba63fc88e5983ccd [id=4c1df4d864b643e59a5e6251cfd6c44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.721040 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ccbefd48bcb945828054aeac735e1750"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:16.721390 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ff86ab886e433f9f7b82e70a035415. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:16.721572 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccbefd48bcb945828054aeac735e1750 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.714540 3065 tablet.cc:1724] T 2943333e572e4f1384b78d96a27d9c63 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:16.715966 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e6e4c15733c34e66b6bba87bd6b3edf3 (DEFAULT_TABLE table=default.Table_0b53167d2e6c488f9cdb201c78fd2fd1 [id=e6947a23fe8641d9917ae561d36a75cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.724363 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e4c15733c34e66b6bba87bd6b3edf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.727278 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 79bcc998cf6c4d3e851a437ccd2edb92 with delete_type TABLET_DATA_DELETED (replaced by tablet 695da0cfd6e54682b6fad1f3a2ff0ac9) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.728417 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 41e34d9261a14baeb78679e6fe5da505 (DEFAULT_TABLE table=default.Table_2f3ca718f1364e56929c805460a6a394 [id=ae580be067b24a7a844f76420f444721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.730268 889 tablet_service.cc:1511] Processing CreateTablet for tablet 84986ae33a33426293a1a2c13c0a70fa (DEFAULT_TABLE table=default.Table_1b4977d0526047a79425bc05e1582c45 [id=cdf7557087db44aca4829b13803d714a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.730681 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84986ae33a33426293a1a2c13c0a70fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:16.730754 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 140de873b1094bf4ac9fa29507722300 (table default.Table_90f44db33056470a9a5f6623abe6f491 [id=df4fa9ddc0cf43939afd4f282bd8d131], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 140de873b1094bf4ac9fa29507722300 consensus state has no leader
I20260619 19:54:16.732287 894 tablet_service.cc:1511] Processing CreateTablet for tablet 7383ecadaef04d0bab70889940bbb485 (DEFAULT_TABLE table=default.Table_b719a071d63b4664b397926a5f99ec7b [id=c9482af3b35e4bb3a42e1cba36970e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.732841 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7383ecadaef04d0bab70889940bbb485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.739604 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f17221015b624191b0e6fbdb55d87595 (DEFAULT_TABLE table=default.Table_700ad3760841471bae364a646e4d85d9 [id=11eb9a7baad14371824f029400186748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.740283 886 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa7699279c2462dbb396d260723693a (DEFAULT_TABLE table=default.Table_b6487d191e234b36b6b524ee98f4a71e [id=40aafbe8f30d4a0aac7ac20fd5fb36e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.740754 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa7699279c2462dbb396d260723693a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.741195 888 tablet_service.cc:1511] Processing CreateTablet for tablet f81d5bad8efe4c6b9b13f4d8fdc664cb (DEFAULT_TABLE table=default.Table_227f6683e0654c1a8d6b3993255ae331 [id=8e51cc51a9564081b445288138159402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.742175 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81d5bad8efe4c6b9b13f4d8fdc664cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.745504 893 tablet_service.cc:1511] Processing CreateTablet for tablet 08344646a1db48f8bd0a41b0cc88ac70 (DEFAULT_TABLE table=default.Table_5a155405123a4e39958b742564b7817e [id=8abc904e579744d08c190bb9441e6718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.746112 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08344646a1db48f8bd0a41b0cc88ac70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.749203 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd3f8ae7ae4e509ee42463279be2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.751191 884 tablet_service.cc:1511] Processing CreateTablet for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 (DEFAULT_TABLE table=default.Table_5062c62488f6467a9fbcb70bea9f24f1 [id=3ff222773cf34801bbb0d0abc4955716]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.752218 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437cebe83301488d9cd7d1b9a1ebef15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.752743 1033 tablet_service.cc:1511] Processing CreateTablet for tablet efba47405c35417a85690c8c95367ff1 (DEFAULT_TABLE table=default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8 [id=2bf0bd2517724b73b1f5b41bb391449d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.753165 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efba47405c35417a85690c8c95367ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.754765 756 tablet_service.cc:1511] Processing CreateTablet for tablet 66f145a7e9214376bc07e0f8d2b82ba2 (DEFAULT_TABLE table=default.Table_97afba45159d435bae3025f31b4472e1 [id=e6755357afce4e388874a25c48ee2ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.757933 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 485) took 6142 ms. Trace:
I20260619 19:54:16.758306 1973 rpcz_store.cc:276] 0619 19:54:10.615927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.615960 (+ 33us) service_pool.cc:224] Handling call
0619 19:54:16.314468 (+5698508us) ts_tablet_manager.cc:1151] Deleting tablet 9f33c2c00b414fbebf1965510e1e2b96
0619 19:54:16.314480 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.467900 (+153420us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.593649 (+125749us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.757906 (+164257us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5698358}
I20260619 19:54:16.761915 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08344646a1db48f8bd0a41b0cc88ac70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.763787 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 486) took 6147 ms. Trace:
I20260619 19:54:16.764580 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 73fa6438bb734872a22cf1e8aa80470e (DEFAULT_TABLE table=default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 [id=2413d4206e3e4b1c9b9ace3921450d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.764295 1973 rpcz_store.cc:276] 0619 19:54:10.616043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.616125 (+ 82us) service_pool.cc:224] Handling call
0619 19:54:16.759511 (+6143386us) ts_tablet_manager.cc:1151] Deleting tablet ac55fd703e184730ab053e045b0f4e2c
0619 19:54:16.759565 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.763717 (+ 4152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6143282}
I20260619 19:54:16.766445 1201 tablet_bootstrap.cc:492] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:16.769815 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fa6438bb734872a22cf1e8aa80470e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.775439 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fdf28d4ee349f0b8529bd777063861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.777740 899 tablet_service.cc:1511] Processing CreateTablet for tablet d8d8a5ed6a874739b2195f8caa74ae9b (DEFAULT_TABLE table=default.Table_15292b79d02e4cc393e24ec7842d26d2 [id=472c098d0c8e45098130756df8d9e505]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.779512 3089 tablet.cc:1724] T a6b5f1da20614838aac1a0175ad4a67d P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:16.780588 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 66e27442d24142b7a3b0d53c0f0d9ded (DEFAULT_TABLE table=default.Table_af8379e2099643ab834cb55af9529eb3 [id=44a8f65f912446f9b75138d8a099320d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.781848 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38fa2f7e9b54b1bb3c659334f43f8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.782127 900 tablet_service.cc:1511] Processing CreateTablet for tablet 2c512a30b4fa48fb89bc1ea968ad6536 (DEFAULT_TABLE table=default.Table_1af8c578eef1461093d09e3c7c8724d1 [id=7e9e2d1b8b6d4116a108ffac5a3511d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.784101 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c512a30b4fa48fb89bc1ea968ad6536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.784829 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7383ecadaef04d0bab70889940bbb485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.785882 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a331d2baf5d4f3081f9eab3589fddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.786811 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84986ae33a33426293a1a2c13c0a70fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.787012 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f145a7e9214376bc07e0f8d2b82ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.788010 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f81d5bad8efe4c6b9b13f4d8fdc664cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.790974 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 040c559120d64e06865e82f84b1cdc4e (DEFAULT_TABLE table=default.Table_aece37580b584c31a97b2030aa7f0cf5 [id=553e154e40764fe2990f8b568a1c31d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.791462 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040c559120d64e06865e82f84b1cdc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.793591 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 487) took 6177 ms. Trace:
I20260619 19:54:16.793689 1973 rpcz_store.cc:276] 0619 19:54:10.616129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.616238 (+ 109us) service_pool.cc:224] Handling call
0619 19:54:16.765447 (+6149209us) ts_tablet_manager.cc:1151] Deleting tablet fcb37eed280c48e8931b6fc94f7600dd
0619 19:54:16.765519 (+ 72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.793566 (+ 28047us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6149018}
I20260619 19:54:16.794215 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 484) took 6178 ms. Trace:
I20260619 19:54:16.794302 1973 rpcz_store.cc:276] 0619 19:54:10.615844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.616325 (+ 481us) service_pool.cc:224] Handling call
0619 19:54:16.793932 (+6177607us) ts_tablet_manager.cc:1151] Deleting tablet 8b2e40a7328d42dd864703db24c1fa3c
0619 19:54:16.793944 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.794025 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6177412}
I20260619 19:54:16.794615 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 477) took 6180 ms. Trace:
I20260619 19:54:16.794695 1973 rpcz_store.cc:276] 0619 19:54:10.614064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.614663 (+ 599us) service_pool.cc:224] Handling call
0619 19:54:16.794513 (+6179850us) ts_tablet_manager.cc:1151] Deleting tablet 5e5c1ffd83c944ada87d59439b6a9cb3
0619 19:54:16.794522 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.794600 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6167783}
I20260619 19:54:16.794950 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 488) took 5436 ms. Trace:
I20260619 19:54:16.795007 1973 rpcz_store.cc:276] 0619 19:54:11.358888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.358938 (+ 50us) service_pool.cc:224] Handling call
0619 19:54:16.794868 (+5435930us) ts_tablet_manager.cc:1151] Deleting tablet 056f7982f51f45a78d2b9b0a0b50576e
0619 19:54:16.794875 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.794938 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5435734}
I20260619 19:54:16.795239 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8a331d2baf5d4f3081f9eab3589fddbd (DEFAULT_TABLE table=default.Table_82c02ca7771f4f82b3e8c9d066e7463e [id=907e940ff16844f793d2e8d8c666098f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.798231 2426 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 19:54:16.748832 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 288) took 11946 ms. Trace:
I20260619 19:54:16.805207 1201 tablet_bootstrap.cc:654] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:16.806507 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 494) took 5435 ms. Trace:
I20260619 19:54:16.806620 1973 rpcz_store.cc:276] 0619 19:54:11.371537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.371663 (+ 126us) service_pool.cc:224] Handling call
0619 19:54:16.795218 (+5423555us) ts_tablet_manager.cc:1151] Deleting tablet de6c34ec79d24bfe926f90b8067db558
0619 19:54:16.795226 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.806477 (+ 11251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5423294}
I20260619 19:54:16.807019 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 506) took 5330 ms. Trace:
I20260619 19:54:16.807111 1973 rpcz_store.cc:276] 0619 19:54:11.477029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.477094 (+ 65us) service_pool.cc:224] Handling call
0619 19:54:16.806873 (+5329779us) ts_tablet_manager.cc:1151] Deleting tablet eb43742411444ecaa62f74fc729c7745
0619 19:54:16.806883 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.806999 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5329234}
I20260619 19:54:16.807417 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 507) took 5329 ms. Trace:
I20260619 19:54:16.807479 1973 rpcz_store.cc:276] 0619 19:54:11.478058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.478134 (+ 76us) service_pool.cc:224] Handling call
0619 19:54:16.807331 (+5329197us) ts_tablet_manager.cc:1151] Deleting tablet e22e0f53008c4a96bf56b7f057f81cd5
0619 19:54:16.807340 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.807405 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5328921}
I20260619 19:54:16.807672 1973 tablet_replica.cc:333] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:16.807857 1973 raft_consensus.cc:2243] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:16.808058 1973 pending_rounds.cc:70] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:16.808090 1973 pending_rounds.cc:77] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7298657708508971008 op_type: NO_OP noop_request { }
I20260619 19:54:16.808187 1973 raft_consensus.cc:2889] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:16.808254 1973 raft_consensus.cc:2272] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:16.808770 1973 ts_tablet_manager.cc:1916] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:16.819873 896 tablet_service.cc:1511] Processing CreateTablet for tablet 437cebe83301488d9cd7d1b9a1ebef15 (DEFAULT_TABLE table=default.Table_cc7858b6eabf4a87957b2964dd1cfde4 [id=074ebc0b2ae44a90ac1e81311018e976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.824112 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d8a5ed6a874739b2195f8caa74ae9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.825307 2996 consensus_queue.cc:1048] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:16.749119 889 tablet_service.cc:1511] Processing CreateTablet for tablet 0937ce43ca3e4b899d9198e0db3f7a3f (DEFAULT_TABLE table=default.Table_b59b55dfe04f45c98219770cd72e72a3 [id=addf240392bd4b17b66bc256e9bc1585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.829180 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0937ce43ca3e4b899d9198e0db3f7a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.832099 523 catalog_manager.cc:5696] T e7a19f43793b4440b7a9d2652a75e6bd P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:16.832880 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:16.838011 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dfd28dcc8602420fa6d621c66de1acc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.838899 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfd28dcc8602420fa6d621c66de1acc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:16.842892 859 consensus_peers.cc:597] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8522f562665540ce99490ab90e02d801. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:16.847939 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f5057229e0d04eafb501356ad8f649ba
I20260619 19:54:16.849725 1023 tablet_service.cc:1558] Processing DeleteTablet for tablet f5057229e0d04eafb501356ad8f649ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.855336 1024 tablet_service.cc:1511] Processing CreateTablet for tablet c5925acc62a846d2b340039d7b02443e (DEFAULT_TABLE table=default.Table_5710399e6e08425593af8f928adeace2 [id=dee6cf21380f42b38625c8a8bce8e6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.855861 1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5925acc62a846d2b340039d7b02443e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.859649 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 58635330cf29425bbafea95e64bdfbb9 (DEFAULT_TABLE table=default.Table_d27b4fd6fd07484dac45acac41ef8dea [id=c8855e3b5758459fa836ec1d1b4c3bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.861711 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6763e5bd260242b7a4c12eaf6a57507f (DEFAULT_TABLE table=default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.863392 891 tablet_service.cc:1511] Processing CreateTablet for tablet ddfe76640e5641fdb02ef53fddd8df2a (DEFAULT_TABLE table=default.Table_72cf4d7f1df6437590fc200e5936fa21 [id=51c7c5bc74a4428b85bac8ea15aab27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.863610 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 198c9f7a044c4a62b178a32e562f7168 (DEFAULT_TABLE table=default.Table_01a59125e9354956a7df1f8f0b26b592 [id=c44fdc0b0cb7416eb9c47a3f314f3f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.863849 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddfe76640e5641fdb02ef53fddd8df2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.868976 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9bca1b1d70944f1fb9df39ee8c10c573"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.869621 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bca1b1d70944f1fb9df39ee8c10c573 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.871762 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6763e5bd260242b7a4c12eaf6a57507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.871985 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58635330cf29425bbafea95e64bdfbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.875658 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e34d9261a14baeb78679e6fe5da505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.884392 3048 consensus_queue.cc:1048] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:16.884613 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17221015b624191b0e6fbdb55d87595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.885358 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e27442d24142b7a3b0d53c0f0d9ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.888074 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1df39b15e65e4b4c8a798e9dedf18358"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.888671 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1df39b15e65e4b4c8a798e9dedf18358 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.890131 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198c9f7a044c4a62b178a32e562f7168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.897442 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a1c42c4e323a434bac1f6cb25a1a0281
I20260619 19:54:16.898590 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dcf87d57044279a218cbb21c383352" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:16.898859 785 raft_consensus.cc:2393] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:16.901804 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet a1c42c4e323a434bac1f6cb25a1a0281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.908689 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]) successfully deleted
W20260619 19:54:16.909121 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ac55fd703e184730ab053e045b0f4e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac55fd703e184730ab053e045b0f4e2c already in progress: creating tablet
W20260619 19:54:16.909479 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet fcb37eed280c48e8931b6fc94f7600dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcb37eed280c48e8931b6fc94f7600dd already in progress: creating tablet
W20260619 19:54:16.909684 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8b2e40a7328d42dd864703db24c1fa3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2e40a7328d42dd864703db24c1fa3c already in progress: creating tablet
W20260619 19:54:16.909885 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e5c1ffd83c944ada87d59439b6a9cb3 already in progress: creating tablet
W20260619 19:54:16.910076 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 056f7982f51f45a78d2b9b0a0b50576e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 056f7982f51f45a78d2b9b0a0b50576e already in progress: creating tablet
W20260619 19:54:16.910382 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet de6c34ec79d24bfe926f90b8067db558 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de6c34ec79d24bfe926f90b8067db558 already in progress: creating tablet
W20260619 19:54:16.910565 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet eb43742411444ecaa62f74fc729c7745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb43742411444ecaa62f74fc729c7745 already in progress: creating tablet
I20260619 19:54:16.910539 719 leader_election.cc:304] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:16.910768 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e22e0f53008c4a96bf56b7f057f81cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e22e0f53008c4a96bf56b7f057f81cd5 already in progress: creating tablet
I20260619 19:54:16.910837 3078 raft_consensus.cc:2749] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:16.911237 719 leader_election.cc:304] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.911582 3078 raft_consensus.cc:2749] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:16.923995 858 leader_election.cc:304] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:16.924773 858 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:16.924901 858 leader_election.cc:304] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:16.925259 3047 raft_consensus.cc:2804] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:16.925974 2953 raft_consensus.cc:2749] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:16.931212 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b34d510958c945519187a1aefb7ae1c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.931905 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b34d510958c945519187a1aefb7ae1c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.935377 895 tablet_service.cc:1511] Processing CreateTablet for tablet e342499619514c8997ab8f1b4cbd5950 (DEFAULT_TABLE table=default.Table_0d241bec13be41218abdee2d77a73f53 [id=2506e6d2f5e24fdebed70cb78181ac3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.935873 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e342499619514c8997ab8f1b4cbd5950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.959002 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1980b85fb1e5469a917fe9eb7ad91a50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:16.959771 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1980b85fb1e5469a917fe9eb7ad91a50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:16.966928 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b8bc6173a84f4a5091c9f865cd0037fb (DEFAULT_TABLE table=default.Table_063722268d314b36997cd6b451eae90d [id=c8e717d598254e39b84549546dc08c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:16.967451 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bc6173a84f4a5091c9f865cd0037fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:16.970404 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 55404d15d42244c6b42272143c44ff9c
I20260619 19:54:16.972352 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet 55404d15d42244c6b42272143c44ff9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:16.975509 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5a155405123a4e39958b742564b7817e" } new_table_name: "default.Table_04412bec4b6c425e9522c480ee9b108b" modify_external_catalogs: true
I20260619 19:54:16.977335 1994 ts_tablet_manager.cc:1950] T a54231986cca44258942dbc3373870b2 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:16.979681 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet a54231986cca44258942dbc3373870b2 (table default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]) successfully deleted
I20260619 19:54:17.003191 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:17.005789 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.006373 1994 tablet_replica.cc:333] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:17.006805 1994 raft_consensus.cc:2243] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:17.008514 1994 raft_consensus.cc:2272] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.009827 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c83114cdb88a48a79cc3c49817a51222" } new_table_name: "default.Table_cd4ea98b46774b57a87f54d926390aec" modify_external_catalogs: true
I20260619 19:54:17.015705 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8a390cfff6c24509ab2a07a622dd7ca9 (DEFAULT_TABLE table=default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.017190 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a390cfff6c24509ab2a07a622dd7ca9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.019778 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b1fbb31c1084a4aa851a7f7a2ad942f consensus state has no leader
I20260619 19:54:17.021600 1994 ts_tablet_manager.cc:1916] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.023329 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4310c3d1b2cf4ad0841fee7480e05bf5" } modify_external_catalogs: true
I20260619 19:54:17.023520 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4310c3d1b2cf4ad0841fee7480e05bf5" } modify_external_catalogs: true
I20260619 19:54:17.029420 1200 tablet_bootstrap.cc:492] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:17.029621 1200 ts_tablet_manager.cc:1403] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.322s user 0.010s sys 0.000s
I20260619 19:54:17.030460 1200 raft_consensus.cc:359] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.030686 1200 raft_consensus.cc:385] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.030748 1200 raft_consensus.cc:740] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.030972 1200 consensus_queue.cc:260] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.032091 1200 ts_tablet_manager.cc:1434] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:17.034708 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2054a94d62164467843a0f47465f4e82 (DEFAULT_TABLE table=default.Table_baff15c587f7449cbc53a0c38dbf8c32 [id=c0cd86425dc84f8dbec09b1af920759e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.039860 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cce3f00760d0463f87c8fea78a0e425c" } new_table_name: "default.Table_abbfebb4e0fe42d4b046d4c687349c1d" modify_external_catalogs: true
I20260619 19:54:17.042596 1200 tablet_bootstrap.cc:492] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.043799 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 579567f970874a36b1b89e7d5ff70a1f (DEFAULT_TABLE table=default.Table_370c9e1a3e67410cbb4fec543864ae95 [id=46cd2d6b7e0941618273a466d5387411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.044284 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579567f970874a36b1b89e7d5ff70a1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.044523 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 149499us
I20260619 19:54:17.046063 3089 tablet.cc:1724] T 2943333e572e4f1384b78d96a27d9c63 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:17.046964 3084 raft_consensus.cc:493] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.047108 3084 raft_consensus.cc:515] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.048369 1200 tablet_bootstrap.cc:654] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:17.051374 720 leader_election.cc:343] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 774938222588473e90c513232c82aece
I20260619 19:54:17.056563 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e1485977ffee48529713dafd37bf30f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:17.057281 1200 tablet_bootstrap.cc:492] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
W20260619 19:54:17.057266 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1485977ffee48529713dafd37bf30f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.057402 1200 ts_tablet_manager.cc:1403] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260619 19:54:17.058069 1200 raft_consensus.cc:359] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.058235 1200 raft_consensus.cc:385] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.058284 1200 raft_consensus.cc:740] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.060011 1200 consensus_queue.cc:260] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.061178 1200 ts_tablet_manager.cc:1434] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260619 19:54:17.064065 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 152184us
I20260619 19:54:17.062194 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff01c0de8a540d0a024a4924199ba54 (DEFAULT_TABLE table=default.Table_766549702f124d0286617da3d1fa585c [id=3e15f4bd79fd433590d102806c85fed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.068711 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff01c0de8a540d0a024a4924199ba54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.074257 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:17.074795 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9911df524f8948ea8ecce55df0fdd0d6 (table default.Table_02e64fc0947b45c6a2eb8c87da0582d3 [id=1150e278fd3646d9b0897243ff2524d4]). Expected version 2 got 0
I20260619 19:54:17.081094 1200 tablet_bootstrap.cc:492] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.082021 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e8c52fca539243069032092b552030f9 (DEFAULT_TABLE table=default.Table_97566a6b6a6041ac9fceff103e3be47b [id=23067799ec0f4b97b8ea5aa4441a1b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.082580 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c52fca539243069032092b552030f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.090131 1200 tablet_bootstrap.cc:654] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.092860 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e7943a3044fe46f783ae56e66daf2120" } new_table_name: "default.Table_47f324361ce9495b8148970f3669be81" modify_external_catalogs: true
W20260619 19:54:17.111027 3093 log.cc:927] Time spent T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Append to log took a long time: real 0.219s user 0.000s sys 0.000s
W20260619 19:54:17.119506 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 52978.9us
I20260619 19:54:17.047667 3084 leader_election.cc:290] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:17.139848 780 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.719s user 0.030s sys 0.034s
W20260619 19:54:17.140097 780 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.720s user 0.030s sys 0.034s
I20260619 19:54:17.140029 3099 tablet.cc:1724] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:17.141917 894 tablet_service.cc:1511] Processing CreateTablet for tablet 6c05b4794d58476895ff0ad66be80fff (DEFAULT_TABLE table=default.Table_d25b06554eb1441c8dc2fa9030209fa8 [id=6fe1bfe274634734a4721d02045e73fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.142554 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c512a30b4fa48fb89bc1ea968ad6536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.143746 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2054a94d62164467843a0f47465f4e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.145387 3068 raft_consensus.cc:493] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.145591 3068 raft_consensus.cc:515] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.146420 3068 leader_election.cc:290] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.147317 902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 672) took 1055 ms. Trace:
I20260619 19:54:17.147490 902 rpcz_store.cc:276] 0619 19:54:16.092217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.582385 (+490168us) service_pool.cc:224] Handling call
0619 19:54:16.717636 (+135251us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:16.717666 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:16.761951 (+ 44285us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.028080 (+266129us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:17.147294 (+119214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:17.148715 902 tablet_service.cc:1511] Processing CreateTablet for tablet f17221015b624191b0e6fbdb55d87595 (DEFAULT_TABLE table=default.Table_700ad3760841471bae364a646e4d85d9 [id=11eb9a7baad14371824f029400186748]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.149319 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17221015b624191b0e6fbdb55d87595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.153923 892 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 667) took 1062 ms. Trace:
I20260619 19:54:17.154192 892 rpcz_store.cc:276] 0619 19:54:16.091906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.572453 (+480547us) service_pool.cc:224] Handling call
0619 19:54:16.587453 (+ 15000us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:16.715548 (+128095us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:16.774109 (+ 58561us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.032418 (+258309us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:17.153899 (+121481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:17.155225 892 tablet_service.cc:1511] Processing CreateTablet for tablet a5dc0f846a734f8596d5ee0ad03a2533 (DEFAULT_TABLE table=default.Table_b54e41ea7f3743c0a2b7d330cdfc13a3 [id=58308a2bd3f14689836d7ec3a6740fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.155687 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc0f846a734f8596d5ee0ad03a2533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.166989 886 tablet_service.cc:1511] Processing CreateTablet for tablet 66f145a7e9214376bc07e0f8d2b82ba2 (DEFAULT_TABLE table=default.Table_97afba45159d435bae3025f31b4472e1 [id=e6755357afce4e388874a25c48ee2ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.167445 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f145a7e9214376bc07e0f8d2b82ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.168378 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 670) took 1076 ms. Trace:
I20260619 19:54:17.168525 897 rpcz_store.cc:276] 0619 19:54:16.092080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.365326 (+273246us) service_pool.cc:224] Handling call
0619 19:54:16.476337 (+111011us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:16.476372 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:16.817518 (+341146us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.066844 (+249326us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:17.168363 (+101519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:17.169243 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 669) took 1077 ms. Trace:
I20260619 19:54:17.170140 893 tablet_service.cc:1511] Processing CreateTablet for tablet e4b2802ecd504e0a8b743e432bfc3fab (DEFAULT_TABLE table=default.Table_3501993f2f45498d8b39e29320e10e04 [id=0fcd3cdc60cd4c33bc173c67273891f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.170604 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b2802ecd504e0a8b743e432bfc3fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.177276 891 tablet_service.cc:1511] Processing CreateTablet for tablet b7ff86ab886e433f9f7b82e70a035415 (DEFAULT_TABLE table=default.Table_f7b3d16eaff643bbba63fc88e5983ccd [id=4c1df4d864b643e59a5e6251cfd6c44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.177769 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ff86ab886e433f9f7b82e70a035415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.179900 3106 tablet.cc:1724] T a6b5f1da20614838aac1a0175ad4a67d P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:17.180474 889 tablet_service.cc:1511] Processing CreateTablet for tablet e6e4c15733c34e66b6bba87bd6b3edf3 (DEFAULT_TABLE table=default.Table_0b53167d2e6c488f9cdb201c78fd2fd1 [id=e6947a23fe8641d9917ae561d36a75cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.180799 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e4c15733c34e66b6bba87bd6b3edf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.181399 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 79bcc998cf6c4d3e851a437ccd2edb92 with delete_type TABLET_DATA_DELETED (replaced by tablet 695da0cfd6e54682b6fad1f3a2ff0ac9) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.181699 884 tablet_service.cc:1511] Processing CreateTablet for tablet 41e34d9261a14baeb78679e6fe5da505 (DEFAULT_TABLE table=default.Table_2f3ca718f1364e56929c805460a6a394 [id=ae580be067b24a7a844f76420f444721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.182004 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e34d9261a14baeb78679e6fe5da505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.187407 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437cebe83301488d9cd7d1b9a1ebef15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.192122 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a331d2baf5d4f3081f9eab3589fddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.192453 890 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 673) took 1100 ms. Trace:
I20260619 19:54:17.192595 890 rpcz_store.cc:276] 0619 19:54:16.092287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.616765 (+524478us) service_pool.cc:224] Handling call
0619 19:54:16.716560 (+ 99795us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:16.716607 (+ 47us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:16.813381 (+ 96774us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.961046 (+147665us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:17.192437 (+231391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:17.193233 890 tablet_service.cc:1511] Processing CreateTablet for tablet efba47405c35417a85690c8c95367ff1 (DEFAULT_TABLE table=default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8 [id=2bf0bd2517724b73b1f5b41bb391449d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.193791 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efba47405c35417a85690c8c95367ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.195168 888 tablet_service.cc:1511] Processing CreateTablet for tablet 73fa6438bb734872a22cf1e8aa80470e (DEFAULT_TABLE table=default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 [id=2413d4206e3e4b1c9b9ace3921450d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.195585 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fa6438bb734872a22cf1e8aa80470e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.197105 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c05b4794d58476895ff0ad66be80fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.200246 1208 tablet_bootstrap.cc:654] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.220158 887 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 668) took 1128 ms. Trace:
I20260619 19:54:17.169370 885 rpcz_store.cc:276] 0619 19:54:16.092029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.193839 (+101810us) service_pool.cc:224] Handling call
0619 19:54:16.195863 (+ 2024us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:16.195909 (+ 46us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:16.598288 (+402379us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.790220 (+191932us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:17.067391 (+277171us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x61800000ed18. stack: 00007ff028f96496 00007ff028f96250 00007ff027fc13ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ff028f8bf2d 00007ff028f8cf9e 00007ff03ce411ad 00007ff03cdc01d3 00007ff038f49609 00007ff038f3d878 00007ff038f3f1bb 00007ff038e8d1e1 00007ff032d266a6 00007ff032d263d5
0619 19:54:17.169229 (+101838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104795520}
W20260619 19:54:17.130077 923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s user 0.004s sys 0.015s
W20260619 19:54:17.224314 923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s user 0.004s sys 0.015s
I20260619 19:54:17.226569 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4f1dad13b920481f96d68e2c13b75d97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.227278 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 86453.3us
W20260619 19:54:17.227438 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c74c898beb54b52999e1c52434b16cf consensus state has no leader
I20260619 19:54:17.227823 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3260b2ff38f7407c9e97eef73d777be8" } modify_external_catalogs: true
I20260619 19:54:17.228058 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3260b2ff38f7407c9e97eef73d777be8" } modify_external_catalogs: true
I20260619 19:54:17.228046 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26af8ab52d470f8bd1b7c42a57e8a3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:17.229118 996 leader_election.cc:343] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.229817 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d99b0cd8fffb481290e112c2b6e82ff4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.230422 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d99b0cd8fffb481290e112c2b6e82ff4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:17.231732 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08344646a1db48f8bd0a41b0cc88ac70 consensus state has no leader
I20260619 19:54:17.232100 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_45a3ba7b76404715ae3b943580b8077d" } modify_external_catalogs: true
I20260619 19:54:17.232249 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_45a3ba7b76404715ae3b943580b8077d" } modify_external_catalogs: true
I20260619 19:54:17.233706 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0d58ce404e2d479c9f54ddaeecc6e402"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.234297 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d58ce404e2d479c9f54ddaeecc6e402 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.236665 3065 tablet.cc:1724] T 9911df524f8948ea8ecce55df0fdd0d6 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:17.237347 3101 tablet.cc:1724] T 9911df524f8948ea8ecce55df0fdd0d6 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:17.248585 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f1dad13b920481f96d68e2c13b75d97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.256913 1200 tablet_bootstrap.cc:492] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:17.257097 1200 ts_tablet_manager.cc:1403] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.176s user 0.007s sys 0.039s
I20260619 19:54:17.257757 1200 raft_consensus.cc:359] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.257923 1200 raft_consensus.cc:385] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.257972 1200 raft_consensus.cc:740] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.258178 1200 consensus_queue.cc:260] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.258639 1200 ts_tablet_manager.cc:1434] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260619 19:54:17.259125 1200 tablet_bootstrap.cc:492] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.260512 1200 tablet_bootstrap.cc:654] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.260726 902 tablet_service.cc:1558] Processing DeleteTablet for tablet f5057229e0d04eafb501356ad8f649ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.265377 1994 ts_tablet_manager.cc:1929] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:17.265621 1994 log.cc:1199] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/8614b0ab1a3749a1a0aa441574f79ab1
I20260619 19:54:17.266376 1994 ts_tablet_manager.cc:1950] T 8614b0ab1a3749a1a0aa441574f79ab1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:17.267676 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 8614b0ab1a3749a1a0aa441574f79ab1 (table default.Table_5b2e48a604b14d41b144c467b1738da5 [id=07abbfb4efc94a4a9104ba6600121313]) successfully deleted
I20260619 19:54:17.275987 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6dcc6a33ac96439d9409ec194b40ab5f
I20260619 19:54:17.277691 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dcc6a33ac96439d9409ec194b40ab5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.281464 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5062c62488f6467a9fbcb70bea9f24f1" } modify_external_catalogs: true
I20260619 19:54:17.281771 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5062c62488f6467a9fbcb70bea9f24f1" } modify_external_catalogs: true
I20260619 19:54:17.283449 1973 ts_tablet_manager.cc:1929] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260619 19:54:17.283623 1973 log.cc:1199] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:17.284389 1973 ts_tablet_manager.cc:1950] T fde2b5d12ab7465791f26d214c2dc2f5 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:17.285107 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 508) took 5806 ms. Trace:
I20260619 19:54:17.285326 1973 rpcz_store.cc:276] 0619 19:54:11.478593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.478643 (+ 50us) service_pool.cc:224] Handling call
0619 19:54:16.807636 (+5328993us) ts_tablet_manager.cc:1151] Deleting tablet fde2b5d12ab7465791f26d214c2dc2f5
0619 19:54:16.807642 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.255634 (+447992us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.283383 (+ 27749us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.285089 (+ 1706us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5328807}
I20260619 19:54:17.286100 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 511) took 5736 ms. Trace:
I20260619 19:54:17.287040 1973 rpcz_store.cc:276] 0619 19:54:11.549359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.549406 (+ 47us) service_pool.cc:224] Handling call
0619 19:54:17.285937 (+5736531us) ts_tablet_manager.cc:1151] Deleting tablet 087630689da0433ab876dcd3cd6bec0f
0619 19:54:17.285950 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.286082 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5736272}
I20260619 19:54:17.287792 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 512) took 5738 ms. Trace:
I20260619 19:54:17.287943 1973 rpcz_store.cc:276] 0619 19:54:11.549450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.549693 (+ 243us) service_pool.cc:224] Handling call
0619 19:54:17.287685 (+5737992us) ts_tablet_manager.cc:1151] Deleting tablet 268c752e60624f96b37b0afab2d994e3
0619 19:54:17.287697 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.287775 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5737841}
I20260619 19:54:17.288341 1973 tablet_replica.cc:333] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:17.288645 1973 raft_consensus.cc:2243] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:17.289057 1973 raft_consensus.cc:2272] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.289917 1973 ts_tablet_manager.cc:1916] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.296279 903 tablet_service.cc:1511] Processing CreateTablet for tablet c5925acc62a846d2b340039d7b02443e (DEFAULT_TABLE table=default.Table_5710399e6e08425593af8f928adeace2 [id=dee6cf21380f42b38625c8a8bce8e6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.296911 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5925acc62a846d2b340039d7b02443e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.297199 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61adf222e10c490c9c8dd6f83edc1643 consensus state has no leader
I20260619 19:54:17.301820 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_069216990ae746dca4b43043b9485658" } modify_external_catalogs: true
I20260619 19:54:17.302095 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_069216990ae746dca4b43043b9485658" } modify_external_catalogs: true
I20260619 19:54:17.305123 892 tablet_service.cc:1511] Processing CreateTablet for tablet 58635330cf29425bbafea95e64bdfbb9 (DEFAULT_TABLE table=default.Table_d27b4fd6fd07484dac45acac41ef8dea [id=c8855e3b5758459fa836ec1d1b4c3bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.305696 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58635330cf29425bbafea95e64bdfbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.313676 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3d262f57d4bd4d469005873c954d1a7a (DEFAULT_TABLE table=default.Table_ba0fc2cf64384072b2f81f7a30526192 [id=936d83b658654ce3b4d440b2db9d125e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.314182 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d262f57d4bd4d469005873c954d1a7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.316640 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_543df7cf4dd94f00b3cb83082b6941d2" } new_table_name: "default.Table_e9ca39e105a54a2298b050c3cdedfdb4" modify_external_catalogs: true
I20260619 19:54:17.292399 742 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 267) took 1010 ms. Trace:
I20260619 19:54:17.299357 3078 raft_consensus.cc:493] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.319378 3078 raft_consensus.cc:515] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.320536 3078 leader_election.cc:290] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.230091 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26af8ab52d470f8bd1b7c42a57e8a3" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:17.320974 742 rpcz_store.cc:276] 0619 19:54:16.282000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.282191 (+ 191us) service_pool.cc:224] Handling call
0619 19:54:16.804444 (+522253us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x6160000c4654. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.292350 (+487906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693572864}
W20260619 19:54:17.321226 996 leader_election.cc:343] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.321355 996 leader_election.cc:304] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:17.321749 3124 raft_consensus.cc:2749] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:17.307225 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 187466us
I20260619 19:54:17.323187 750 tablet_service.cc:1511] Processing CreateTablet for tablet e4b2802ecd504e0a8b743e432bfc3fab (DEFAULT_TABLE table=default.Table_3501993f2f45498d8b39e29320e10e04 [id=0fcd3cdc60cd4c33bc173c67273891f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.323669 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b2802ecd504e0a8b743e432bfc3fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.324802 528 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_289e9a40dfe544978d2b24059317037e [id=1741c78878ea424ebd539cb6fb4aaccc] alter complete (version 2)
I20260619 19:54:17.220284 887 rpcz_store.cc:276] 0619 19:54:16.091971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.572907 (+480936us) service_pool.cc:224] Handling call
0619 19:54:16.748947 (+176040us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:16.748990 (+ 43us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:17.093808 (+344818us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.219949 (+126141us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:17.220115 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:17.325826 887 tablet_service.cc:1511] Processing CreateTablet for tablet 6763e5bd260242b7a4c12eaf6a57507f (DEFAULT_TABLE table=default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.326270 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6763e5bd260242b7a4c12eaf6a57507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.328497 885 tablet_service.cc:1511] Processing CreateTablet for tablet 66e27442d24142b7a3b0d53c0f0d9ded (DEFAULT_TABLE table=default.Table_af8379e2099643ab834cb55af9529eb3 [id=44a8f65f912446f9b75138d8a099320d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.328899 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e27442d24142b7a3b0d53c0f0d9ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.328851 748 tablet_service.cc:1511] Processing CreateTablet for tablet 3d262f57d4bd4d469005873c954d1a7a (DEFAULT_TABLE table=default.Table_ba0fc2cf64384072b2f81f7a30526192 [id=936d83b658654ce3b4d440b2db9d125e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.329211 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d262f57d4bd4d469005873c954d1a7a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.330044 918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s user 0.007s sys 0.012s
W20260619 19:54:17.330133 918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s user 0.007s sys 0.012s
W20260619 19:54:17.231226 919 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.683s user 0.011s sys 0.010s
W20260619 19:54:17.330730 919 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.783s user 0.011s sys 0.010s
I20260619 19:54:17.330722 3124 raft_consensus.cc:493] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.331036 896 tablet_service.cc:1511] Processing CreateTablet for tablet 198c9f7a044c4a62b178a32e562f7168 (DEFAULT_TABLE table=default.Table_01a59125e9354956a7df1f8f0b26b592 [id=c44fdc0b0cb7416eb9c47a3f314f3f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.331290 3124 raft_consensus.cc:515] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.332734 3124 leader_election.cc:290] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.333055 899 tablet_service.cc:1558] Processing DeleteTablet for tablet a1c42c4e323a434bac1f6cb25a1a0281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.333287 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 55404d15d42244c6b42272143c44ff9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.333673 899 tablet_service.cc:1511] Processing CreateTablet for tablet b8bc6173a84f4a5091c9f865cd0037fb (DEFAULT_TABLE table=default.Table_063722268d314b36997cd6b451eae90d [id=c8e717d598254e39b84549546dc08c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.334084 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bc6173a84f4a5091c9f865cd0037fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.307392 778 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.541s user 0.021s sys 0.081s
W20260619 19:54:17.339089 778 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.573s user 0.021s sys 0.081s
W20260619 19:54:17.339427 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 277d68dd1d1d4b8b897f5e0b341ab47e consensus state has no leader
I20260619 19:54:17.343870 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_90338ea3099b45ecb387eadcbeef093b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.344792 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90338ea3099b45ecb387eadcbeef093b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.352458 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.352890 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8a390cfff6c24509ab2a07a622dd7ca9 (DEFAULT_TABLE table=default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.353268 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a390cfff6c24509ab2a07a622dd7ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.357426 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:17.358031 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0a8c49f78e984e1ebd0c4e79a457447c
W20260619 19:54:17.358165 996 leader_election.cc:343] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.360926 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a8c49f78e984e1ebd0c4e79a457447c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.363924 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198c9f7a044c4a62b178a32e562f7168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.365533 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_fcf0a5b39915474cbddeb9fd0cb7efa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.366461 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcf0a5b39915474cbddeb9fd0cb7efa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.368790 752 tablet_service.cc:1511] Processing CreateTablet for tablet e6e4c15733c34e66b6bba87bd6b3edf3 (DEFAULT_TABLE table=default.Table_0b53167d2e6c488f9cdb201c78fd2fd1 [id=e6947a23fe8641d9917ae561d36a75cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.368850 901 tablet_service.cc:1511] Processing CreateTablet for tablet 579567f970874a36b1b89e7d5ff70a1f (DEFAULT_TABLE table=default.Table_370c9e1a3e67410cbb4fec543864ae95 [id=46cd2d6b7e0941618273a466d5387411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.369249 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579567f970874a36b1b89e7d5ff70a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.369503 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 79bcc998cf6c4d3e851a437ccd2edb92 with delete_type TABLET_DATA_DELETED (replaced by tablet 695da0cfd6e54682b6fad1f3a2ff0ac9) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.370157 759 tablet_service.cc:1511] Processing CreateTablet for tablet 41e34d9261a14baeb78679e6fe5da505 (DEFAULT_TABLE table=default.Table_2f3ca718f1364e56929c805460a6a394 [id=ae580be067b24a7a844f76420f444721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.371198 765 tablet_service.cc:1511] Processing CreateTablet for tablet efba47405c35417a85690c8c95367ff1 (DEFAULT_TABLE table=default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8 [id=2bf0bd2517724b73b1f5b41bb391449d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.372149 754 tablet_service.cc:1511] Processing CreateTablet for tablet 73fa6438bb734872a22cf1e8aa80470e (DEFAULT_TABLE table=default.Table_d7e553f15ae24ab3bf8ebd401bc9d588 [id=2413d4206e3e4b1c9b9ace3921450d76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.373054 756 tablet_service.cc:1511] Processing CreateTablet for tablet 66e27442d24142b7a3b0d53c0f0d9ded (DEFAULT_TABLE table=default.Table_af8379e2099643ab834cb55af9529eb3 [id=44a8f65f912446f9b75138d8a099320d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.373692 900 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff01c0de8a540d0a024a4924199ba54 (DEFAULT_TABLE table=default.Table_766549702f124d0286617da3d1fa585c [id=3e15f4bd79fd433590d102806c85fed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.374122 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff01c0de8a540d0a024a4924199ba54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.374250 751 tablet_service.cc:1511] Processing CreateTablet for tablet 198c9f7a044c4a62b178a32e562f7168 (DEFAULT_TABLE table=default.Table_01a59125e9354956a7df1f8f0b26b592 [id=c44fdc0b0cb7416eb9c47a3f314f3f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.375440 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f5057229e0d04eafb501356ad8f649ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.376976 3091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.105.129:58673 (request call id 590) took 1040 ms. Trace:
W20260619 19:54:17.378338 913 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.042s user 0.093s sys 0.194s
I20260619 19:54:17.378533 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d6bc861cb7d941f380671105fd338538
W20260619 19:54:17.378758 913 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.042s user 0.094s sys 0.194s
I20260619 19:54:17.380610 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d6bc861cb7d941f380671105fd338538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.381939 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fa6438bb734872a22cf1e8aa80470e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.387307 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 198c9f7a044c4a62b178a32e562f7168. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.388190 916 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.673s user 0.009s sys 0.006s
W20260619 19:54:17.388276 916 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.673s user 0.009s sys 0.006s
I20260619 19:54:17.391274 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e4c15733c34e66b6bba87bd6b3edf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.395257 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e34d9261a14baeb78679e6fe5da505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.399266 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e27442d24142b7a3b0d53c0f0d9ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.399780 1200 tablet_bootstrap.cc:492] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:17.399958 1200 ts_tablet_manager.cc:1403] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.141s user 0.013s sys 0.033s
I20260619 19:54:17.400851 1200 raft_consensus.cc:359] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:17.401069 1200 raft_consensus.cc:385] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.401144 1200 raft_consensus.cc:740] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.401391 1200 consensus_queue.cc:260] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:17.402024 1200 ts_tablet_manager.cc:1434] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:54:17.402354 1200 tablet_bootstrap.cc:492] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.404268 1200 tablet_bootstrap.cc:654] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.404408 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:17.405150 996 leader_election.cc:343] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.405278 996 leader_election.cc:304] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:17.405656 3124 raft_consensus.cc:2749] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:17.404501 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efba47405c35417a85690c8c95367ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.414801 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c6124626ca3a4af9ba80ea47f707694d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.415526 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6124626ca3a4af9ba80ea47f707694d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.420403 1200 tablet_bootstrap.cc:492] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:17.420569 1200 ts_tablet_manager.cc:1403] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.002s
I20260619 19:54:17.421248 902 tablet_service.cc:1511] Processing CreateTablet for tablet 040c559120d64e06865e82f84b1cdc4e (DEFAULT_TABLE table=default.Table_aece37580b584c31a97b2030aa7f0cf5 [id=553e154e40764fe2990f8b568a1c31d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.421294 1200 raft_consensus.cc:359] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.421456 1200 raft_consensus.cc:385] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.421566 1200 raft_consensus.cc:740] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.421798 1200 consensus_queue.cc:260] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.422282 1200 ts_tablet_manager.cc:1434] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:17.422549 1200 tablet_bootstrap.cc:492] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.424480 1200 tablet_bootstrap.cc:654] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:17.432636 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 79bcc998cf6c4d3e851a437ccd2edb92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79bcc998cf6c4d3e851a437ccd2edb92 already in progress: creating tablet
I20260619 19:54:17.432834 1994 tablet_replica.cc:333] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:17.432950 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f5057229e0d04eafb501356ad8f649ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5057229e0d04eafb501356ad8f649ba already in progress: creating tablet
I20260619 19:54:17.433064 1994 raft_consensus.cc:2243] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
W20260619 19:54:17.433171 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a1c42c4e323a434bac1f6cb25a1a0281 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1c42c4e323a434bac1f6cb25a1a0281 already in progress: creating tablet
W20260619 19:54:17.433395 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 55404d15d42244c6b42272143c44ff9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55404d15d42244c6b42272143c44ff9c already in progress: creating tablet
I20260619 19:54:17.433439 1994 raft_consensus.cc:2272] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.433589 1208 tablet_bootstrap.cc:492] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:17.433727 1208 ts_tablet_manager.cc:1403] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.748s user 0.006s sys 0.004s
I20260619 19:54:17.433992 1994 ts_tablet_manager.cc:1916] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.434587 1208 raft_consensus.cc:359] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.434834 1208 raft_consensus.cc:385] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.435015 1208 raft_consensus.cc:740] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.435292 1208 consensus_queue.cc:260] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.435851 1208 ts_tablet_manager.cc:1434] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:17.436177 1208 tablet_bootstrap.cc:492] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:17.437762 1208 tablet_bootstrap.cc:654] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.439693 758 tablet_service.cc:1511] Processing CreateTablet for tablet c5925acc62a846d2b340039d7b02443e (DEFAULT_TABLE table=default.Table_5710399e6e08425593af8f928adeace2 [id=dee6cf21380f42b38625c8a8bce8e6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.439694 890 tablet_service.cc:1511] Processing CreateTablet for tablet e8c52fca539243069032092b552030f9 (DEFAULT_TABLE table=default.Table_97566a6b6a6041ac9fceff103e3be47b [id=23067799ec0f4b97b8ea5aa4441a1b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.440317 760 tablet_service.cc:1511] Processing CreateTablet for tablet 58635330cf29425bbafea95e64bdfbb9 (DEFAULT_TABLE table=default.Table_d27b4fd6fd07484dac45acac41ef8dea [id=c8855e3b5758459fa836ec1d1b4c3bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.440831 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6763e5bd260242b7a4c12eaf6a57507f (DEFAULT_TABLE table=default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.441236 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a1c42c4e323a434bac1f6cb25a1a0281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.441587 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 55404d15d42244c6b42272143c44ff9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.442034 755 tablet_service.cc:1511] Processing CreateTablet for tablet b8bc6173a84f4a5091c9f865cd0037fb (DEFAULT_TABLE table=default.Table_063722268d314b36997cd6b451eae90d [id=c8e717d598254e39b84549546dc08c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.442421 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 42b0e811cf2a4bf4a23351f9ba5b6173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.442865 749 tablet_service.cc:1511] Processing CreateTablet for tablet 8a390cfff6c24509ab2a07a622dd7ca9 (DEFAULT_TABLE table=default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.443395 764 tablet_service.cc:1511] Processing CreateTablet for tablet 579567f970874a36b1b89e7d5ff70a1f (DEFAULT_TABLE table=default.Table_370c9e1a3e67410cbb4fec543864ae95 [id=46cd2d6b7e0941618273a466d5387411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.445363 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7fecc933f5c14c979a3a376db9937ae0" } new_table_name: "default.Table_57f1f3c6372a48e4b5ea99b90b604d62" modify_external_catalogs: true
I20260619 19:54:17.446776 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_bbe5d19016164023a3cea6a56764f446"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.447299 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbe5d19016164023a3cea6a56764f446 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.455956 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5925acc62a846d2b340039d7b02443e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.458559 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58635330cf29425bbafea95e64bdfbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.461236 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6763e5bd260242b7a4c12eaf6a57507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.462600 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dcc6a33ac96439d9409ec194b40ab5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.462883 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a8c49f78e984e1ebd0c4e79a457447c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.462999 889 tablet_service.cc:1558] Processing DeleteTablet for tablet d6bc861cb7d941f380671105fd338538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.463485 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bc6173a84f4a5091c9f865cd0037fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.467427 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a390cfff6c24509ab2a07a622dd7ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.471381 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579567f970874a36b1b89e7d5ff70a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.476104 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e38fa2f7e9b54b1bb3c659334f43f8d4
I20260619 19:54:17.478143 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.479828 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e73233a773d74ae2b28e0a7f5480cb61" } new_table_name: "default.Table_ab79ed03c01648898d4d85f4c3e51e85" modify_external_catalogs: true
I20260619 19:54:17.481446 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_fd57a3a63b3d4e73a86997c3e9511bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.482044 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd57a3a63b3d4e73a86997c3e9511bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.483917 889 tablet_service.cc:1558] Processing DeleteTablet for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.485325 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 297f07f2d08d47dfa69f845dadb973b1
W20260619 19:54:17.486457 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5eb4005068684928b3b27ff73b108d1b consensus state has no leader
I20260619 19:54:17.487614 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 297f07f2d08d47dfa69f845dadb973b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.489131 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 297f07f2d08d47dfa69f845dadb973b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.490253 528 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_c273513e138d49f4a69189b55f41c410 [id=ae897279d45c4caa8d2b55342f3f79f1] alter complete (version 2)
I20260619 19:54:17.493147 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.493223 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 56640f773efb4123b93f4ca3799ddde7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.495041 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5ca3976b352f4aa78ea89424e5b16739"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.495915 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ca3976b352f4aa78ea89424e5b16739 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.497737 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_59b60a002f8f410484eb04cb5925bb66" } modify_external_catalogs: true
I20260619 19:54:17.497887 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_59b60a002f8f410484eb04cb5925bb66" } modify_external_catalogs: true
I20260619 19:54:17.501012 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_41a860a9f0aa442fa44bb1a677587282" } new_table_name: "default.Table_bb8381daf4be4243a05167e5a12ff7b1" modify_external_catalogs: true
I20260619 19:54:17.377161 3091 rpcz_store.cc:276] 0619 19:54:16.336158 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.336213 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:17.376955 (+1040742us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-copy.queue_time_us":1040491,"threads_started":1}
I20260619 19:54:17.511302 1200 tablet_bootstrap.cc:492] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:17.511339 3124 raft_consensus.cc:493] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.511449 1200 ts_tablet_manager.cc:1403] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.016s
I20260619 19:54:17.511495 3124 raft_consensus.cc:515] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.512099 3124 leader_election.cc:290] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.512095 1200 raft_consensus.cc:359] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.512295 1200 raft_consensus.cc:385] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.512338 1200 raft_consensus.cc:740] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.512496 1200 consensus_queue.cc:260] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.513082 1200 ts_tablet_manager.cc:1434] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:17.513609 1200 tablet_bootstrap.cc:492] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.513798 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5482cf46c91d426484938c387b785d61" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:17.514850 996 leader_election.cc:343] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.514864 2026 rpcz_store.cc:276] 0619 19:54:04.802205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:04.802265 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:15.763959 (+10961694us) ts_tablet_manager.cc:1151] Deleting tablet f305a99e3481419196532cb5c62c2500
0619 19:54:15.763968 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:16.047030 (+283062us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.394377 (+347347us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:16.748804 (+354427us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10913179}
I20260619 19:54:17.515441 1200 tablet_bootstrap.cc:654] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.517201 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet f305a99e3481419196532cb5c62c2500 (table default.Table_1d74433076a3413f90471ec48b668e5f [id=7020f678d0034cd59f74dce2a0ecf0bf]) successfully deleted
I20260619 19:54:17.517692 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5482cf46c91d426484938c387b785d61" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:17.518303 996 leader_election.cc:343] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.518425 996 leader_election.cc:304] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:17.518810 3124 raft_consensus.cc:2749] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:17.519771 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040c559120d64e06865e82f84b1cdc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.532485 759 tablet_service.cc:1511] Processing CreateTablet for tablet 040c559120d64e06865e82f84b1cdc4e (DEFAULT_TABLE table=default.Table_aece37580b584c31a97b2030aa7f0cf5 [id=553e154e40764fe2990f8b568a1c31d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.532899 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040c559120d64e06865e82f84b1cdc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.536762 1973 ts_tablet_manager.cc:1929] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:17.536865 1973 log.cc:1199] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:17.537243 1973 ts_tablet_manager.cc:1950] T 9f6ec149e1ac475f8038b328dae4af2a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:17.541882 720 leader_election.cc:343] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 68788824224b426bb433b87763073bae
W20260619 19:54:17.544100 720 consensus_peers.cc:597] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc5235127fb54d3dba90c9f9f8c134b4. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:17.545043 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 297f07f2d08d47dfa69f845dadb973b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.545358 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.545531 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dcc6a33ac96439d9409ec194b40ab5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.545708 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d6bc861cb7d941f380671105fd338538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.545867 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a8c49f78e984e1ebd0c4e79a457447c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.546332 751 tablet_service.cc:1511] Processing CreateTablet for tablet e8c52fca539243069032092b552030f9 (DEFAULT_TABLE table=default.Table_97566a6b6a6041ac9fceff103e3be47b [id=23067799ec0f4b97b8ea5aa4441a1b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.546797 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c52fca539243069032092b552030f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.549731 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fde2b5d12ab7465791f26d214c2dc2f5 (table default.Table_aa310c6c62a340b3a2a9b00ddad42f22 [id=dbf8a7ab6063477b9e3bd2bd051116bf]) successfully deleted
I20260619 19:54:17.550518 3082 raft_consensus.cc:493] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.550652 3082 raft_consensus.cc:515] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.551054 3089 tablet.cc:1724] T 83452ce6b5b3479b98ea312db05dc651 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:17.551237 3082 leader_election.cc:290] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.551900 3106 tablet.cc:1724] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:17.551961 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 087630689da0433ab876dcd3cd6bec0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 087630689da0433ab876dcd3cd6bec0f already in progress: creating tablet
W20260619 19:54:17.552165 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 268c752e60624f96b37b0afab2d994e3 because the tablet was not found. No further retry: Not found: Tablet not found: 268c752e60624f96b37b0afab2d994e3
I20260619 19:54:17.547047 765 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff01c0de8a540d0a024a4924199ba54 (DEFAULT_TABLE table=default.Table_766549702f124d0286617da3d1fa585c [id=3e15f4bd79fd433590d102806c85fed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.554682 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "774938222588473e90c513232c82aece" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:17.554984 913 raft_consensus.cc:2393] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
W20260619 19:54:17.560125 720 leader_election.cc:343] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:17.568431 3089 tablet.cc:1724] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:17.575469 719 leader_election.cc:343] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 68788824224b426bb433b87763073bae
I20260619 19:54:17.575732 719 leader_election.cc:304] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:17.575855 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 516) took 6026 ms. Trace:
I20260619 19:54:17.576049 3082 raft_consensus.cc:2749] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:17.576887 719 leader_election.cc:304] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:17.577191 3082 raft_consensus.cc:3060] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:17.578217 719 leader_election.cc:343] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:17.578387 719 leader_election.cc:304] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:17.575969 1973 rpcz_store.cc:276] 0619 19:54:11.549763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.549830 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:17.288285 (+5738455us) ts_tablet_manager.cc:1151] Deleting tablet 9f6ec149e1ac475f8038b328dae4af2a
0619 19:54:17.288296 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.529973 (+241677us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.536708 (+ 6735us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.575833 (+ 39125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5738231}
I20260619 19:54:17.579495 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 519) took 6029 ms. Trace:
I20260619 19:54:17.579828 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9f6ec149e1ac475f8038b328dae4af2a (table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]) successfully deleted
I20260619 19:54:17.580127 1973 rpcz_store.cc:276] 0619 19:54:11.550005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.550093 (+ 88us) service_pool.cc:224] Handling call
0619 19:54:17.579338 (+6029245us) ts_tablet_manager.cc:1151] Deleting tablet 0168c82ece6e4ce683265229a5d4c6ea
0619 19:54:17.579354 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.579475 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6029094}
I20260619 19:54:17.580546 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 520) took 6030 ms. Trace:
I20260619 19:54:17.581871 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c52fca539243069032092b552030f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.587206 2953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s user 0.003s sys 0.017s
W20260619 19:54:17.587327 2953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s user 0.003s sys 0.017s
W20260619 19:54:17.587457 917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s user 0.010s sys 0.012s
W20260619 19:54:17.587505 917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s user 0.010s sys 0.012s
W20260619 19:54:17.589732 3048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s user 0.003s sys 0.017s
W20260619 19:54:17.589831 3048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s user 0.003s sys 0.017s
W20260619 19:54:17.589934 3047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s user 0.005s sys 0.015s
W20260619 19:54:17.589977 3047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s user 0.005s sys 0.015s
I20260619 19:54:17.590024 3047 raft_consensus.cc:697] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:17.590288 3047 consensus_queue.cc:237] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:17.590787 1201 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.785s user 0.003s sys 0.020s
W20260619 19:54:17.591809 1201 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.786s user 0.003s sys 0.020s
W20260619 19:54:17.590885 858 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s user 0.005s sys 0.015s
W20260619 19:54:17.592185 858 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s user 0.005s sys 0.015s
W20260619 19:54:17.592365 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 667540us
W20260619 19:54:17.590903 2909 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s user 0.005s sys 0.016s
W20260619 19:54:17.592638 2909 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s user 0.005s sys 0.016s
I20260619 19:54:17.593241 2026 tablet_replica.cc:333] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:17.593465 2026 raft_consensus.cc:2243] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:17.598330 2026 raft_consensus.cc:2272] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.605067 2026 ts_tablet_manager.cc:1916] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:17.607210 422 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-task38CK2r/build/asan/bin/kudu pid 1820: Timed out: CheckLeaks RPC to 127.0.105.188:44433 timed out after 1.000s (SENT)
I20260619 19:54:17.607371 422 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task38CK2r/build/asan/bin/kudu with pid 1820
W20260619 19:54:17.601485 858 consensus_peers.cc:597] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:17.615192 2996 raft_consensus.cc:493] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.615453 2996 raft_consensus.cc:515] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.616343 2996 leader_election.cc:290] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.618144 858 leader_election.cc:304] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:17.622162 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f49aed0b6f9647588f2e3923839b7b92 consensus state has no leader
I20260619 19:54:17.622403 525 master_service.cc:960] ReplaceTablet: received request to replace tablet 8614b0ab1a3749a1a0aa441574f79ab1 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:17.617677 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56640f773efb4123b93f4ca3799ddde7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:17.641618 996 leader_election.cc:343] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.596232 1201 tablet_bootstrap.cc:492] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:17.642195 1201 ts_tablet_manager.cc:1403] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.919s user 0.005s sys 0.021s
W20260619 19:54:17.648161 994 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 19:54:17.649331 516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.105.188:44433 (error 108) [suppressed 8 similar messages]
I20260619 19:54:17.650440 3116 raft_consensus.cc:2749] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:17.651563 1201 raft_consensus.cc:359] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.651849 1201 raft_consensus.cc:385] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.651942 1201 raft_consensus.cc:740] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.652238 1201 consensus_queue.cc:260] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.652838 1201 ts_tablet_manager.cc:1434] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260619 19:54:17.653182 1201 tablet_bootstrap.cc:492] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:17.664958 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:17.677706 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54c9d239a4342bd959810ee017b8dcc consensus state has no leader
W20260619 19:54:17.684965 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e89f230ad9644e8f8bedfb0b54399712 consensus state has no leader
I20260619 19:54:17.688601 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 2 got 0
I20260619 19:54:17.603237 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff01c0de8a540d0a024a4924199ba54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.580718 1973 rpcz_store.cc:276] 0619 19:54:11.550090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.550265 (+ 175us) service_pool.cc:224] Handling call
0619 19:54:17.580443 (+6030178us) ts_tablet_manager.cc:1151] Deleting tablet 71fa4434f83f42d4abacceeb2e816c26
0619 19:54:17.580452 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.580531 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6030046}
I20260619 19:54:17.602713 748 tablet_service.cc:1511] Processing CreateTablet for tablet b7ff86ab886e433f9f7b82e70a035415 (DEFAULT_TABLE table=default.Table_f7b3d16eaff643bbba63fc88e5983ccd [id=4c1df4d864b643e59a5e6251cfd6c44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.692747 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ff86ab886e433f9f7b82e70a035415. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.692813 717 connection.cc:573] client connection to 127.0.105.188:44433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 19:54:17.694000 1208 tablet_bootstrap.cc:492] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:17.694126 1208 ts_tablet_manager.cc:1403] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.258s user 0.003s sys 0.000s
I20260619 19:54:17.694815 1028 tablet_service.cc:1511] Processing CreateTablet for tablet adb07e9a7bf44c49bc0f1cd328dd2b63 (DEFAULT_TABLE table=default.Table_9bca1b1d70944f1fb9df39ee8c10c573 [id=eb074f5bcee441fc8a927537cf8a3653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.695007 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4ccc9079254320bfb917c4b33e2547 (DEFAULT_TABLE table=default.Table_e69c58bd08a44109a5918cbb26e3c33e [id=978b14646c10457ba67e73efd4fad776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.695362 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4ccc9079254320bfb917c4b33e2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.695367 1022 tablet_service.cc:1511] Processing CreateTablet for tablet d45b168c8aeb4789812b236ac33a728f (DEFAULT_TABLE table=default.Table_7786a591827046899d2a6dcb0024ea06 [id=3740109dc5b748c4b036ced9b60a0b5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.695793 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45b168c8aeb4789812b236ac33a728f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.698762 3123 raft_consensus.cc:493] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.698887 3123 raft_consensus.cc:515] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.699295 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb07e9a7bf44c49bc0f1cd328dd2b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.699893 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 518) took 6149 ms. Trace:
I20260619 19:54:17.699982 1973 rpcz_store.cc:276] 0619 19:54:11.549927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.550331 (+ 404us) service_pool.cc:224] Handling call
0619 19:54:17.692581 (+6142250us) ts_tablet_manager.cc:1151] Deleting tablet 01489233bc6f4f8a998fc8d2b8bf70a6
0619 19:54:17.699760 (+ 7179us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.699874 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6142128}
I20260619 19:54:17.700264 1973 tablet_replica.cc:333] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:17.700371 1994 ts_tablet_manager.cc:1929] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:17.700459 1994 log.cc:1199] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:17.700443 1973 raft_consensus.cc:2243] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:17.700608 1973 raft_consensus.cc:2272] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.700790 1994 ts_tablet_manager.cc:1950] T 42b0e811cf2a4bf4a23351f9ba5b6173 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:17.701151 1973 ts_tablet_manager.cc:1916] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.701489 2996 raft_consensus.cc:493] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.701614 2996 raft_consensus.cc:515] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.702255 2996 leader_election.cc:290] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.692942 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56640f773efb4123b93f4ca3799ddde7" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:17.711951 996 leader_election.cc:343] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.712083 996 leader_election.cc:304] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:17.702977 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:17.715660 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0168c82ece6e4ce683265229a5d4c6ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0168c82ece6e4ce683265229a5d4c6ea already in progress: creating tablet
W20260619 19:54:17.715888 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 71fa4434f83f42d4abacceeb2e816c26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71fa4434f83f42d4abacceeb2e816c26 already in progress: creating tablet
W20260619 19:54:17.716037 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 01489233bc6f4f8a998fc8d2b8bf70a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01489233bc6f4f8a998fc8d2b8bf70a6 already in progress: creating tablet
I20260619 19:54:17.718415 759 tablet_service.cc:1511] Processing CreateTablet for tablet adb07e9a7bf44c49bc0f1cd328dd2b63 (DEFAULT_TABLE table=default.Table_9bca1b1d70944f1fb9df39ee8c10c573 [id=eb074f5bcee441fc8a927537cf8a3653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.718374 1025 tablet_service.cc:1511] Processing CreateTablet for tablet d9b2d1e901494d4ca908aa7e4cdca1d8 (DEFAULT_TABLE table=default.Table_54c93ff3c68a4245bf89e0de176cb1fd [id=a60facdaef9349c08fc2bc6708377ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.718905 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb07e9a7bf44c49bc0f1cd328dd2b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.718978 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b2d1e901494d4ca908aa7e4cdca1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.719759 3124 raft_consensus.cc:2749] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:17.721316 3123 leader_election.cc:290] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:17.722520 720 leader_election.cc:343] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 47ace991ad1a4d52ab609940aacf6681
I20260619 19:54:17.723945 1208 raft_consensus.cc:359] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.724146 1208 raft_consensus.cc:385] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.724206 1208 raft_consensus.cc:740] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.724432 1208 consensus_queue.cc:260] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.725047 1208 ts_tablet_manager.cc:1434] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.031s user 0.000s sys 0.002s
I20260619 19:54:17.725370 1208 tablet_bootstrap.cc:492] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:17.726385 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e47c087bc8da4f118bd048c7325411a1 (DEFAULT_TABLE table=default.Table_7a0a87856cb047c79adf3896f5edd0ad [id=af62acd25b374db09cb842380863f292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.726423 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4ccc9079254320bfb917c4b33e2547 (DEFAULT_TABLE table=default.Table_e69c58bd08a44109a5918cbb26e3c33e [id=978b14646c10457ba67e73efd4fad776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.726745 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47c087bc8da4f118bd048c7325411a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.726832 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4ccc9079254320bfb917c4b33e2547. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.733945 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet e89f230ad9644e8f8bedfb0b54399712 (table default.Table_bb8381daf4be4243a05167e5a12ff7b1 [id=537364fb23d046cea541f5fd42dc20d3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e89f230ad9644e8f8bedfb0b54399712 consensus state has no leader
I20260619 19:54:17.735021 1022 tablet_service.cc:1511] Processing CreateTablet for tablet cdddc931d68145819459476666e2ad26 (DEFAULT_TABLE table=default.Table_c19cfd75d3aa41fdb8d781b26abca8d0 [id=594e879fcf4d489081b3688e6393e2e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.735838 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdddc931d68145819459476666e2ad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.578601 3084 raft_consensus.cc:2749] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:17.744722 1028 tablet_service.cc:1511] Processing CreateTablet for tablet de13d06685dd4a188de6ccd8fa786824 (DEFAULT_TABLE table=default.Table_f2841116a1194e7b970b38e4beabd0c9 [id=c5238d2162c8495ba96b9968c0e1d963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.745366 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de13d06685dd4a188de6ccd8fa786824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.751561 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a5e8c1996f334ea5a1af3771ed80c14d (DEFAULT_TABLE table=default.Table_60d77a600a084c169d2df6057f58806c [id=d0fe46d72c3d458c8cec4467fff24565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.752235 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e8c1996f334ea5a1af3771ed80c14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.756049 741 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 269) took 1345 ms. Trace:
I20260619 19:54:17.756129 1200 tablet_bootstrap.cc:492] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:17.756269 1200 ts_tablet_manager.cc:1403] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.243s user 0.022s sys 0.016s
I20260619 19:54:17.756274 741 rpcz_store.cc:276] 0619 19:54:16.410821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.410894 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:17.142752 (+731858us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x616000332254. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.180743 (+ 37991us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x616000340954. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.346772 (+166029us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x616000200854. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.756007 (+409235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098993024}
I20260619 19:54:17.757290 1200 raft_consensus.cc:359] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.693854 902 tablet_service.cc:1511] Processing CreateTablet for tablet adb07e9a7bf44c49bc0f1cd328dd2b63 (DEFAULT_TABLE table=default.Table_9bca1b1d70944f1fb9df39ee8c10c573 [id=eb074f5bcee441fc8a927537cf8a3653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.763557 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb07e9a7bf44c49bc0f1cd328dd2b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.694201 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4ccc9079254320bfb917c4b33e2547 (DEFAULT_TABLE table=default.Table_e69c58bd08a44109a5918cbb26e3c33e [id=978b14646c10457ba67e73efd4fad776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.697398 2026 ts_tablet_manager.cc:1929] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:17.767303 2026 log.cc:1199] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/950b8e74d12f46a68ba5eae3186c87a9
I20260619 19:54:17.767499 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4ccc9079254320bfb917c4b33e2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.767685 2026 ts_tablet_manager.cc:1950] T 950b8e74d12f46a68ba5eae3186c87a9 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:17.768476 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 289) took 12611 ms. Trace:
I20260619 19:54:17.768554 2026 rpcz_store.cc:276] 0619 19:54:05.157103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.157408 (+ 305us) service_pool.cc:224] Handling call
0619 19:54:17.517484 (+12360076us) ts_tablet_manager.cc:1151] Deleting tablet 950b8e74d12f46a68ba5eae3186c87a9
0619 19:54:17.593194 (+ 75710us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.647605 (+ 54411us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.697345 (+ 49740us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.768452 (+ 71107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4535,"tablet-delete.queue_time_us":12321198}
I20260619 19:54:17.768972 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 296) took 12513 ms. Trace:
I20260619 19:54:17.769047 2026 rpcz_store.cc:276] 0619 19:54:05.255902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.259993 (+ 4091us) service_pool.cc:224] Handling call
0619 19:54:17.768849 (+12508856us) ts_tablet_manager.cc:1151] Deleting tablet 1b18a61d955e4929998b90c6c8fa844e
0619 19:54:17.768857 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.768953 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12508608}
I20260619 19:54:17.769315 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 297) took 12513 ms. Trace:
I20260619 19:54:17.769372 2026 rpcz_store.cc:276] 0619 19:54:05.256061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.260442 (+ 4381us) service_pool.cc:224] Handling call
0619 19:54:17.769226 (+12508784us) ts_tablet_manager.cc:1151] Deleting tablet 28a09107b11d480dba8c456fc8753ad1
0619 19:54:17.769233 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.769297 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12508614}
I20260619 19:54:17.769618 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 299) took 12482 ms. Trace:
I20260619 19:54:17.769678 2026 rpcz_store.cc:276] 0619 19:54:05.287081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.287301 (+ 220us) service_pool.cc:224] Handling call
0619 19:54:17.769546 (+12482245us) ts_tablet_manager.cc:1151] Deleting tablet 33935217c1f44ce0ad5b8610d368f2eb
0619 19:54:17.769555 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.769605 (+ 50us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12481986}
I20260619 19:54:17.769872 2026 tablet_replica.cc:333] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:17.770053 2026 raft_consensus.cc:2243] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:17.770179 2026 raft_consensus.cc:2272] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.770659 2026 ts_tablet_manager.cc:1916] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.770769 750 tablet_service.cc:1511] Processing CreateTablet for tablet d45b168c8aeb4789812b236ac33a728f (DEFAULT_TABLE table=default.Table_7786a591827046899d2a6dcb0024ea06 [id=3740109dc5b748c4b036ced9b60a0b5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.707916 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:17.716084 901 tablet_service.cc:1511] Processing CreateTablet for tablet d45b168c8aeb4789812b236ac33a728f (DEFAULT_TABLE table=default.Table_7786a591827046899d2a6dcb0024ea06 [id=3740109dc5b748c4b036ced9b60a0b5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.771754 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45b168c8aeb4789812b236ac33a728f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.772140 756 tablet_service.cc:1511] Processing CreateTablet for tablet cdddc931d68145819459476666e2ad26 (DEFAULT_TABLE table=default.Table_c19cfd75d3aa41fdb8d781b26abca8d0 [id=594e879fcf4d489081b3688e6393e2e0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:17.773909 996 leader_election.cc:343] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.716107 896 tablet_service.cc:1511] Processing CreateTablet for tablet cdddc931d68145819459476666e2ad26 (DEFAULT_TABLE table=default.Table_c19cfd75d3aa41fdb8d781b26abca8d0 [id=594e879fcf4d489081b3688e6393e2e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.718051 900 tablet_service.cc:1511] Processing CreateTablet for tablet e47c087bc8da4f118bd048c7325411a1 (DEFAULT_TABLE table=default.Table_7a0a87856cb047c79adf3896f5edd0ad [id=af62acd25b374db09cb842380863f292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.741997 898 tablet_service.cc:1511] Processing CreateTablet for tablet d9b2d1e901494d4ca908aa7e4cdca1d8 (DEFAULT_TABLE table=default.Table_54c93ff3c68a4245bf89e0de176cb1fd [id=a60facdaef9349c08fc2bc6708377ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.745462 888 tablet_service.cc:1511] Processing CreateTablet for tablet de13d06685dd4a188de6ccd8fa786824 (DEFAULT_TABLE table=default.Table_f2841116a1194e7b970b38e4beabd0c9 [id=c5238d2162c8495ba96b9968c0e1d963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.745461 899 tablet_service.cc:1511] Processing CreateTablet for tablet a5e8c1996f334ea5a1af3771ed80c14d (DEFAULT_TABLE table=default.Table_60d77a600a084c169d2df6057f58806c [id=d0fe46d72c3d458c8cec4467fff24565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.758674 3089 tablet.cc:1724] T c08fc0181e5642d0a2b7967ff30d4eaa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:17.775417 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdddc931d68145819459476666e2ad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.777634 751 tablet_service.cc:1511] Processing CreateTablet for tablet e47c087bc8da4f118bd048c7325411a1 (DEFAULT_TABLE table=default.Table_7a0a87856cb047c79adf3896f5edd0ad [id=af62acd25b374db09cb842380863f292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.779389 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b2d1e901494d4ca908aa7e4cdca1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.780514 1208 tablet_bootstrap.cc:654] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:17.781633 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 950b8e74d12f46a68ba5eae3186c87a9 (table default.Table_36823837347942e5b5cbe3975e6b0ce6 [id=b81cd4dd9a004f89affb658409896b84]) successfully deleted
W20260619 19:54:17.781958 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 28a09107b11d480dba8c456fc8753ad1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28a09107b11d480dba8c456fc8753ad1 already in progress: creating tablet
W20260619 19:54:17.782164 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 33935217c1f44ce0ad5b8610d368f2eb because the tablet was not found. No further retry: Not found: Tablet not found: 33935217c1f44ce0ad5b8610d368f2eb
I20260619 19:54:17.786633 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de13d06685dd4a188de6ccd8fa786824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.787322 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e8c1996f334ea5a1af3771ed80c14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.791356 754 tablet_service.cc:1511] Processing CreateTablet for tablet d9b2d1e901494d4ca908aa7e4cdca1d8 (DEFAULT_TABLE table=default.Table_54c93ff3c68a4245bf89e0de176cb1fd [id=a60facdaef9349c08fc2bc6708377ff9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:17.792886 719 leader_election.cc:343] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 47ace991ad1a4d52ab609940aacf6681
I20260619 19:54:17.793035 719 leader_election.cc:304] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:17.793370 3123 raft_consensus.cc:2749] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:17.795806 3082 raft_consensus.cc:2749] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:17.796695 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 04f3b3b8c8ed484d8faa812e83dc07f9 (DEFAULT_TABLE table=default.Table_19a8a86fcf0842b998d5a19f7d199f35 [id=aa750a04193a4a1fbf6f2d580df7a0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.797145 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f3b3b8c8ed484d8faa812e83dc07f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.802908 1973 ts_tablet_manager.cc:1929] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:17.803172 1973 log.cc:1199] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/71d212a279754f2497ad4fc2a3c8b5c3
I20260619 19:54:17.803639 1973 ts_tablet_manager.cc:1950] T 71d212a279754f2497ad4fc2a3c8b5c3 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:17.804633 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 514) took 6255 ms. Trace:
I20260619 19:54:17.804823 1973 rpcz_store.cc:276] 0619 19:54:11.549611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.550270 (+ 659us) service_pool.cc:224] Handling call
0619 19:54:17.700223 (+6149953us) ts_tablet_manager.cc:1151] Deleting tablet 71d212a279754f2497ad4fc2a3c8b5c3
0619 19:54:17.700232 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.770582 (+ 70350us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.802842 (+ 32260us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.804590 (+ 1748us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6148802}
I20260619 19:54:17.805294 1973 tablet_replica.cc:333] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:17.805558 1973 raft_consensus.cc:2243] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:17.805807 1973 raft_consensus.cc:2272] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.806439 1973 ts_tablet_manager.cc:1916] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.810097 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47c087bc8da4f118bd048c7325411a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.810302 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45b168c8aeb4789812b236ac33a728f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.813831 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdddc931d68145819459476666e2ad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.816148 3115 raft_consensus.cc:493] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.816284 3115 raft_consensus.cc:515] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.816864 3115 leader_election.cc:290] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:17.817859 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841d03189e84deaa036f235946e877a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:17.818117 1054 raft_consensus.cc:2468] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:17.818650 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b2d1e901494d4ca908aa7e4cdca1d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.818673 859 leader_election.cc:304] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:17.818893 3047 raft_consensus.cc:2804] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:17.818970 3047 raft_consensus.cc:493] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:17.819026 3047 raft_consensus.cc:3060] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:17.821224 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47c087bc8da4f118bd048c7325411a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.820137 2026 ts_tablet_manager.cc:1929] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:17.822178 2026 log.cc:1199] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/90b8468df4a449d088f47b3b150ce54a
I20260619 19:54:17.822499 2026 ts_tablet_manager.cc:1950] T 90b8468df4a449d088f47b3b150ce54a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:17.822423 3047 raft_consensus.cc:515] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.825008 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 298) took 12568 ms. Trace:
I20260619 19:54:17.825098 2026 rpcz_store.cc:276] 0619 19:54:05.256157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.332568 (+ 76411us) service_pool.cc:224] Handling call
0619 19:54:17.769840 (+12437272us) ts_tablet_manager.cc:1151] Deleting tablet 90b8468df4a449d088f47b3b150ce54a
0619 19:54:17.769846 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.790715 (+ 20869us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.820090 (+ 29375us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.824984 (+ 4894us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12397797}
I20260619 19:54:17.825448 2026 tablet_replica.cc:333] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:17.825507 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841d03189e84deaa036f235946e877a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:17.825629 2026 raft_consensus.cc:2243] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:17.825582 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 90b8468df4a449d088f47b3b150ce54a (table default.Table_9b463251c2ed4c56aeccc8c045d3dd06 [id=56ee4af476f74b9ab373fb2bfc1c315e]) successfully deleted
I20260619 19:54:17.825677 1054 raft_consensus.cc:3060] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:17.825771 2026 raft_consensus.cc:2272] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.826265 2026 ts_tablet_manager.cc:1916] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.826961 3149 tablet.cc:1724] T c08fc0181e5642d0a2b7967ff30d4eaa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:17.828265 1054 raft_consensus.cc:2468] T 4841d03189e84deaa036f235946e877a P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:17.828671 859 leader_election.cc:304] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:17.823089 3047 leader_election.cc:290] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:17.828926 3115 raft_consensus.cc:2804] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:17.829038 3115 raft_consensus.cc:697] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:17.829270 3115 consensus_queue.cc:237] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.831662 3117 raft_consensus.cc:493] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:17.831840 3117 raft_consensus.cc:515] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.832523 3117 leader_election.cc:290] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:17.834010 859 leader_election.cc:343] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: bf175c80483346788a148b7277b9ca9d
W20260619 19:54:17.834877 859 consensus_peers.cc:597] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b22024a0c434f8e8d4a370dbfb9a4e2. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:17.835386 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 71d212a279754f2497ad4fc2a3c8b5c3 (table default.Table_0761528dd12f4e449282247241577e72 [id=f58a91c6f29e4958b3de00addcb87fec]) successfully deleted
W20260619 19:54:17.837687 858 consensus_peers.cc:597] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:17.802978 765 tablet_service.cc:1511] Processing CreateTablet for tablet de13d06685dd4a188de6ccd8fa786824 (DEFAULT_TABLE table=default.Table_f2841116a1194e7b970b38e4beabd0c9 [id=c5238d2162c8495ba96b9968c0e1d963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.839601 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 58f347b206c34ffd80ff730f238f43aa (DEFAULT_TABLE table=default.Table_ccbefd48bcb945828054aeac735e1750 [id=0fae93bd3be643c49679d0b1e975b250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.840147 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f347b206c34ffd80ff730f238f43aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.848292 744 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 270) took 1252 ms. Trace:
I20260619 19:54:17.848511 744 rpcz_store.cc:276] 0619 19:54:16.595925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.595989 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:17.142973 (+546984us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x616000332254. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.184310 (+ 41337us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x616000340954. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.339684 (+155374us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x616000200854. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.520306 (+180622us) spinlock_profiling.cc:243] Waited 93.3 ms on lock 0x616000335c30. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4e536673 00007eff51060d28 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.848238 (+327932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789387904}
I20260619 19:54:17.852166 1200 raft_consensus.cc:385] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:17.852275 1200 raft_consensus.cc:740] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:17.852502 1200 consensus_queue.cc:260] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.853042 1200 ts_tablet_manager.cc:1434] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.097s user 0.017s sys 0.001s
I20260619 19:54:17.853324 1200 tablet_bootstrap.cc:492] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:17.858592 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_801d5b341fe94df38040e5987a924d1a" } modify_external_catalogs: true
I20260619 19:54:17.858783 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_801d5b341fe94df38040e5987a924d1a" } modify_external_catalogs: true
I20260619 19:54:17.839288 888 tablet_service.cc:1511] Processing CreateTablet for tablet 04f3b3b8c8ed484d8faa812e83dc07f9 (DEFAULT_TABLE table=default.Table_19a8a86fcf0842b998d5a19f7d199f35 [id=aa750a04193a4a1fbf6f2d580df7a0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.860735 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5754e690c96a48968ff02e778777a567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.861272 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5754e690c96a48968ff02e778777a567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.863351 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_62785737f2b84311abc5b0ab6394b5e3" } modify_external_catalogs: true
I20260619 19:54:17.863489 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_62785737f2b84311abc5b0ab6394b5e3" } modify_external_catalogs: true
I20260619 19:54:17.864228 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_97f7804c5583458ca9d73013d1351e6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.864723 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97f7804c5583458ca9d73013d1351e6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.865316 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ed1a0bb02c91457586c92240d93721dd" } new_table_name: "default.Table_589c54e306ea43ea998074767e53995f" modify_external_catalogs: true
I20260619 19:54:17.868348 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ff3a1abe6e54481ebeafa310778691f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.868875 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff3a1abe6e54481ebeafa310778691f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.873979 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_fd82efdfad7d457190095d1d9d0359a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:17.874130 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f3b3b8c8ed484d8faa812e83dc07f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.874490 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd82efdfad7d457190095d1d9d0359a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.881822 3124 raft_consensus.cc:493] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.881978 3124 raft_consensus.cc:515] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.883064 3124 leader_election.cc:290] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.883527 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658e85be0c843f2b02e4567a80521c4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:17.885293 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_02e64fc0947b45c6a2eb8c87da0582d3 [id=1150e278fd3646d9b0897243ff2524d4] alter complete (version 2)
I20260619 19:54:17.886699 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c72c51c230b644f2b000bd9fb1098c44
I20260619 19:54:17.887285 523 master_service.cc:960] ReplaceTablet: received request to replace tablet ee2b48219a234e7daf2a4bc12f250560 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:17.888075 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet f658e85be0c843f2b02e4567a80521c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.888278 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet c72c51c230b644f2b000bd9fb1098c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.888806 890 tablet_service.cc:1558] Processing DeleteTablet for tablet c72c51c230b644f2b000bd9fb1098c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.890563 890 tablet_service.cc:1511] Processing CreateTablet for tablet 58f347b206c34ffd80ff730f238f43aa (DEFAULT_TABLE table=default.Table_ccbefd48bcb945828054aeac735e1750 [id=0fae93bd3be643c49679d0b1e975b250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.890946 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f347b206c34ffd80ff730f238f43aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.891388 899 tablet_service.cc:1511] Processing CreateTablet for tablet 695da0cfd6e54682b6fad1f3a2ff0ac9 (DEFAULT_TABLE table=default.Table_4cd5ba2cc22a454f8607edd045b8e774 [id=44bee1b87a8849d0a9b776bec059c47e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.891692 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695da0cfd6e54682b6fad1f3a2ff0ac9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.891661 996 leader_election.cc:343] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.891794 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 695da0cfd6e54682b6fad1f3a2ff0ac9 (DEFAULT_TABLE table=default.Table_4cd5ba2cc22a454f8607edd045b8e774 [id=44bee1b87a8849d0a9b776bec059c47e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.909015 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f7b3d16eaff643bbba63fc88e5983ccd" } modify_external_catalogs: true
I20260619 19:54:17.909195 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f7b3d16eaff643bbba63fc88e5983ccd" } modify_external_catalogs: true
I20260619 19:54:17.910645 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_60d77a600a084c169d2df6057f58806c" } modify_external_catalogs: true
I20260619 19:54:17.910844 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_60d77a600a084c169d2df6057f58806c" } modify_external_catalogs: true
W20260619 19:54:17.913331 858 leader_election.cc:343] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: bf175c80483346788a148b7277b9ca9d
I20260619 19:54:17.913466 858 leader_election.cc:304] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:17.913663 3047 raft_consensus.cc:2749] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:17.914861 3047 raft_consensus.cc:493] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.914978 3047 raft_consensus.cc:515] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:17.916404 3047 leader_election.cc:290] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:17.918538 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 81ee21d93cf744ff8dcad714ddb369a0 (DEFAULT_TABLE table=default.Table_0bdd74281c9e4f359f9e8ee4ffa72755 [id=6684abb4ebf04d549f86634e3b4b9a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.920406 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3efd4697fa2d43f9a4c62b610d1eb986 (DEFAULT_TABLE table=default.Table_8e63481f54594e328268b598ebc19996 [id=8087abaec33446f3b225ae22c0bd6980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.921103 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 72afb5bbe996484ba77766a463ea15c8 (DEFAULT_TABLE table=default.Table_dfd28dcc8602420fa6d621c66de1acc1 [id=d6d7c1ee4db14fd89293408241d0b83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.921068 890 tablet_service.cc:1511] Processing CreateTablet for tablet 81ee21d93cf744ff8dcad714ddb369a0 (DEFAULT_TABLE table=default.Table_0bdd74281c9e4f359f9e8ee4ffa72755 [id=6684abb4ebf04d549f86634e3b4b9a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.921824 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a2b93b9446934a50ad9f350ea3bf35d8 (DEFAULT_TABLE table=default.Table_dc77ad8e7c564a6d844b4947a687fde0 [id=937df3bf439c4caba7b3bb53eb1c110c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.922232 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ee21d93cf744ff8dcad714ddb369a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.924767 896 tablet_service.cc:1511] Processing CreateTablet for tablet a2b93b9446934a50ad9f350ea3bf35d8 (DEFAULT_TABLE table=default.Table_dc77ad8e7c564a6d844b4947a687fde0 [id=937df3bf439c4caba7b3bb53eb1c110c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.925235 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b93b9446934a50ad9f350ea3bf35d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.925763 899 tablet_service.cc:1511] Processing CreateTablet for tablet 3efd4697fa2d43f9a4c62b610d1eb986 (DEFAULT_TABLE table=default.Table_8e63481f54594e328268b598ebc19996 [id=8087abaec33446f3b225ae22c0bd6980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.926100 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efd4697fa2d43f9a4c62b610d1eb986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.927424 900 tablet_service.cc:1511] Processing CreateTablet for tablet 059819ef54cc4c6ab66cccdbc66fb414 (DEFAULT_TABLE table=default.Table_8c17003f48694476bc969f54bde35f6e [id=f7770cf2c1504b18a8e64613a40f90f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.927467 888 tablet_service.cc:1511] Processing CreateTablet for tablet 72afb5bbe996484ba77766a463ea15c8 (DEFAULT_TABLE table=default.Table_dfd28dcc8602420fa6d621c66de1acc1 [id=d6d7c1ee4db14fd89293408241d0b83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.927750 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059819ef54cc4c6ab66cccdbc66fb414. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:17.928593 859 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:17.929292 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 059819ef54cc4c6ab66cccdbc66fb414 (DEFAULT_TABLE table=default.Table_8c17003f48694476bc969f54bde35f6e [id=f7770cf2c1504b18a8e64613a40f90f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.929657 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 443237fb77ae4ff48c6f64f758b70aa2 (DEFAULT_TABLE table=default.Table_42b8fb62dbca4677a979f1e290505350 [id=0a837b7278d44aa1a08faca843639d53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.929944 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695da0cfd6e54682b6fad1f3a2ff0ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.849217 3123 raft_consensus.cc:493] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.935883 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f87a0e3970cc4123bc7a75db2a63eab1
I20260619 19:54:17.937695 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet f87a0e3970cc4123bc7a75db2a63eab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.938042 3123 raft_consensus.cc:515] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:17.938753 3123 leader_election.cc:290] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.850562 1973 ts_tablet_manager.cc:1929] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:17.938968 1973 log.cc:1199] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/68788824224b426bb433b87763073bae
I20260619 19:54:17.940250 777 raft_consensus.cc:3060] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:17.941625 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443237fb77ae4ff48c6f64f758b70aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.947834 898 tablet_service.cc:1511] Processing CreateTablet for tablet 443237fb77ae4ff48c6f64f758b70aa2 (DEFAULT_TABLE table=default.Table_42b8fb62dbca4677a979f1e290505350 [id=0a837b7278d44aa1a08faca843639d53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.948258 902 tablet_service.cc:1558] Processing DeleteTablet for tablet f87a0e3970cc4123bc7a75db2a63eab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:17.955066 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ee21d93cf744ff8dcad714ddb369a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.959792 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72afb5bbe996484ba77766a463ea15c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.965651 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b93b9446934a50ad9f350ea3bf35d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.968955 3124 raft_consensus.cc:493] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:17.969115 3124 raft_consensus.cc:515] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:17.970372 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f69d2e3ee384eb9997bed7d594c919d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:17.970839 996 leader_election.cc:343] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:17.970966 3124 leader_election.cc:290] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:17.971410 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efd4697fa2d43f9a4c62b610d1eb986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.975524 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059819ef54cc4c6ab66cccdbc66fb414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.979913 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f7f8fcd03be04b6f9d979e221159d073" } new_table_name: "default.Table_4692cafcd97149139d8dda620d16c92c" modify_external_catalogs: true
I20260619 19:54:17.982080 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]) successfully deleted
W20260619 19:54:17.982398 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6dcc6a33ac96439d9409ec194b40ab5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6dcc6a33ac96439d9409ec194b40ab5f already in progress: creating tablet
W20260619 19:54:17.982622 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0a8c49f78e984e1ebd0c4e79a457447c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a8c49f78e984e1ebd0c4e79a457447c already in progress: creating tablet
W20260619 19:54:17.985167 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d6bc861cb7d941f380671105fd338538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6bc861cb7d941f380671105fd338538 already in progress: creating tablet
I20260619 19:54:17.985915 1994 tablet_replica.cc:333] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:17.986132 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e38fa2f7e9b54b1bb3c659334f43f8d4 already in progress: creating tablet
I20260619 19:54:17.986218 1994 raft_consensus.cc:2243] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:17.986428 1994 raft_consensus.cc:2272] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:17.987097 1994 ts_tablet_manager.cc:1916] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.855020 752 tablet_service.cc:1511] Processing CreateTablet for tablet a5e8c1996f334ea5a1af3771ed80c14d (DEFAULT_TABLE table=default.Table_60d77a600a084c169d2df6057f58806c [id=d0fe46d72c3d458c8cec4467fff24565]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.855399 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de13d06685dd4a188de6ccd8fa786824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.871802 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841d03189e84deaa036f235946e877a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:17.872372 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841d03189e84deaa036f235946e877a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:17.992451 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8530dfb740284ad08b498a696d17ef9c
I20260619 19:54:17.874399 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f6ec149e1ac475f8038b328dae4af2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.874811 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f33c2c00b414fbebf1965510e1e2b96 with delete_type TABLET_DATA_DELETED (replaced by tablet cf93b18ae6a44bdb876948d26c4ed087) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:17.876358 748 tablet_service.cc:1511] Processing CreateTablet for tablet 04f3b3b8c8ed484d8faa812e83dc07f9 (DEFAULT_TABLE table=default.Table_19a8a86fcf0842b998d5a19f7d199f35 [id=aa750a04193a4a1fbf6f2d580df7a0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.908564 749 tablet_service.cc:1511] Processing CreateTablet for tablet 58f347b206c34ffd80ff730f238f43aa (DEFAULT_TABLE table=default.Table_ccbefd48bcb945828054aeac735e1750 [id=0fae93bd3be643c49679d0b1e975b250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.994002 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f347b206c34ffd80ff730f238f43aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.909057 758 tablet_service.cc:1511] Processing CreateTablet for tablet 695da0cfd6e54682b6fad1f3a2ff0ac9 (DEFAULT_TABLE table=default.Table_4cd5ba2cc22a454f8607edd045b8e774 [id=44bee1b87a8849d0a9b776bec059c47e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:17.994354 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695da0cfd6e54682b6fad1f3a2ff0ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:17.995966 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_accf378b438e453b85c3fbc643f51b49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:17.996619 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_accf378b438e453b85c3fbc643f51b49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:17.998505 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 8530dfb740284ad08b498a696d17ef9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:17.999190 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 8530dfb740284ad08b498a696d17ef9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:18.002122 3106 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.450s user 0.014s sys 0.029s
I20260619 19:54:18.002820 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ae09ea000f7b4152abf5b57286dc511a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.003479 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae09ea000f7b4152abf5b57286dc511a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.005934 3106 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:56684 (request call id 680) took 2096 ms. Trace:
I20260619 19:54:17.851590 2026 ts_tablet_manager.cc:1929] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:17.859645 1201 tablet_bootstrap.cc:654] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.013778 2026 log.cc:1199] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/774938222588473e90c513232c82aece
I20260619 19:54:18.014393 2026 ts_tablet_manager.cc:1950] T 774938222588473e90c513232c82aece P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:18.021625 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e244971a6b0b424db6d16d233b32a96e consensus state has no leader
I20260619 19:54:18.023774 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_249836bd3ffd4db8ac846ceca943afd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.024410 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_249836bd3ffd4db8ac846ceca943afd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.025473 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443237fb77ae4ff48c6f64f758b70aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.027628 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 305) took 12520 ms. Trace:
I20260619 19:54:18.027712 2026 rpcz_store.cc:276] 0619 19:54:05.507529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.507592 (+ 63us) service_pool.cc:224] Handling call
0619 19:54:17.825383 (+12317791us) ts_tablet_manager.cc:1151] Deleting tablet 774938222588473e90c513232c82aece
0619 19:54:17.825395 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.837328 (+ 11933us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.851520 (+ 14192us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.027610 (+176090us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12220199}
I20260619 19:54:18.028272 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 774938222588473e90c513232c82aece (table default.Table_acb740f517fd4c61bff72f7ceafb5f75 [id=7f73d9f5b89c4d5798cb7f9d95595c8f]) successfully deleted
I20260619 19:54:18.031428 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72afb5bbe996484ba77766a463ea15c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.040475 3048 raft_consensus.cc:493] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.040683 3048 raft_consensus.cc:515] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.041496 3048 leader_election.cc:290] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.042589 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_97b547a957704426af6c457046bbcf5d" } new_table_name: "default.Table_64418f1228984a90b955d7914dc37eaf" modify_external_catalogs: true
W20260619 19:54:18.042783 859 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b2902c7f67a1402987315ee426ddf1d2
I20260619 19:54:18.045418 2026 tablet_replica.cc:333] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:18.046041 1200 tablet_bootstrap.cc:654] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.046515 2026 raft_consensus.cc:2243] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.054286 2026 raft_consensus.cc:2272] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.057240 2026 ts_tablet_manager.cc:1916] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:17.910018 1208 tablet_bootstrap.cc:492] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.062006 1208 ts_tablet_manager.cc:1403] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.337s user 0.003s sys 0.005s
I20260619 19:54:18.063369 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ee2b48219a234e7daf2a4bc12f250560
I20260619 19:54:18.063853 523 catalog_manager.cc:6784] ReplaceTablet: tablet ee2b48219a234e7daf2a4bc12f250560 deleted and replaced by tablet d417d9fa7fd44fd4b5d477e6628e5c0e
I20260619 19:54:18.066913 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_706383ef26e64f13b4c2c1ebbb8ad502"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.067616 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_706383ef26e64f13b4c2c1ebbb8ad502 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.068588 1973 ts_tablet_manager.cc:1950] T 68788824224b426bb433b87763073bae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.069032 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 517) took 6519 ms. Trace:
I20260619 19:54:18.064800 896 tablet_service.cc:1558] Processing DeleteTablet for tablet ee2b48219a234e7daf2a4bc12f250560 with delete_type TABLET_DATA_DELETED (replaced by tablet d417d9fa7fd44fd4b5d477e6628e5c0e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.071470 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c72c51c230b644f2b000bd9fb1098c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.069114 1973 rpcz_store.cc:276] 0619 19:54:11.549855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.551469 (+ 1614us) service_pool.cc:224] Handling call
0619 19:54:17.805211 (+6253742us) ts_tablet_manager.cc:1151] Deleting tablet 68788824224b426bb433b87763073bae
0619 19:54:17.805223 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:17.814153 (+ 8930us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:17.850479 (+ 36326us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.069013 (+218534us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6253580}
I20260619 19:54:18.071889 1973 tablet_replica.cc:333] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:18.072070 1973 raft_consensus.cc:2243] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:18.072361 1973 pending_rounds.cc:70] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:18.072413 1973 pending_rounds.cc:77] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657698024730624 op_type: NO_OP noop_request { }
I20260619 19:54:18.072515 1973 raft_consensus.cc:2889] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:18.072594 1973 raft_consensus.cc:2272] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.072952 751 tablet_service.cc:1511] Processing CreateTablet for tablet 3efd4697fa2d43f9a4c62b610d1eb986 (DEFAULT_TABLE table=default.Table_8e63481f54594e328268b598ebc19996 [id=8087abaec33446f3b225ae22c0bd6980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.074932 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e65ca84182d40c280ec2b0555c0de86" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:18.075860 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f3b3b8c8ed484d8faa812e83dc07f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.076381 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ee2b48219a234e7daf2a4bc12f250560 with delete_type TABLET_DATA_DELETED (replaced by tablet d417d9fa7fd44fd4b5d477e6628e5c0e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.076683 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efd4697fa2d43f9a4c62b610d1eb986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.077423 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e8c1996f334ea5a1af3771ed80c14d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.079874 1973 ts_tablet_manager.cc:1916] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:18.080591 3138 log.cc:927] Time spent T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260619 19:54:18.087476 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b7ff86ab886e433f9f7b82e70a035415
I20260619 19:54:18.087560 755 tablet_service.cc:1511] Processing CreateTablet for tablet 81ee21d93cf744ff8dcad714ddb369a0 (DEFAULT_TABLE table=default.Table_0bdd74281c9e4f359f9e8ee4ffa72755 [id=6684abb4ebf04d549f86634e3b4b9a6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.087589 760 tablet_service.cc:1511] Processing CreateTablet for tablet 72afb5bbe996484ba77766a463ea15c8 (DEFAULT_TABLE table=default.Table_dfd28dcc8602420fa6d621c66de1acc1 [id=d6d7c1ee4db14fd89293408241d0b83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.088122 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72afb5bbe996484ba77766a463ea15c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.088788 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ee21d93cf744ff8dcad714ddb369a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.090428 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ac203b76f07042c79ac356c1c30c2156" } new_table_name: "default.Table_60a3c65991ed4fadb3f5a81fa864b3a7" modify_external_catalogs: true
I20260619 19:54:18.100225 754 tablet_service.cc:1511] Processing CreateTablet for tablet 059819ef54cc4c6ab66cccdbc66fb414 (DEFAULT_TABLE table=default.Table_8c17003f48694476bc969f54bde35f6e [id=f7770cf2c1504b18a8e64613a40f90f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.100724 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059819ef54cc4c6ab66cccdbc66fb414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.101423 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ff86ab886e433f9f7b82e70a035415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:18.101495 996 leader_election.cc:343] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.101624 996 leader_election.cc:304] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:18.101992 3124 raft_consensus.cc:2749] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.107877 751 tablet_service.cc:1558] Processing DeleteTablet for tablet f87a0e3970cc4123bc7a75db2a63eab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.006050 3106 rpcz_store.cc:276] 0619 19:54:15.909566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.912869 (+ 3303us) service_pool.cc:224] Handling call
0619 19:54:18.005912 (+2093043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:15.913337 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0619 19:54:15.913452 (+ 115us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0619 19:54:15.913461 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0619 19:54:15.913482 (+ 21us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0619 19:54:15.913526 (+ 44us) alter_schema_op.cc:128] START. Timestamp: 1781898855913459
0619 19:54:15.913530 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:15.913711 (+ 181us) log.cc:844] Serialized 173 byte log entry
0619 19:54:17.551734 (+1638023us) op_driver.cc:464] REPLICATION: finished
0619 19:54:17.551883 (+ 149us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0619 19:54:17.552238 (+ 355us) log.cc:844] Serialized 5 byte log entry
0619 19:54:18.005486 (+453248us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.005745 (+ 259us) log.cc:844] Serialized 14 byte log entry
0619 19:54:18.005867 (+ 122us) alter_schema_op.cc:73] Released schema lock
0619 19:54:18.005871 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":97,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":10301,"prepare.run_wall_time_us":138233,"raft.queue_time_us":51,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1638170,"thread_start_us":587361,"threads_started":2,"wal-append.queue_time_us":474075,"wal-append.run_cpu_time_us":503,"wal-append.run_wall_time_us":1001745}]]}
I20260619 19:54:18.111207 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 8530dfb740284ad08b498a696d17ef9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.111311 764 tablet_service.cc:1511] Processing CreateTablet for tablet 443237fb77ae4ff48c6f64f758b70aa2 (DEFAULT_TABLE table=default.Table_42b8fb62dbca4677a979f1e290505350 [id=0a837b7278d44aa1a08faca843639d53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.111805 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443237fb77ae4ff48c6f64f758b70aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.117014 888 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ff86ab886e433f9f7b82e70a035415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.118834 1208 raft_consensus.cc:359] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.118469 756 tablet_service.cc:1511] Processing CreateTablet for tablet a2b93b9446934a50ad9f350ea3bf35d8 (DEFAULT_TABLE table=default.Table_dc77ad8e7c564a6d844b4947a687fde0 [id=937df3bf439c4caba7b3bb53eb1c110c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.119022 1208 raft_consensus.cc:385] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.119072 1208 raft_consensus.cc:740] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.119328 1208 consensus_queue.cc:260] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.123932 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b93b9446934a50ad9f350ea3bf35d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.124579 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a5e8c1996f334ea5a1af3771ed80c14d
I20260619 19:54:18.126037 888 tablet_service.cc:1558] Processing DeleteTablet for tablet a5e8c1996f334ea5a1af3771ed80c14d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.126348 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a5e8c1996f334ea5a1af3771ed80c14d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.128667 1201 tablet_bootstrap.cc:492] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:18.128842 1201 ts_tablet_manager.cc:1403] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.476s user 0.009s sys 0.004s
I20260619 19:54:18.135208 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658e85be0c843f2b02e4567a80521c4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.139432 1208 ts_tablet_manager.cc:1434] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.077s user 0.002s sys 0.000s
I20260619 19:54:18.139792 1208 tablet_bootstrap.cc:492] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.140313 1994 ts_tablet_manager.cc:1929] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:18.141664 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 68788824224b426bb433b87763073bae (table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]) successfully deleted
I20260619 19:54:18.142371 743 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:49740 (request call id 271) took 1097 ms. Trace:
I20260619 19:54:18.142738 778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.142688 1201 raft_consensus.cc:359] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.142915 778 raft_consensus.cc:2468] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:18.143081 1201 raft_consensus.cc:385] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.143239 1201 raft_consensus.cc:740] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.143499 1201 consensus_queue.cc:260] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.143815 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e65ca84182d40c280ec2b0555c0de86" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:18.144142 858 leader_election.cc:343] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:18.144479 858 leader_election.cc:343] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.144821 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_26e4f1885f51419ca85efa668d514121"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.145435 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26e4f1885f51419ca85efa668d514121 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.146008 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a5e8c1996f334ea5a1af3771ed80c14d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.146719 3076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "031619d60e724837bd292c5ce23d0aff" member_type: VOTER last_known_addr { host: "127.0.105.190" port: 46791 } } peers { permanent_uuid: "6cc90ee2d59d4dddae6790dd92b20cb5" member_type: VOTER last_known_addr { host: "127.0.105.189" port: 45849 } } peers { permanent_uuid: "2d38b77ff37948e19592b36b6d884fe0" member_type: VOTER last_known_addr { host: "127.0.105.188" port: 44433 } } }
I20260619 19:54:18.146896 3076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 [sys.catalog]: This master's current role is: LEADER
I20260619 19:54:18.144182 1201 ts_tablet_manager.cc:1434] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260619 19:54:18.149884 1201 tablet_bootstrap.cc:492] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:18.151435 858 leader_election.cc:343] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:18.151568 858 leader_election.cc:304] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.151819 783 raft_consensus.cc:3060] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.151965 858 leader_election.cc:304] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.152444 3048 raft_consensus.cc:2749] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.152616 3048 raft_consensus.cc:2804] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:18.142462 743 rpcz_store.cc:276] 0619 19:54:17.045205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.045279 (+ 74us) service_pool.cc:224] Handling call
0619 19:54:17.146883 (+101604us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x616000332254. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:17.355085 (+208202us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x616000200854. stack: 00007eff4113a496 00007eff4113a250 00007eff401653ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007eff4d1af8c0 00007eff51060f1f 00007eff4b482c36 00007eff4b482965 00007eff4824488e 00007eff4824376e 00007eff482499a8 00007eff4824a30f 00007eff4824a138 0000000000aa681c
0619 19:54:18.142320 (+787235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315995264}
I20260619 19:54:18.152679 3048 raft_consensus.cc:493] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:18.152742 3048 raft_consensus.cc:3060] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:18.156076 3048 raft_consensus.cc:515] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.157158 3048 leader_election.cc:290] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:18.160199 859 leader_election.cc:343] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b2902c7f67a1402987315ee426ddf1d2
I20260619 19:54:18.154661 1200 tablet_bootstrap.cc:492] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.162573 1994 log.cc:1199] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/297f07f2d08d47dfa69f845dadb973b1
I20260619 19:54:18.163533 1994 ts_tablet_manager.cc:1950] T 297f07f2d08d47dfa69f845dadb973b1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.162580 1200 ts_tablet_manager.cc:1403] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.309s user 0.003s sys 0.003s
I20260619 19:54:18.164533 1200 raft_consensus.cc:359] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.164705 1200 raft_consensus.cc:385] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.164752 1200 raft_consensus.cc:740] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:18.166509 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 60495.5us
I20260619 19:54:18.168263 1201 tablet_bootstrap.cc:654] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.172392 749 tablet_service.cc:1558] Processing DeleteTablet for tablet ee2b48219a234e7daf2a4bc12f250560 with delete_type TABLET_DATA_DELETED (replaced by tablet d417d9fa7fd44fd4b5d477e6628e5c0e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.172719 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_069216990ae746dca4b43043b9485658 [id=8d6402c45a4d4456935a213be45b3c51]) successfully deleted
I20260619 19:54:18.173477 1994 tablet_replica.cc:333] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.173834 1994 raft_consensus.cc:2243] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.174121 1994 raft_consensus.cc:2272] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.174911 1994 ts_tablet_manager.cc:1916] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:18.178849 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8614b0ab1a3749a1a0aa441574f79ab1 because the tablet was not found. No further retry: Not found: Tablet not found: 8614b0ab1a3749a1a0aa441574f79ab1
W20260619 19:54:18.184257 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34f19f5ac03446a89376695b8321e820 consensus state has no leader
I20260619 19:54:18.185252 3123 raft_consensus.cc:493] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.188119 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0d01627300e842e2b4a9b29e3e8aebaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.188741 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d01627300e842e2b4a9b29e3e8aebaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.189292 1994 ts_tablet_manager.cc:1929] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.189437 1994 log.cc:1199] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/56640f773efb4123b93f4ca3799ddde7
I20260619 19:54:18.189792 1994 ts_tablet_manager.cc:1950] T 56640f773efb4123b93f4ca3799ddde7 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.192423 3084 raft_consensus.cc:493] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:18.192610 3084 raft_consensus.cc:515] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.191300 1200 consensus_queue.cc:260] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.197111 1200 ts_tablet_manager.cc:1434] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260619 19:54:18.197647 1200 tablet_bootstrap.cc:492] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.199754 1200 tablet_bootstrap.cc:654] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.201282 1973 ts_tablet_manager.cc:1929] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:18.201419 1973 log.cc:1199] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/4b88dd7d19514e83857e2c6108291b9f
I20260619 19:54:18.185422 3123 raft_consensus.cc:515] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.211272 1973 ts_tablet_manager.cc:1950] T 4b88dd7d19514e83857e2c6108291b9f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.211968 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d7e553f15ae24ab3bf8ebd401bc9d588" } new_table_name: "default.Table_4b9fd6f50344489a81ea2af1ce385d37" modify_external_catalogs: true
I20260619 19:54:18.211274 719 leader_election.cc:304] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.214452 3084 leader_election.cc:290] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.215339 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f69d2e3ee384eb9997bed7d594c919d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:18.215989 720 leader_election.cc:343] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:54:18.219337 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 515) took 6669 ms. Trace:
I20260619 19:54:18.219460 1973 rpcz_store.cc:276] 0619 19:54:11.549687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.555194 (+ 5507us) service_pool.cc:224] Handling call
0619 19:54:18.071842 (+6516648us) ts_tablet_manager.cc:1151] Deleting tablet 4b88dd7d19514e83857e2c6108291b9f
0619 19:54:18.071853 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.145146 (+ 73293us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.166255 (+ 21109us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.219317 (+ 53062us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6516465}
I20260619 19:54:18.219947 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 524) took 6652 ms. Trace:
I20260619 19:54:18.220042 1973 rpcz_store.cc:276] 0619 19:54:11.567322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.567378 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:18.219806 (+6652428us) ts_tablet_manager.cc:1151] Deleting tablet 6f2a8462edb54df2aa0343ecea6dd761
0619 19:54:18.219818 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.219930 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6652167}
I20260619 19:54:18.220397 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 528) took 6381 ms. Trace:
I20260619 19:54:18.220468 1973 rpcz_store.cc:276] 0619 19:54:11.839205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:11.843661 (+ 4456us) service_pool.cc:224] Handling call
0619 19:54:18.220295 (+6376634us) ts_tablet_manager.cc:1151] Deleting tablet 8c10ee4d02fa48fdb10e3e5110f85cad
0619 19:54:18.220306 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.220382 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6376337}
I20260619 19:54:18.220793 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 541) took 6044 ms. Trace:
I20260619 19:54:18.220863 1973 rpcz_store.cc:276] 0619 19:54:12.176434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.176645 (+ 211us) service_pool.cc:224] Handling call
0619 19:54:18.220689 (+6044044us) ts_tablet_manager.cc:1151] Deleting tablet ca02c454eec840eb9289950b6da7b131
0619 19:54:18.220700 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.220778 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6043695}
I20260619 19:54:18.221210 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 542) took 6044 ms. Trace:
I20260619 19:54:18.221284 1973 rpcz_store.cc:276] 0619 19:54:12.176577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.213113 (+ 36536us) service_pool.cc:224] Handling call
0619 19:54:18.221104 (+6007991us) ts_tablet_manager.cc:1151] Deleting tablet 1ded605c2edc4c2fb138d07dea4a14b4
0619 19:54:18.221115 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.221193 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6007671}
I20260619 19:54:18.221611 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 543) took 6007 ms. Trace:
I20260619 19:54:18.221688 1973 rpcz_store.cc:276] 0619 19:54:12.213698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.214027 (+ 329us) service_pool.cc:224] Handling call
0619 19:54:18.221507 (+6007480us) ts_tablet_manager.cc:1151] Deleting tablet d400ef98ca5d4aad95051cf2edab9f26
0619 19:54:18.221518 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.221594 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6007298}
I20260619 19:54:18.222043 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 544) took 6007 ms. Trace:
I20260619 19:54:18.222118 1973 rpcz_store.cc:276] 0619 19:54:12.214390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.214763 (+ 373us) service_pool.cc:224] Handling call
0619 19:54:18.221923 (+6007160us) ts_tablet_manager.cc:1151] Deleting tablet b8f22a48856a436a9a5abcd9cae20620
0619 19:54:18.221932 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.222024 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6006987}
I20260619 19:54:18.222443 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 545) took 6007 ms. Trace:
I20260619 19:54:18.222512 1973 rpcz_store.cc:276] 0619 19:54:12.215279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.231109 (+ 15830us) service_pool.cc:224] Handling call
0619 19:54:18.222344 (+5991235us) ts_tablet_manager.cc:1151] Deleting tablet dfb556a60a9749a2889ad84db2294f8e
0619 19:54:18.222354 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.222428 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5983218}
I20260619 19:54:18.222841 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 546) took 5991 ms. Trace:
I20260619 19:54:18.222913 1973 rpcz_store.cc:276] 0619 19:54:12.231493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.235275 (+ 3782us) service_pool.cc:224] Handling call
0619 19:54:18.222740 (+5987465us) ts_tablet_manager.cc:1151] Deleting tablet 9d44344339f34866bab486a5abf104e9
0619 19:54:18.222750 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.222825 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5971384}
I20260619 19:54:18.225656 3123 leader_election.cc:290] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:18.227267 720 leader_election.cc:343] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d703c5c2820642aab6dd1e500ce1e9fd
W20260619 19:54:18.231760 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 79993us
I20260619 19:54:18.232600 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 4b88dd7d19514e83857e2c6108291b9f (table default.Table_5ab0c5d77506466ebc58898ec783e478 [id=9109c9aa5b7547c08b940e8793c7964f]) successfully deleted
W20260619 19:54:18.232854 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6f2a8462edb54df2aa0343ecea6dd761 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2a8462edb54df2aa0343ecea6dd761 already in progress: creating tablet
W20260619 19:54:18.233084 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8c10ee4d02fa48fdb10e3e5110f85cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c10ee4d02fa48fdb10e3e5110f85cad already in progress: creating tablet
W20260619 19:54:18.233278 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ca02c454eec840eb9289950b6da7b131 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca02c454eec840eb9289950b6da7b131 already in progress: creating tablet
W20260619 19:54:18.233481 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1ded605c2edc4c2fb138d07dea4a14b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ded605c2edc4c2fb138d07dea4a14b4 already in progress: creating tablet
W20260619 19:54:18.233670 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d400ef98ca5d4aad95051cf2edab9f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d400ef98ca5d4aad95051cf2edab9f26 already in progress: creating tablet
W20260619 19:54:18.233899 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b8f22a48856a436a9a5abcd9cae20620 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8f22a48856a436a9a5abcd9cae20620 already in progress: creating tablet
W20260619 19:54:18.234094 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet dfb556a60a9749a2889ad84db2294f8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb556a60a9749a2889ad84db2294f8e already in progress: creating tablet
W20260619 19:54:18.234297 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9d44344339f34866bab486a5abf104e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d44344339f34866bab486a5abf104e9 already in progress: creating tablet
I20260619 19:54:18.234279 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:18.235021 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2902c7f67a1402987315ee426ddf1d2" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:18.235244 774 raft_consensus.cc:3060] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:54:18.235297 719 leader_election.cc:343] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: d703c5c2820642aab6dd1e500ce1e9fd
I20260619 19:54:18.235402 719 leader_election.cc:304] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.235671 3123 raft_consensus.cc:2749] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.237254 719 leader_election.cc:304] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.237498 3123 raft_consensus.cc:2749] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:18.237531 2026 ts_tablet_manager.cc:1929] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:18.237639 2026 log.cc:1199] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/79f8635b919a44a8a1e5fe48420ca4b7
I20260619 19:54:18.237995 2026 ts_tablet_manager.cc:1950] T 79f8635b919a44a8a1e5fe48420ca4b7 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:18.238214 1973 tablet_replica.cc:333] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:18.238608 3047 raft_consensus.cc:493] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:18.238735 3047 raft_consensus.cc:515] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.239580 3047 leader_election.cc:290] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.239943 1973 raft_consensus.cc:2243] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.240058 2996 raft_consensus.cc:493] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.240182 2996 raft_consensus.cc:515] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.240733 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ff86ab886e433f9f7b82e70a035415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:17 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.240847 2996 leader_election.cc:290] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.242074 1208 tablet_bootstrap.cc:654] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:18.243481 859 leader_election.cc:343] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:54:18.244230 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2939b8aa0d44ad2a05a933db4ea64be" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:18.252418 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.252627 775 raft_consensus.cc:2468] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:18.253014 858 leader_election.cc:304] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.253786 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 15b81edd27d14611b3a66c547117c532 from {username='slave'} at 127.0.0.1:37030
W20260619 19:54:18.254715 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c34d1212487348ceae8c58e5c09740cc consensus state has no leader
I20260619 19:54:18.254844 3047 raft_consensus.cc:2804] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:18.254920 3047 raft_consensus.cc:493] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:18.254997 3047 raft_consensus.cc:3060] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:18.255555 1973 raft_consensus.cc:2272] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.255743 3082 raft_consensus.cc:2749] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.256258 775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2939b8aa0d44ad2a05a933db4ea64be" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.257170 1973 ts_tablet_manager.cc:1916] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.258440 3047 raft_consensus.cc:515] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.260265 1994 tablet_replica.cc:333] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.260356 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 56640f773efb4123b93f4ca3799ddde7 (table default.Table_dac857d85b7e4b748ff854769df04686 [id=628e260ecd874610b88e42ddd8bf62e1]) successfully deleted
I20260619 19:54:18.260461 1994 raft_consensus.cc:2243] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.260635 1994 raft_consensus.cc:2272] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.261199 1994 ts_tablet_manager.cc:1916] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:18.261308 859 leader_election.cc:343] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:54:18.261471 3047 leader_election.cc:290] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.261862 1201 tablet_bootstrap.cc:492] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:18.262216 1201 ts_tablet_manager.cc:1403] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.007s
I20260619 19:54:18.263181 1201 raft_consensus.cc:359] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.263553 1201 raft_consensus.cc:385] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.263671 1201 raft_consensus.cc:740] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.264230 1201 consensus_queue.cc:260] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.265803 1200 tablet_bootstrap.cc:492] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.265935 1200 ts_tablet_manager.cc:1403] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260619 19:54:18.266726 1200 raft_consensus.cc:359] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.266863 1200 raft_consensus.cc:385] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.266904 1200 raft_consensus.cc:740] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.267112 1200 consensus_queue.cc:260] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.267735 1200 ts_tablet_manager.cc:1434] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:18.267969 1200 tablet_bootstrap.cc:492] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.269538 1200 tablet_bootstrap.cc:654] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.271945 1201 ts_tablet_manager.cc:1434] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:54:18.273443 1201 tablet_bootstrap.cc:492] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:18.274024 1994 ts_tablet_manager.cc:1929] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.274127 1994 log.cc:1199] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f658e85be0c843f2b02e4567a80521c4
I20260619 19:54:18.274405 1994 ts_tablet_manager.cc:1950] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.275075 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f658e85be0c843f2b02e4567a80521c4 (table default.Table_b79ac240d4f14940b5676186655549bc [id=303a823bc9844cc28a07eb1f14617bc8]) successfully deleted
W20260619 19:54:18.277529 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c72c51c230b644f2b000bd9fb1098c44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c72c51c230b644f2b000bd9fb1098c44 already in progress: creating tablet
W20260619 19:54:18.277777 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f87a0e3970cc4123bc7a75db2a63eab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f87a0e3970cc4123bc7a75db2a63eab1 already in progress: creating tablet
I20260619 19:54:18.277858 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fb6712fc0994154aa5022ec16cec1ae" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:18.277976 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8530dfb740284ad08b498a696d17ef9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8530dfb740284ad08b498a696d17ef9c already in progress: creating tablet
I20260619 19:54:18.278079 777 raft_consensus.cc:3060] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
W20260619 19:54:18.278143 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ee2b48219a234e7daf2a4bc12f250560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee2b48219a234e7daf2a4bc12f250560 already in progress: creating tablet
W20260619 19:54:18.278319 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b7ff86ab886e433f9f7b82e70a035415 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7ff86ab886e433f9f7b82e70a035415 already in progress: creating tablet
I20260619 19:54:18.281984 1201 tablet_bootstrap.cc:654] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:18.282791 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a5e8c1996f334ea5a1af3771ed80c14d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5e8c1996f334ea5a1af3771ed80c14d already in progress: creating tablet
W20260619 19:54:18.283953 971 tablet.cc:2406] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:54:18.284742 774 raft_consensus.cc:2468] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 2.
I20260619 19:54:18.289223 858 leader_election.cc:304] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.290207 3047 raft_consensus.cc:2804] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:18.291626 3047 raft_consensus.cc:697] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:18.291989 3047 consensus_queue.cc:237] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.294651 422 external_mini_cluster.cc:1372] Running /tmp/dist-test-task38CK2r/build/asan/bin/kudu
/tmp/dist-test-task38CK2r/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:44433
--webserver_interface=127.0.105.188
--webserver_port=42109
--builtin_ntp_servers=127.0.105.148:38937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 19:54:18.296864 1200 tablet_bootstrap.cc:492] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.297031 1200 ts_tablet_manager.cc:1403] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.012s
I20260619 19:54:18.298018 1200 raft_consensus.cc:359] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.298194 1200 raft_consensus.cc:385] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.298244 1200 raft_consensus.cc:740] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.298446 1200 consensus_queue.cc:260] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.298978 1200 ts_tablet_manager.cc:1434] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:18.299304 1200 tablet_bootstrap.cc:492] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.300978 1200 tablet_bootstrap.cc:654] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.309801 3106 tablet.cc:1724] T c08fc0181e5642d0a2b7967ff30d4eaa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:18.310865 1208 tablet_bootstrap.cc:492] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.311012 1208 ts_tablet_manager.cc:1403] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.171s user 0.005s sys 0.003s
I20260619 19:54:18.312073 1208 raft_consensus.cc:359] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.312299 1208 raft_consensus.cc:385] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.312362 1208 raft_consensus.cc:740] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.312716 1208 consensus_queue.cc:260] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.314440 1208 ts_tablet_manager.cc:1434] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:18.315466 1208 tablet_bootstrap.cc:492] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.316592 777 raft_consensus.cc:2468] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 2.
I20260619 19:54:18.317180 1208 tablet_bootstrap.cc:654] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.319307 858 leader_election.cc:304] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.319602 3116 raft_consensus.cc:2804] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:18.319720 3116 raft_consensus.cc:697] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:18.320004 3116 consensus_queue.cc:237] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.325521 1208 tablet_bootstrap.cc:492] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.325695 1208 ts_tablet_manager.cc:1403] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260619 19:54:18.326377 1208 raft_consensus.cc:359] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.326586 1208 raft_consensus.cc:385] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.326644 1208 raft_consensus.cc:740] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.326877 1208 consensus_queue.cc:260] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.327750 1973 ts_tablet_manager.cc:1929] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260619 19:54:18.327847 1973 log.cc:1199] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/74f39941c13847d79e2b2c3ddd176533
I20260619 19:54:18.328210 1973 ts_tablet_manager.cc:1950] T 74f39941c13847d79e2b2c3ddd176533 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.328276 1208 ts_tablet_manager.cc:1434] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:18.328508 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 548) took 5915 ms. Trace:
I20260619 19:54:18.328522 1208 tablet_bootstrap.cc:492] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.330793 1208 tablet_bootstrap.cc:654] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.328591 1973 rpcz_store.cc:276] 0619 19:54:12.412766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.412812 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:18.238153 (+5825341us) ts_tablet_manager.cc:1151] Deleting tablet 74f39941c13847d79e2b2c3ddd176533
0619 19:54:18.238169 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.273551 (+ 35382us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.327695 (+ 54144us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.328495 (+ 800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15333,"tablet-delete.queue_time_us":5825127}
I20260619 19:54:18.334132 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 549) took 5841 ms. Trace:
I20260619 19:54:18.334189 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 74f39941c13847d79e2b2c3ddd176533 (table default.Table_c775a92121304b789e5e4a1a08a165aa [id=58f44c01817240c4a73be8ba24a9a0dd]) successfully deleted
I20260619 19:54:18.334800 1973 rpcz_store.cc:276] 0619 19:54:12.492422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.492481 (+ 59us) service_pool.cc:224] Handling call
0619 19:54:18.333995 (+5841514us) ts_tablet_manager.cc:1151] Deleting tablet f7696e1f927f4877b720964c7b8af02c
0619 19:54:18.334004 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.334108 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5841304}
I20260619 19:54:18.335368 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 550) took 5842 ms. Trace:
W20260619 19:54:18.335379 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f7696e1f927f4877b720964c7b8af02c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7696e1f927f4877b720964c7b8af02c already in progress: creating tablet
I20260619 19:54:18.338795 1208 tablet_bootstrap.cc:492] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.339434 1208 ts_tablet_manager.cc:1403] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260619 19:54:18.340175 1208 raft_consensus.cc:359] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.340354 1208 raft_consensus.cc:385] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.340418 1208 raft_consensus.cc:740] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.340617 1208 consensus_queue.cc:260] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.341917 1208 ts_tablet_manager.cc:1434] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:18.342926 1208 tablet_bootstrap.cc:492] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.338923 1973 rpcz_store.cc:276] 0619 19:54:12.492837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.492880 (+ 43us) service_pool.cc:224] Handling call
0619 19:54:18.335232 (+5842352us) ts_tablet_manager.cc:1151] Deleting tablet 39706a77fb3a40afbaa9b0436d4eaa28
0619 19:54:18.335244 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.335347 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5842213}
I20260619 19:54:18.343417 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 551) took 5850 ms. Trace:
W20260619 19:54:18.343494 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 39706a77fb3a40afbaa9b0436d4eaa28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39706a77fb3a40afbaa9b0436d4eaa28 already in progress: creating tablet
I20260619 19:54:18.343499 1973 rpcz_store.cc:276] 0619 19:54:12.493169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.493217 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:18.343296 (+5850079us) ts_tablet_manager.cc:1151] Deleting tablet cb068672e26d48b9a871ceb1c81022cc
0619 19:54:18.343307 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.343401 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5849927}
I20260619 19:54:18.343811 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 552) took 5698 ms. Trace:
I20260619 19:54:18.343886 1973 rpcz_store.cc:276] 0619 19:54:12.645137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.645188 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:18.343719 (+5698531us) ts_tablet_manager.cc:1151] Deleting tablet 85f16c7a84e54c21b3f908540654bf58
0619 19:54:18.343727 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.343797 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5698351}
I20260619 19:54:18.344189 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 553) took 5576 ms. Trace:
I20260619 19:54:18.344266 1973 rpcz_store.cc:276] 0619 19:54:12.767512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.767577 (+ 65us) service_pool.cc:224] Handling call
0619 19:54:18.344093 (+5576516us) ts_tablet_manager.cc:1151] Deleting tablet 642e0199fd244f7e927bf7abf231327d
0619 19:54:18.344101 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.344175 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5576320}
I20260619 19:54:18.344547 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 554) took 5576 ms. Trace:
I20260619 19:54:18.344619 1973 rpcz_store.cc:276] 0619 19:54:12.767629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.767812 (+ 183us) service_pool.cc:224] Handling call
0619 19:54:18.344464 (+5576652us) ts_tablet_manager.cc:1151] Deleting tablet f40da590ead8491788f59f1711e7e525
0619 19:54:18.344471 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.344534 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5576482}
I20260619 19:54:18.344914 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 555) took 5355 ms. Trace:
I20260619 19:54:18.344986 1973 rpcz_store.cc:276] 0619 19:54:12.989734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.989783 (+ 49us) service_pool.cc:224] Handling call
0619 19:54:18.344821 (+5355038us) ts_tablet_manager.cc:1151] Deleting tablet 1359dd33e7b946c286bbe8c1ec8ebad5
0619 19:54:18.344831 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.344900 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5354884}
I20260619 19:54:18.345276 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 556) took 5349 ms. Trace:
I20260619 19:54:18.345353 1973 rpcz_store.cc:276] 0619 19:54:12.995502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:12.995568 (+ 66us) service_pool.cc:224] Handling call
0619 19:54:18.345195 (+5349627us) ts_tablet_manager.cc:1151] Deleting tablet 17ce8540ee2846198786b8e215275641
0619 19:54:18.345202 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.345262 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5349395}
I20260619 19:54:18.345636 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 557) took 5259 ms. Trace:
I20260619 19:54:18.345708 1973 rpcz_store.cc:276] 0619 19:54:13.086208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.086261 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:18.345553 (+5259292us) ts_tablet_manager.cc:1151] Deleting tablet 17ce8540ee2846198786b8e215275641
0619 19:54:18.345561 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.345622 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5246316}
I20260619 19:54:18.345985 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 558) took 5259 ms. Trace:
I20260619 19:54:18.346058 1973 rpcz_store.cc:276] 0619 19:54:13.086499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.086563 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:18.345901 (+5259338us) ts_tablet_manager.cc:1151] Deleting tablet 1359dd33e7b946c286bbe8c1ec8ebad5
0619 19:54:18.345909 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.345971 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5246440}
W20260619 19:54:18.346302 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet cb068672e26d48b9a871ceb1c81022cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb068672e26d48b9a871ceb1c81022cc already in progress: creating tablet
I20260619 19:54:18.346352 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 560) took 5258 ms. Trace:
I20260619 19:54:18.346415 1973 rpcz_store.cc:276] 0619 19:54:13.087486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.131802 (+ 44316us) service_pool.cc:224] Handling call
0619 19:54:18.346267 (+5214465us) ts_tablet_manager.cc:1151] Deleting tablet 74813bf79789451f90bcf7779aff9290
0619 19:54:18.346274 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.346337 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5214207}
W20260619 19:54:18.346611 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 85f16c7a84e54c21b3f908540654bf58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f16c7a84e54c21b3f908540654bf58 already in progress: creating tablet
I20260619 19:54:18.346724 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 561) took 5214 ms. Trace:
I20260619 19:54:18.346797 1973 rpcz_store.cc:276] 0619 19:54:13.132284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.132340 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:18.346634 (+5214294us) ts_tablet_manager.cc:1151] Deleting tablet 6da56cd05ea740eb949abb9bba60760a
0619 19:54:18.346642 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.346708 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5214130}
W20260619 19:54:18.346848 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 642e0199fd244f7e927bf7abf231327d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 642e0199fd244f7e927bf7abf231327d already in progress: creating tablet
I20260619 19:54:18.347040 1973 tablet_replica.cc:333] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:18.347040 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f40da590ead8491788f59f1711e7e525 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f40da590ead8491788f59f1711e7e525 already in progress: creating tablet
W20260619 19:54:18.347361 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1359dd33e7b946c286bbe8c1ec8ebad5 already in progress: creating tablet
W20260619 19:54:18.347594 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 17ce8540ee2846198786b8e215275641 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17ce8540ee2846198786b8e215275641 already in progress: creating tablet
W20260619 19:54:18.347805 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 17ce8540ee2846198786b8e215275641 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17ce8540ee2846198786b8e215275641 already in progress: creating tablet
W20260619 19:54:18.348011 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1359dd33e7b946c286bbe8c1ec8ebad5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1359dd33e7b946c286bbe8c1ec8ebad5 already in progress: creating tablet
W20260619 19:54:18.348213 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 74813bf79789451f90bcf7779aff9290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74813bf79789451f90bcf7779aff9290 already in progress: creating tablet
W20260619 19:54:18.348428 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6da56cd05ea740eb949abb9bba60760a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da56cd05ea740eb949abb9bba60760a already in progress: creating tablet
I20260619 19:54:18.348816 1208 tablet_bootstrap.cc:654] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.349849 1973 raft_consensus.cc:2243] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.350071 1973 pending_rounds.cc:70] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:18.350183 1973 pending_rounds.cc:77] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657698246017024 op_type: NO_OP noop_request { }
I20260619 19:54:18.350361 1973 raft_consensus.cc:2889] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:18.350515 1973 raft_consensus.cc:2272] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.355188 1973 ts_tablet_manager.cc:1916] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:18.360867 833 tablet.cc:2406] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:54:18.364344 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 311) took 12735 ms. Trace:
I20260619 19:54:18.365024 1200 tablet_bootstrap.cc:492] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.365302 1200 ts_tablet_manager.cc:1403] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.017s
I20260619 19:54:18.365643 1973 ts_tablet_manager.cc:1929] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:18.366262 1200 raft_consensus.cc:359] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.366520 1200 raft_consensus.cc:385] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.366577 1200 raft_consensus.cc:740] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.366837 1200 consensus_queue.cc:260] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.367522 1200 ts_tablet_manager.cc:1434] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 19:54:18.369726 1973 log.cc:1199] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/4023cceb8d9447c9952951c1d6bcdf00
I20260619 19:54:18.370153 1200 tablet_bootstrap.cc:492] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.370659 1973 ts_tablet_manager.cc:1950] T 4023cceb8d9447c9952951c1d6bcdf00 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.373041 1200 tablet_bootstrap.cc:654] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.374228 1208 tablet_bootstrap.cc:492] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.374480 1208 ts_tablet_manager.cc:1403] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.008s
I20260619 19:54:18.375505 1208 raft_consensus.cc:359] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.375834 1208 raft_consensus.cc:385] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.375990 1208 raft_consensus.cc:740] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.376312 1208 consensus_queue.cc:260] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.377136 1208 ts_tablet_manager.cc:1434] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260619 19:54:18.392241 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 150137us
W20260619 19:54:18.392688 996 leader_election.cc:343] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.392920 996 leader_election.cc:304] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:18.393216 996 raft_consensus.cc:2686] T f658e85be0c843f2b02e4567a80521c4 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260619 19:54:18.394033 996 leader_election.cc:343] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.394665 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_73fb804f16184152a67bef2cd29b53b0" } modify_external_catalogs: true
I20260619 19:54:18.394944 1208 tablet_bootstrap.cc:492] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.364902 2026 rpcz_store.cc:276] 0619 19:54:05.628862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.629420 (+ 558us) service_pool.cc:224] Handling call
0619 19:54:18.045359 (+12415939us) ts_tablet_manager.cc:1151] Deleting tablet 79f8635b919a44a8a1e5fe48420ca4b7
0619 19:54:18.045371 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.102610 (+ 57239us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.237474 (+134864us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.364307 (+126833us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12415469}
I20260619 19:54:18.394908 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_73fb804f16184152a67bef2cd29b53b0" } modify_external_catalogs: true
I20260619 19:54:18.395351 2026 tablet_replica.cc:333] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:18.395592 2026 raft_consensus.cc:2243] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:18.395956 2026 raft_consensus.cc:2272] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.396687 2026 ts_tablet_manager.cc:1916] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.398346 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5a96ee39da6c4a1a8987e658455b7ebf" } modify_external_catalogs: true
I20260619 19:54:18.398532 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5a96ee39da6c4a1a8987e658455b7ebf" } modify_external_catalogs: true
I20260619 19:54:18.399242 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 79f8635b919a44a8a1e5fe48420ca4b7 (table default.Table_0d1560157edb47baa3153f7a5b863967 [id=0206e06d5e5f4829aecf4be95ceea42d]) successfully deleted
I20260619 19:54:18.400059 1208 tablet_bootstrap.cc:654] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.404296 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 562) took 5271 ms. Trace:
I20260619 19:54:18.404510 1208 tablet_bootstrap.cc:492] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.414250 1208 ts_tablet_manager.cc:1403] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260619 19:54:18.404417 1973 rpcz_store.cc:276] 0619 19:54:13.132748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.132802 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:18.347003 (+5214201us) ts_tablet_manager.cc:1151] Deleting tablet 4023cceb8d9447c9952951c1d6bcdf00
0619 19:54:18.347011 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.358559 (+ 11548us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.365578 (+ 7019us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.404266 (+ 38688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5214031}
I20260619 19:54:18.415231 996 leader_election.cc:304] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:18.415504 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 563) took 5282 ms. Trace:
I20260619 19:54:18.415606 1973 rpcz_store.cc:276] 0619 19:54:13.133186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.133237 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:18.415304 (+5282067us) ts_tablet_manager.cc:1151] Deleting tablet 8330e7df55694a7387cb9bdde32d2ba0
0619 19:54:18.415320 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.415482 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5281908}
I20260619 19:54:18.415979 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 571) took 5050 ms. Trace:
I20260619 19:54:18.416004 2996 raft_consensus.cc:2749] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.416064 1973 rpcz_store.cc:276] 0619 19:54:13.365448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.367360 (+ 1912us) service_pool.cc:224] Handling call
0619 19:54:18.415867 (+5048507us) ts_tablet_manager.cc:1151] Deleting tablet 32648df603ac442396922383ffbd2e31
0619 19:54:18.415879 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.415963 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5048315}
I20260619 19:54:18.416386 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 582) took 4759 ms. Trace:
I20260619 19:54:18.416456 1973 rpcz_store.cc:276] 0619 19:54:13.657205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.657251 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:18.416282 (+4759031us) ts_tablet_manager.cc:1151] Deleting tablet 3ddfe1bb8e174151b5872ee6dcebfdb7
0619 19:54:18.416293 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.416371 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4758879}
I20260619 19:54:18.416765 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 575) took 4760 ms. Trace:
I20260619 19:54:18.416857 1973 rpcz_store.cc:276] 0619 19:54:13.656594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.657438 (+ 844us) service_pool.cc:224] Handling call
0619 19:54:18.416684 (+4759246us) ts_tablet_manager.cc:1151] Deleting tablet b57381b0a02141459dc582196d0c0095
0619 19:54:18.416693 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.416750 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4759085}
I20260619 19:54:18.417207 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 576) took 4760 ms. Trace:
I20260619 19:54:18.417291 1973 rpcz_store.cc:276] 0619 19:54:13.656684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.658649 (+ 1965us) service_pool.cc:224] Handling call
0619 19:54:18.417115 (+4758466us) ts_tablet_manager.cc:1151] Deleting tablet c54b2e4f657245c2aa23d138968b3b0d
0619 19:54:18.417124 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.417192 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4758324}
I20260619 19:54:18.417595 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 577) took 4760 ms. Trace:
I20260619 19:54:18.417685 1973 rpcz_store.cc:276] 0619 19:54:13.656768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.658820 (+ 2052us) service_pool.cc:224] Handling call
0619 19:54:18.417519 (+4758699us) ts_tablet_manager.cc:1151] Deleting tablet 42a3f254125141bf8783626e669717d2
0619 19:54:18.417529 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.417580 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4758580}
I20260619 19:54:18.417969 1973 tablet_replica.cc:333] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:18.418143 996 leader_election.cc:343] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.418220 1973 raft_consensus.cc:2243] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.419162 1208 raft_consensus.cc:359] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.419407 1208 raft_consensus.cc:385] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.419476 1208 raft_consensus.cc:740] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.419721 1208 consensus_queue.cc:260] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.421538 1208 ts_tablet_manager.cc:1434] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
W20260619 19:54:18.421864 996 leader_election.cc:343] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.422365 996 leader_election.cc:304] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:18.422533 1208 tablet_bootstrap.cc:492] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.423079 3168 raft_consensus.cc:2749] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:18.423466 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea03e6d6e7a0411082726e31877628b0 consensus state has no leader
I20260619 19:54:18.424367 1208 tablet_bootstrap.cc:654] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.425691 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 8f50b9f07f3b4d00b500adef6c67e36d from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:18.426530 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 4023cceb8d9447c9952951c1d6bcdf00 (table default.Table_46a7c157a163498b8dad537378867594 [id=003a72dcde564d29b771f069509c99cd]) successfully deleted
W20260619 19:54:18.426800 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8330e7df55694a7387cb9bdde32d2ba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8330e7df55694a7387cb9bdde32d2ba0 already in progress: creating tablet
W20260619 19:54:18.427001 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 32648df603ac442396922383ffbd2e31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32648df603ac442396922383ffbd2e31 already in progress: creating tablet
I20260619 19:54:18.427120 3168 raft_consensus.cc:493] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:18.427249 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 already in progress: creating tablet
W20260619 19:54:18.427418 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b57381b0a02141459dc582196d0c0095 because the tablet was not found. No further retry: Not found: Tablet not found: b57381b0a02141459dc582196d0c0095
I20260619 19:54:18.427340 3168 raft_consensus.cc:515] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:18.427584 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c54b2e4f657245c2aa23d138968b3b0d because the tablet was not found. No further retry: Not found: Tablet not found: c54b2e4f657245c2aa23d138968b3b0d
W20260619 19:54:18.427831 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 42a3f254125141bf8783626e669717d2 because the tablet was not found. No further retry: Not found: Tablet not found: 42a3f254125141bf8783626e669717d2
I20260619 19:54:18.428107 3168 leader_election.cc:290] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.428802 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b78d8a4d8dd42859be248b698257e2c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:18.428938 1110 tablet.cc:2406] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 19:54:18.430090 1973 raft_consensus.cc:2272] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.430127 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b78d8a4d8dd42859be248b698257e2c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:18.431710 996 leader_election.cc:343] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.430771 1973 ts_tablet_manager.cc:1916] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:18.432256 996 leader_election.cc:343] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.434412 1201 tablet_bootstrap.cc:492] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:18.434610 1201 ts_tablet_manager.cc:1403] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.161s user 0.010s sys 0.029s
I20260619 19:54:18.435516 1201 raft_consensus.cc:359] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.435839 1201 raft_consensus.cc:385] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.435957 1201 raft_consensus.cc:740] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.436496 1201 consensus_queue.cc:260] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.436965 996 leader_election.cc:304] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:18.440688 3168 raft_consensus.cc:2749] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.441145 1973 ts_tablet_manager.cc:1929] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:18.445782 1973 log.cc:1199] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/3ce88d3d4ea340dcaa9d8e26f9a047a7
I20260619 19:54:18.446202 1201 ts_tablet_manager.cc:1434] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260619 19:54:18.446411 1973 ts_tablet_manager.cc:1950] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.447921 1201 tablet_bootstrap.cc:492] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:18.455175 1208 tablet_bootstrap.cc:492] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.455426 1208 ts_tablet_manager.cc:1403] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.006s
I20260619 19:54:18.456269 1208 raft_consensus.cc:359] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.456525 1208 raft_consensus.cc:385] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.456653 1208 raft_consensus.cc:740] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.456925 1208 consensus_queue.cc:260] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.457741 1208 ts_tablet_manager.cc:1434] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:18.454154 1201 tablet_bootstrap.cc:654] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.458200 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b14adf8fae244e7ba3e4fe985bccbfce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.454748 859 consensus_peers.cc:597] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4023cceb8d9447c9952951c1d6bcdf00. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:18.458823 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b14adf8fae244e7ba3e4fe985bccbfce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.465019 777 raft_consensus.cc:3060] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.475756 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1115d6c0e49f4156802fe490e99b9a4a (DEFAULT_TABLE table=default.Table_5ca3976b352f4aa78ea89424e5b16739 [id=9fa78b4b1a5a45bd98d70b20dba4fc92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.475847 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1115d6c0e49f4156802fe490e99b9a4a (DEFAULT_TABLE table=default.Table_5ca3976b352f4aa78ea89424e5b16739 [id=9fa78b4b1a5a45bd98d70b20dba4fc92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.476192 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1115d6c0e49f4156802fe490e99b9a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.476198 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1115d6c0e49f4156802fe490e99b9a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.477190 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:18.477795 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:18.478506 527 catalog_manager.cc:5696] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:18.479430 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 4de3585208ff43c1ad790244bcc9d55d (DEFAULT_TABLE table=default.Table_c6124626ca3a4af9ba80ea47f707694d [id=47277eef0bc44e448760815605bee12b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.479821 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de3585208ff43c1ad790244bcc9d55d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:18.481119 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73fa6438bb734872a22cf1e8aa80470e consensus state has no leader
I20260619 19:54:18.481334 888 tablet_service.cc:1511] Processing CreateTablet for tablet 4de3585208ff43c1ad790244bcc9d55d (DEFAULT_TABLE table=default.Table_c6124626ca3a4af9ba80ea47f707694d [id=47277eef0bc44e448760815605bee12b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.481688 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de3585208ff43c1ad790244bcc9d55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.481566 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_211ccb0b3f0b4fea8e50ed8735b58916"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.482239 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_211ccb0b3f0b4fea8e50ed8735b58916 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.482964 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e9eedbb5ebff4371b97b696680fc8213" } new_table_name: "default.Table_5c033e60215b4b10af8e3e07f6012956" modify_external_catalogs: true
I20260619 19:54:18.483752 758 tablet_service.cc:1511] Processing CreateTablet for tablet 4de3585208ff43c1ad790244bcc9d55d (DEFAULT_TABLE table=default.Table_c6124626ca3a4af9ba80ea47f707694d [id=47277eef0bc44e448760815605bee12b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.484125 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de3585208ff43c1ad790244bcc9d55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.485380 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1115d6c0e49f4156802fe490e99b9a4a (DEFAULT_TABLE table=default.Table_5ca3976b352f4aa78ea89424e5b16739 [id=9fa78b4b1a5a45bd98d70b20dba4fc92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.485692 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1115d6c0e49f4156802fe490e99b9a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.481674 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f1436f5ff9b34985976f95675a904bc5" } modify_external_catalogs: true
I20260619 19:54:18.487442 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f1436f5ff9b34985976f95675a904bc5" } modify_external_catalogs: true
I20260619 19:54:18.489450 528 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_83323de24e23497a9cec6d92ad957bc1 [id=1debae55f0e7477db2e2285641220a72] alter complete (version 1)
I20260619 19:54:18.490185 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8464dd18d8124733b29929afbe73c8ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.490867 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8464dd18d8124733b29929afbe73c8ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.494349 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff01c0de8a540d0a024a4924199ba54) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.494877 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4598862f0a3a4f44b4d4c7281a9f6815 (DEFAULT_TABLE table=default.Table_fcf0a5b39915474cbddeb9fd0cb7efa5 [id=1c0e8eefafda4b8fa47bc9c35cc4471e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.494901 759 tablet_service.cc:1511] Processing CreateTablet for tablet 4598862f0a3a4f44b4d4c7281a9f6815 (DEFAULT_TABLE table=default.Table_fcf0a5b39915474cbddeb9fd0cb7efa5 [id=1c0e8eefafda4b8fa47bc9c35cc4471e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.495258 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4598862f0a3a4f44b4d4c7281a9f6815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.495391 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4598862f0a3a4f44b4d4c7281a9f6815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.495780 1994 tablet_replica.cc:333] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.495968 1994 raft_consensus.cc:2243] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.496241 1994 raft_consensus.cc:2272] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.497427 1994 ts_tablet_manager.cc:1916] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.502162 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4598862f0a3a4f44b4d4c7281a9f6815 (DEFAULT_TABLE table=default.Table_fcf0a5b39915474cbddeb9fd0cb7efa5 [id=1c0e8eefafda4b8fa47bc9c35cc4471e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.504722 1035 tablet_service.cc:1511] Processing CreateTablet for tablet aeb2f4df7c3742999d8c344e1b514ffc (DEFAULT_TABLE table=default.Table_4f1dad13b920481f96d68e2c13b75d97 [id=882b0dada2f745209a927790a5f56010]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.505091 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb2f4df7c3742999d8c344e1b514ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.505470 750 tablet_service.cc:1511] Processing CreateTablet for tablet aeb2f4df7c3742999d8c344e1b514ffc (DEFAULT_TABLE table=default.Table_4f1dad13b920481f96d68e2c13b75d97 [id=882b0dada2f745209a927790a5f56010]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.505833 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb2f4df7c3742999d8c344e1b514ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.507413 900 tablet_service.cc:1511] Processing CreateTablet for tablet 7a917d8574e647edb4ed5b2ec579ad80 (DEFAULT_TABLE table=default.Table_0d58ce404e2d479c9f54ddaeecc6e402 [id=b01ed92eb7a04a01b14551ef90d9b068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.507660 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7a917d8574e647edb4ed5b2ec579ad80 (DEFAULT_TABLE table=default.Table_0d58ce404e2d479c9f54ddaeecc6e402 [id=b01ed92eb7a04a01b14551ef90d9b068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.507952 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a917d8574e647edb4ed5b2ec579ad80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.508443 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 15b81edd27d14611b3a66c547117c532
I20260619 19:54:18.508921 526 catalog_manager.cc:6784] ReplaceTablet: tablet 15b81edd27d14611b3a66c547117c532 deleted and replaced by tablet ac483f6761354d4f967efecf729f8338
I20260619 19:54:18.509501 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1c0e601c022049fcb050f7b90b9f3a98
I20260619 19:54:18.510351 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8a6e5f969929426d95a49cf597bda491
I20260619 19:54:18.512382 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 8f50b9f07f3b4d00b500adef6c67e36d
I20260619 19:54:18.512871 523 catalog_manager.cc:6784] ReplaceTablet: tablet 8f50b9f07f3b4d00b500adef6c67e36d deleted and replaced by tablet e8dde8469510471993ad33a341d09a77
I20260619 19:54:18.513799 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 15b81edd27d14611b3a66c547117c532 with delete_type TABLET_DATA_DELETED (replaced by tablet ac483f6761354d4f967efecf729f8338) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.514748 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 15b81edd27d14611b3a66c547117c532 with delete_type TABLET_DATA_DELETED (replaced by tablet ac483f6761354d4f967efecf729f8338) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.514984 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c0e601c022049fcb050f7b90b9f3a98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.515028 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c0e601c022049fcb050f7b90b9f3a98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.515189 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a6e5f969929426d95a49cf597bda491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.515244 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a6e5f969929426d95a49cf597bda491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.515283 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f50b9f07f3b4d00b500adef6c67e36d with delete_type TABLET_DATA_DELETED (replaced by tablet e8dde8469510471993ad33a341d09a77) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.515404 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f50b9f07f3b4d00b500adef6c67e36d with delete_type TABLET_DATA_DELETED (replaced by tablet e8dde8469510471993ad33a341d09a77) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.518296 902 tablet_service.cc:1511] Processing CreateTablet for tablet aeb2f4df7c3742999d8c344e1b514ffc (DEFAULT_TABLE table=default.Table_4f1dad13b920481f96d68e2c13b75d97 [id=882b0dada2f745209a927790a5f56010]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.520037 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 578) took 4863 ms. Trace:
I20260619 19:54:18.520174 1973 rpcz_store.cc:276] 0619 19:54:13.656845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.658967 (+ 2122us) service_pool.cc:224] Handling call
0619 19:54:18.417916 (+4758949us) ts_tablet_manager.cc:1151] Deleting tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7
0619 19:54:18.417926 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.437638 (+ 19712us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.441076 (+ 3438us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.520008 (+ 78932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11654,"tablet-delete.queue_time_us":4758816}
I20260619 19:54:18.520643 1973 tablet_replica.cc:333] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:18.520896 1973 raft_consensus.cc:2243] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.521154 1973 raft_consensus.cc:2272] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.521875 1973 ts_tablet_manager.cc:1916] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.522950 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4598862f0a3a4f44b4d4c7281a9f6815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.523496 1208 tablet_bootstrap.cc:492] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.523782 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a917d8574e647edb4ed5b2ec579ad80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.524176 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb2f4df7c3742999d8c344e1b514ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.525524 1208 tablet_bootstrap.cc:654] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.527351 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 3ce88d3d4ea340dcaa9d8e26f9a047a7 (table default.Table_299b0539a019486f9ab66bb6e24975a3 [id=0d428bc351c644c49601058ab8da82d6]) successfully deleted
I20260619 19:54:18.532474 2953 raft_consensus.cc:493] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:18.533162 2953 raft_consensus.cc:515] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.536602 2953 leader_election.cc:290] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:18.537604 859 leader_election.cc:343] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 801f08f4daa842238460506ccd0c466f
I20260619 19:54:18.537904 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.538443 858 leader_election.cc:304] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.539448 3047 raft_consensus.cc:2749] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:18.546146 759 tablet_service.cc:1511] Processing CreateTablet for tablet 6703b9aa4b9c471099adb146e3570428 (DEFAULT_TABLE table=default.Table_1df39b15e65e4b4c8a798e9dedf18358 [id=66cdb1252548485e8578531e5eb65af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.546597 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6703b9aa4b9c471099adb146e3570428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.511477 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 7a917d8574e647edb4ed5b2ec579ad80 (DEFAULT_TABLE table=default.Table_0d58ce404e2d479c9f54ddaeecc6e402 [id=b01ed92eb7a04a01b14551ef90d9b068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.547851 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a917d8574e647edb4ed5b2ec579ad80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.552646 900 tablet_service.cc:1511] Processing CreateTablet for tablet 6703b9aa4b9c471099adb146e3570428 (DEFAULT_TABLE table=default.Table_1df39b15e65e4b4c8a798e9dedf18358 [id=66cdb1252548485e8578531e5eb65af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.553171 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6703b9aa4b9c471099adb146e3570428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.554594 3047 raft_consensus.cc:493] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.514885 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c0e601c022049fcb050f7b90b9f3a98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.514933 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a6e5f969929426d95a49cf597bda491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.554812 3047 raft_consensus.cc:515] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:18.555240 2953 raft_consensus.cc:493] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.555431 2953 raft_consensus.cc:515] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.519490 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 6703b9aa4b9c471099adb146e3570428 (DEFAULT_TABLE table=default.Table_1df39b15e65e4b4c8a798e9dedf18358 [id=66cdb1252548485e8578531e5eb65af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.556164 2953 leader_election.cc:290] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.556401 3047 leader_election.cc:290] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:18.556532 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6703b9aa4b9c471099adb146e3570428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.515573 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f50b9f07f3b4d00b500adef6c67e36d with delete_type TABLET_DATA_DELETED (replaced by tablet e8dde8469510471993ad33a341d09a77) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:18.561280 858 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: b57381b0a02141459dc582196d0c0095
I20260619 19:54:18.561594 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77de42bb514452a8dc6a4a71289dc59" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:18.561815 1054 raft_consensus.cc:2468] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:18.562265 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77de42bb514452a8dc6a4a71289dc59" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.562486 781 raft_consensus.cc:2468] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:18.563498 858 leader_election.cc:304] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:18.563441 750 tablet_service.cc:1511] Processing CreateTablet for tablet 875e0b369f1c47d19ac3191f2d3c5d61 (DEFAULT_TABLE table=default.Table_b34d510958c945519187a1aefb7ae1c9 [id=55d62c2fc76042e29ceb0f6a90ad25ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.564116 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875e0b369f1c47d19ac3191f2d3c5d61. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:18.564626 859 leader_election.cc:343] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b57381b0a02141459dc582196d0c0095
I20260619 19:54:18.564790 859 leader_election.cc:304] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.511921 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 15b81edd27d14611b3a66c547117c532 with delete_type TABLET_DATA_DELETED (replaced by tablet ac483f6761354d4f967efecf729f8338) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.511114 1994 ts_tablet_manager.cc:1929] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.565618 3116 raft_consensus.cc:2804] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:18.565762 3116 raft_consensus.cc:493] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:18.565831 1994 log.cc:1199] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d2939b8aa0d44ad2a05a933db4ea64be
I20260619 19:54:18.565869 3116 raft_consensus.cc:3060] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.566269 1994 ts_tablet_manager.cc:1950] T d2939b8aa0d44ad2a05a933db4ea64be P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.568691 1200 tablet_bootstrap.cc:492] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.568817 1200 ts_tablet_manager.cc:1403] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.199s user 0.018s sys 0.034s
I20260619 19:54:18.569438 1200 raft_consensus.cc:359] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.569586 1200 raft_consensus.cc:385] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.569630 1200 raft_consensus.cc:740] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.569927 1200 consensus_queue.cc:260] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.570075 3116 raft_consensus.cc:515] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.570391 1200 ts_tablet_manager.cc:1434] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:18.570959 3116 leader_election.cc:290] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.571915 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77de42bb514452a8dc6a4a71289dc59" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:18.572088 1054 raft_consensus.cc:3060] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.573146 1200 tablet_bootstrap.cc:492] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.576558 3123 raft_consensus.cc:493] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.576779 3123 raft_consensus.cc:515] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.577636 3123 leader_election.cc:290] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.579439 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:18.579622 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77de42bb514452a8dc6a4a71289dc59" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:18.580168 3116 raft_consensus.cc:2749] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:54:18.580153 774 raft_consensus.cc:3060] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:18.584339 719 leader_election.cc:343] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.585511 1208 tablet_bootstrap.cc:492] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.585659 1208 ts_tablet_manager.cc:1403] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.003s
I20260619 19:54:18.585772 774 raft_consensus.cc:2468] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:18.586490 1208 raft_consensus.cc:359] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:18.586661 1208 raft_consensus.cc:385] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.586728 1208 raft_consensus.cc:740] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.587178 858 leader_election.cc:304] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:18.587548 1200 tablet_bootstrap.cc:654] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.588651 3115 raft_consensus.cc:2804] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:18.588814 3115 raft_consensus.cc:697] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:18.590219 1201 tablet_bootstrap.cc:492] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:18.590389 859 consensus_peers.cc:597] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 297f07f2d08d47dfa69f845dadb973b1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:18.590544 1201 ts_tablet_manager.cc:1403] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.143s user 0.032s sys 0.026s
I20260619 19:54:18.591606 1201 raft_consensus.cc:359] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.591815 1201 raft_consensus.cc:385] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.591876 1201 raft_consensus.cc:740] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.587493 1208 consensus_queue.cc:260] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:18.592411 1201 consensus_queue.cc:260] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.593462 1201 ts_tablet_manager.cc:1434] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:18.589118 3115 consensus_queue.cc:237] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.594741 1208 ts_tablet_manager.cc:1434] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260619 19:54:18.595088 1208 tablet_bootstrap.cc:492] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.597525 1201 tablet_bootstrap.cc:492] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:18.599138 1201 tablet_bootstrap.cc:654] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.601699 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:18.601749 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_81f483b6dbf949ee904fdb2d85285759" } modify_external_catalogs: true
I20260619 19:54:18.601891 1059 raft_consensus.cc:2468] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:18.601985 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_81f483b6dbf949ee904fdb2d85285759" } modify_external_catalogs: true
I20260619 19:54:18.602434 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 875e0b369f1c47d19ac3191f2d3c5d61 (DEFAULT_TABLE table=default.Table_b34d510958c945519187a1aefb7ae1c9 [id=55d62c2fc76042e29ceb0f6a90ad25ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.602602 1208 tablet_bootstrap.cc:654] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.602809 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875e0b369f1c47d19ac3191f2d3c5d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.603483 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f689cd38e8504e5086c9f54dbb3cb6ff" } new_table_name: "default.Table_1a3a06a102bf495ab529ad893ed45d22" modify_external_catalogs: true
I20260619 19:54:18.608067 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 11c4467016e640b4aa4edcd83ac61173 (DEFAULT_TABLE table=default.Table_fd57a3a63b3d4e73a86997c3e9511bd5 [id=377a6963b1e34a06b1e7ac9c6c3c7f68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.608601 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c4467016e640b4aa4edcd83ac61173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.609541 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f3f755f497a44326b8f2c7e87db573bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.610248 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3f755f497a44326b8f2c7e87db573bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.611706 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8349f974cb2246779c7c71dada5fcd52" } modify_external_catalogs: true
I20260619 19:54:18.611896 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8349f974cb2246779c7c71dada5fcd52" } modify_external_catalogs: true
I20260619 19:54:18.612229 720 leader_election.cc:304] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:18.612846 3082 raft_consensus.cc:2804] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:18.612923 3082 raft_consensus.cc:493] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:18.612988 3082 raft_consensus.cc:3060] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.613188 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_021d1b5629484a168dc9dbf0e2bfa23d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.613761 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_021d1b5629484a168dc9dbf0e2bfa23d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.614660 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d2939b8aa0d44ad2a05a933db4ea64be (table default.Table_766549702f124d0286617da3d1fa585c [id=3e15f4bd79fd433590d102806c85fed0]) successfully deleted
W20260619 19:54:18.614874 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1c0e601c022049fcb050f7b90b9f3a98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c0e601c022049fcb050f7b90b9f3a98 already in progress: creating tablet
W20260619 19:54:18.615093 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8a6e5f969929426d95a49cf597bda491 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a6e5f969929426d95a49cf597bda491 already in progress: creating tablet
W20260619 19:54:18.615341 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 8f50b9f07f3b4d00b500adef6c67e36d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f50b9f07f3b4d00b500adef6c67e36d already in progress: creating tablet
W20260619 19:54:18.615538 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 15b81edd27d14611b3a66c547117c532 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b81edd27d14611b3a66c547117c532 already in progress: creating tablet
I20260619 19:54:18.615595 3082 raft_consensus.cc:515] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.617066 3082 leader_election.cc:290] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.619848 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:18.620472 719 leader_election.cc:343] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.620999 1054 raft_consensus.cc:2468] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:18.621169 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74e17caefca44171b451258424497769 consensus state has no leader
I20260619 19:54:18.626325 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0ba255fd81f741d989e015a9cbe3310d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.627077 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ba255fd81f741d989e015a9cbe3310d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.627126 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:18.627851 1054 raft_consensus.cc:3060] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.630980 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b78d8a4d8dd42859be248b698257e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.631330 1994 tablet_replica.cc:333] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.631575 900 tablet_service.cc:1511] Processing CreateTablet for tablet 875e0b369f1c47d19ac3191f2d3c5d61 (DEFAULT_TABLE table=default.Table_b34d510958c945519187a1aefb7ae1c9 [id=55d62c2fc76042e29ceb0f6a90ad25ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.631690 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.631731 1994 raft_consensus.cc:2243] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.632287 1994 raft_consensus.cc:2272] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.633283 1994 ts_tablet_manager.cc:1916] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.634241 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 with delete_type TABLET_DATA_DELETED (replaced by tablet f9d9e816e001403a820caca4916f8824) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.639412 1054 raft_consensus.cc:2468] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:18.639873 720 leader_election.cc:304] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:18.640229 1994 ts_tablet_manager.cc:1929] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.640322 1994 log.cc:1199] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/9b78d8a4d8dd42859be248b698257e2c
I20260619 19:54:18.640319 3082 raft_consensus.cc:2804] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:18.640435 3082 raft_consensus.cc:697] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:18.640676 1994 ts_tablet_manager.cc:1950] T 9b78d8a4d8dd42859be248b698257e2c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.640673 3082 consensus_queue.cc:237] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.641170 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875e0b369f1c47d19ac3191f2d3c5d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.641937 1994 tablet_replica.cc:333] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.641902 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 9b78d8a4d8dd42859be248b698257e2c (table default.Table_6fd43f965fb445cfbc8018f1ed9adfaf [id=86b56cb65cf741ae8607f903894cc121]) successfully deleted
I20260619 19:54:18.642108 1994 raft_consensus.cc:2243] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.642261 1994 raft_consensus.cc:2272] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.643474 1994 ts_tablet_manager.cc:1916] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.648074 781 raft_consensus.cc:3060] T 4841d03189e84deaa036f235946e877a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.648756 898 tablet_service.cc:1511] Processing CreateTablet for tablet 11c4467016e640b4aa4edcd83ac61173 (DEFAULT_TABLE table=default.Table_fd57a3a63b3d4e73a86997c3e9511bd5 [id=377a6963b1e34a06b1e7ac9c6c3c7f68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.649147 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c4467016e640b4aa4edcd83ac61173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.650344 1041 tablet_service.cc:1511] Processing CreateTablet for tablet ce908760659140bdbf9a7c35b418317a (DEFAULT_TABLE table=default.Table_d99b0cd8fffb481290e112c2b6e82ff4 [id=fe9603f144754729ad93c0bc99850231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.650710 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce908760659140bdbf9a7c35b418317a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.651860 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 888ce677bddb4072aecd2b799892b6b6 (DEFAULT_TABLE table=default.Table_bbe5d19016164023a3cea6a56764f446 [id=09ba8746f7bf4664b09248913c5e3247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.652287 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888ce677bddb4072aecd2b799892b6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.654775 3048 consensus_queue.cc:1048] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:18.655560 1973 ts_tablet_manager.cc:1929] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:18.655752 1973 log.cc:1199] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/41455237399b45efbe8190dcb01e764c
I20260619 19:54:18.656150 1973 ts_tablet_manager.cc:1950] T 41455237399b45efbe8190dcb01e764c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.656356 898 tablet_service.cc:1511] Processing CreateTablet for tablet ce908760659140bdbf9a7c35b418317a (DEFAULT_TABLE table=default.Table_d99b0cd8fffb481290e112c2b6e82ff4 [id=fe9603f144754729ad93c0bc99850231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.656633 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 581) took 4999 ms. Trace:
I20260619 19:54:18.656809 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce908760659140bdbf9a7c35b418317a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.656733 1973 rpcz_store.cc:276] 0619 19:54:13.657127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.659547 (+ 2420us) service_pool.cc:224] Handling call
0619 19:54:18.520575 (+4861028us) ts_tablet_manager.cc:1151] Deleting tablet 41455237399b45efbe8190dcb01e764c
0619 19:54:18.520589 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.535248 (+ 14659us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.655497 (+120249us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.656489 (+ 992us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4851557}
I20260619 19:54:18.657199 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 574) took 5000 ms. Trace:
I20260619 19:54:18.657305 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 41455237399b45efbe8190dcb01e764c (table default.Table_4e0bca12b7834af7a6690074fa09e1e8 [id=af3f4335b675482195a6511647ca2871]) successfully deleted
I20260619 19:54:18.657275 1973 rpcz_store.cc:276] 0619 19:54:13.656500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.662231 (+ 5731us) service_pool.cc:224] Handling call
0619 19:54:18.657097 (+4994866us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:54:18.657108 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.657184 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4959308}
I20260619 19:54:18.657589 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 589) took 4804 ms. Trace:
I20260619 19:54:18.657678 1973 rpcz_store.cc:276] 0619 19:54:13.852696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.853278 (+ 582us) service_pool.cc:224] Handling call
0619 19:54:18.657491 (+4804213us) ts_tablet_manager.cc:1151] Deleting tablet 8e3f4b47d0e7451d91add5a81330bc7d
0619 19:54:18.657501 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.657576 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4785841}
W20260619 19:54:18.657928 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d651c8fb8ff244a5a09dd9ea593ecb14 because the tablet was not found. No further retry: Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:18.658197 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 590) took 4805 ms. Trace:
I20260619 19:54:18.658265 1973 rpcz_store.cc:276] 0619 19:54:13.852811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.853312 (+ 501us) service_pool.cc:224] Handling call
0619 19:54:18.657892 (+4804580us) ts_tablet_manager.cc:1151] Deleting tablet 79e86e744f254b7fbca1adfe43e3ade5
0619 19:54:18.657903 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.658180 (+ 277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4785344}
W20260619 19:54:18.658439 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8e3f4b47d0e7451d91add5a81330bc7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e3f4b47d0e7451d91add5a81330bc7d already in progress: creating tablet
I20260619 19:54:18.658591 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 594) took 4805 ms. Trace:
I20260619 19:54:18.658658 1973 rpcz_store.cc:276] 0619 19:54:13.853215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.853936 (+ 721us) service_pool.cc:224] Handling call
0619 19:54:18.658473 (+4804537us) ts_tablet_manager.cc:1151] Deleting tablet b57f64f97cdc493ea48e08d897bfc982
0619 19:54:18.658481 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.658576 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45,"tablet-delete.queue_time_us":4785925}
I20260619 19:54:18.658758 758 tablet_service.cc:1511] Processing CreateTablet for tablet ce908760659140bdbf9a7c35b418317a (DEFAULT_TABLE table=default.Table_d99b0cd8fffb481290e112c2b6e82ff4 [id=fe9603f144754729ad93c0bc99850231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.658921 1973 tablet_replica.cc:333] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:18.659106 1973 raft_consensus.cc:2243] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
W20260619 19:54:18.659350 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 79e86e744f254b7fbca1adfe43e3ade5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79e86e744f254b7fbca1adfe43e3ade5 already in progress: creating tablet
I20260619 19:54:18.659394 1994 ts_tablet_manager.cc:1929] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.659512 1994 log.cc:1199] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b4f7122fa5f94eeaa3b99cae107d8c9a
I20260619 19:54:18.659524 1973 raft_consensus.cc:2272] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:18.659582 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b57f64f97cdc493ea48e08d897bfc982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b57f64f97cdc493ea48e08d897bfc982 already in progress: creating tablet
I20260619 19:54:18.659162 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce908760659140bdbf9a7c35b418317a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.661104 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 1642bc8d3f984e1c9d60093fa7abcc53
I20260619 19:54:18.662092 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_be35c2633c92422e8ba617ebeac078e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.662683 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be35c2633c92422e8ba617ebeac078e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.663650 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_108b76c017514b1aabe28f50b0351398" } new_table_name: "default.Table_3d479895567c4946b5944f671bed079b" modify_external_catalogs: true
I20260619 19:54:18.664219 759 tablet_service.cc:1511] Processing CreateTablet for tablet 11c4467016e640b4aa4edcd83ac61173 (DEFAULT_TABLE table=default.Table_fd57a3a63b3d4e73a86997c3e9511bd5 [id=377a6963b1e34a06b1e7ac9c6c3c7f68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.664631 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c4467016e640b4aa4edcd83ac61173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.666059 1994 ts_tablet_manager.cc:1950] T b4f7122fa5f94eeaa3b99cae107d8c9a P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.666297 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.666992 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.667186 1994 tablet_replica.cc:333] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.667815 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b4f7122fa5f94eeaa3b99cae107d8c9a (table default.Table_599b6bc9158b48d4848732a5c03bc7d1 [id=a8cf65f08efa458883756790fbdd055d]) successfully deleted
I20260619 19:54:18.668262 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.670073 1994 raft_consensus.cc:2243] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.670259 1994 raft_consensus.cc:2272] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.670421 2953 raft_consensus.cc:493] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.670836 1994 ts_tablet_manager.cc:1916] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.671060 2953 raft_consensus.cc:515] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:18.674697 859 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:18.675892 2953 leader_election.cc:290] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:18.676635 858 leader_election.cc:343] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:18.676826 858 leader_election.cc:304] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.677299 2953 raft_consensus.cc:2749] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.684204 529 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:18.686750 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f3fbad77d4744a10aac60455a996adbf" } new_table_name: "default.Table_66143b0ff15e496eb622ea96a608f0a0" modify_external_catalogs: true
I20260619 19:54:18.690291 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 774938222588473e90c513232c82aece with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.693329 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d88ba4ee21f84d869cd33c9f6896efdf
I20260619 19:54:18.694440 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d88ba4ee21f84d869cd33c9f6896efdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.695593 902 tablet_service.cc:1558] Processing DeleteTablet for tablet d88ba4ee21f84d869cd33c9f6896efdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.696408 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d88ba4ee21f84d869cd33c9f6896efdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:18.698770 858 consensus_peers.cc:597] T 4023cceb8d9447c9952951c1d6bcdf00 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4023cceb8d9447c9952951c1d6bcdf00. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:18.701759 902 tablet_service.cc:1511] Processing CreateTablet for tablet 888ce677bddb4072aecd2b799892b6b6 (DEFAULT_TABLE table=default.Table_bbe5d19016164023a3cea6a56764f446 [id=09ba8746f7bf4664b09248913c5e3247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.702174 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888ce677bddb4072aecd2b799892b6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.702524 3168 raft_consensus.cc:493] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.702709 3168 raft_consensus.cc:515] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.703464 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e28e5a1d6ce54aa0a21e4b6de743783a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:18.703675 3168 leader_election.cc:290] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:18.703984 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e28e5a1d6ce54aa0a21e4b6de743783a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.705466 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c663c06d10e43958ab42dacc11cb486" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.705907 749 tablet_service.cc:1511] Processing CreateTablet for tablet 3998f275f66f44d48a5354c5e73ceb50 (DEFAULT_TABLE table=default.Table_e1485977ffee48529713dafd37bf30f0 [id=8bd5df9b5d854bee8a629167893cbdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.706300 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3998f275f66f44d48a5354c5e73ceb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.710036 765 tablet_service.cc:1511] Processing CreateTablet for tablet b9fd5c556ae04b73867e1b28967520d2 (DEFAULT_TABLE table=default.Table_1980b85fb1e5469a917fe9eb7ad91a50 [id=db7d0e0e637e49aebfb449d85910d0ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:18.710170 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e90afc275a147c99616529dccc866cd consensus state has no leader
I20260619 19:54:18.710407 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fd5c556ae04b73867e1b28967520d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.713784 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b88dd7d19514e83857e2c6108291b9f with delete_type TABLET_DATA_DELETED (replaced by tablet 9f69d2e3ee384eb9997bed7d594c919d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.716518 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0f37a2b643f545a599d3bea1d614a0d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.717149 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f37a2b643f545a599d3bea1d614a0d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.718616 3106 tablet.cc:1724] T 9911df524f8948ea8ecce55df0fdd0d6 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:18.722862 888 tablet_service.cc:1511] Processing CreateTablet for tablet 3998f275f66f44d48a5354c5e73ceb50 (DEFAULT_TABLE table=default.Table_e1485977ffee48529713dafd37bf30f0 [id=8bd5df9b5d854bee8a629167893cbdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.723352 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3998f275f66f44d48a5354c5e73ceb50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.729506 896 tablet_service.cc:1511] Processing CreateTablet for tablet b9fd5c556ae04b73867e1b28967520d2 (DEFAULT_TABLE table=default.Table_1980b85fb1e5469a917fe9eb7ad91a50 [id=db7d0e0e637e49aebfb449d85910d0ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.729933 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fd5c556ae04b73867e1b28967520d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:18.731581 859 consensus_peers.cc:597] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28e463032d0744cc88d011accbebfe1f. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:18.732168 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c663c06d10e43958ab42dacc11cb486" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:18.732792 996 leader_election.cc:343] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:18.733129 996 leader_election.cc:343] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.733219 996 leader_election.cc:304] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:18.733441 3168 raft_consensus.cc:2749] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.736405 2026 ts_tablet_manager.cc:1929] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:18.736548 2026 log.cc:1199] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fcaeebaaa93c479bafff14d312d526ec
I20260619 19:54:18.736961 2026 ts_tablet_manager.cc:1950] T fcaeebaaa93c479bafff14d312d526ec P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:18.737654 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 315) took 13101 ms. Trace:
I20260619 19:54:18.737845 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9911df524f8948ea8ecce55df0fdd0d6 (table default.Table_02e64fc0947b45c6a2eb8c87da0582d3 [id=1150e278fd3646d9b0897243ff2524d4]). Expected version 2 got 0
I20260619 19:54:18.737778 2026 rpcz_store.cc:276] 0619 19:54:05.636243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.636298 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:18.395292 (+12758994us) ts_tablet_manager.cc:1151] Deleting tablet fcaeebaaa93c479bafff14d312d526ec
0619 19:54:18.395305 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.454407 (+ 59102us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.736341 (+281934us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.737630 (+ 1289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12758815}
I20260619 19:54:18.738355 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 1e65ca84182d40c280ec2b0555c0de86 (table default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f]). Expected version 3 got 0
I20260619 19:54:18.738373 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 323) took 12934 ms. Trace:
I20260619 19:54:18.738467 2026 rpcz_store.cc:276] 0619 19:54:05.804343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.804633 (+ 290us) service_pool.cc:224] Handling call
0619 19:54:18.738209 (+12933576us) ts_tablet_manager.cc:1151] Deleting tablet 788550efad2f4dbc917131cff1e76f09
0619 19:54:18.738223 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.738352 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12933303}
I20260619 19:54:18.738806 2026 tablet_replica.cc:333] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:18.738843 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 2943333e572e4f1384b78d96a27d9c63 (table default.Table_289e9a40dfe544978d2b24059317037e [id=1741c78878ea424ebd539cb6fb4aaccc]). Expected version 2 got 0
W20260619 19:54:18.739262 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 7e90afc275a147c99616529dccc866cd (table default.Table_1a3a06a102bf495ab529ad893ed45d22 [id=9ed21405f8364c3ca3edc992fa68d588], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7e90afc275a147c99616529dccc866cd consensus state has no leader
I20260619 19:54:18.739502 1033 tablet_service.cc:1511] Processing CreateTablet for tablet b9fd5c556ae04b73867e1b28967520d2 (DEFAULT_TABLE table=default.Table_1980b85fb1e5469a917fe9eb7ad91a50 [id=db7d0e0e637e49aebfb449d85910d0ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.739959 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fd5c556ae04b73867e1b28967520d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.739768 526 catalog_manager.cc:5696] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:18.740658 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:18.743734 1034 tablet_service.cc:1511] Processing CreateTablet for tablet e12ad1228ed5406e8ac6c82f7ac621d7 (DEFAULT_TABLE table=default.Table_90338ea3099b45ecb387eadcbeef093b [id=ab82c583e9b14aefad2b6d080917bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.744194 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12ad1228ed5406e8ac6c82f7ac621d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.744189 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fcaeebaaa93c479bafff14d312d526ec (table default.Table_62fe6139c5d044fdbbb960537c4609d2 [id=47d4780785af4193b4ef32aa4b9c45f9]) successfully deleted
I20260619 19:54:18.746308 3123 raft_consensus.cc:493] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.746471 3123 raft_consensus.cc:515] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.746555 750 tablet_service.cc:1511] Processing CreateTablet for tablet e12ad1228ed5406e8ac6c82f7ac621d7 (DEFAULT_TABLE table=default.Table_90338ea3099b45ecb387eadcbeef093b [id=ab82c583e9b14aefad2b6d080917bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.746906 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12ad1228ed5406e8ac6c82f7ac621d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.747121 3123 leader_election.cc:290] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.748533 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2943333e572e4f1384b78d96a27d9c63" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:18.755802 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 5fcc9a948562461092da5bb781854652
I20260619 19:54:18.757658 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fcc9a948562461092da5bb781854652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.760324 754 tablet_service.cc:1511] Processing CreateTablet for tablet 888ce677bddb4072aecd2b799892b6b6 (DEFAULT_TABLE table=default.Table_bbe5d19016164023a3cea6a56764f446 [id=09ba8746f7bf4664b09248913c5e3247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.761202 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5bb390fdc5da4195aad76300af23656b" } new_table_name: "default.Table_8abcb74713e74debb89e2a80d9f8fdea" modify_external_catalogs: true
I20260619 19:54:18.761442 3048 consensus_queue.cc:1048] T 4841d03189e84deaa036f235946e877a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:18.764603 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2943333e572e4f1384b78d96a27d9c63" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:18.765858 1973 ts_tablet_manager.cc:1916] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.769222 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888ce677bddb4072aecd2b799892b6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.769490 720 leader_election.cc:304] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.769968 3123 raft_consensus.cc:2749] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.771445 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9b2db7fc24bd4e6b89758838f60b0ac5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.772557 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b2db7fc24bd4e6b89758838f60b0ac5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.777226 1200 tablet_bootstrap.cc:492] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.777379 1200 ts_tablet_manager.cc:1403] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.204s user 0.008s sys 0.045s
I20260619 19:54:18.778154 1200 raft_consensus.cc:359] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.778321 1200 raft_consensus.cc:385] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.778367 1200 raft_consensus.cc:740] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.778556 1200 consensus_queue.cc:260] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.779386 1200 ts_tablet_manager.cc:1434] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:18.779671 1200 tablet_bootstrap.cc:492] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.782837 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_54f50363519947bd8439607d2803a350"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.783584 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54f50363519947bd8439607d2803a350 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.783713 1200 tablet_bootstrap.cc:654] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.788394 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fcc9a948562461092da5bb781854652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.789502 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fcc9a948562461092da5bb781854652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.790868 896 tablet_service.cc:1511] Processing CreateTablet for tablet e12ad1228ed5406e8ac6c82f7ac621d7 (DEFAULT_TABLE table=default.Table_90338ea3099b45ecb387eadcbeef093b [id=ab82c583e9b14aefad2b6d080917bfa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.791405 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12ad1228ed5406e8ac6c82f7ac621d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:18.793280 1994 ts_tablet_manager.cc:1929] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.793426 1994 log.cc:1199] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d5ddb8412ad145dd85916bf5d756a9f0
I20260619 19:54:18.793771 1994 ts_tablet_manager.cc:1950] T d5ddb8412ad145dd85916bf5d756a9f0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.793948 1200 tablet_bootstrap.cc:492] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.794080 1200 ts_tablet_manager.cc:1403] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20260619 19:54:18.794737 1200 raft_consensus.cc:359] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.794924 1200 raft_consensus.cc:385] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.794889 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d5ddb8412ad145dd85916bf5d756a9f0 (table default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]) successfully deleted
I20260619 19:54:18.794973 1200 raft_consensus.cc:740] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:18.795876 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 1642bc8d3f984e1c9d60093fa7abcc53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1642bc8d3f984e1c9d60093fa7abcc53 already in progress: creating tablet
W20260619 19:54:18.796439 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet d88ba4ee21f84d869cd33c9f6896efdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d88ba4ee21f84d869cd33c9f6896efdf already in progress: creating tablet
W20260619 19:54:18.796733 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 5fcc9a948562461092da5bb781854652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fcc9a948562461092da5bb781854652 already in progress: creating tablet
I20260619 19:54:18.797519 1200 consensus_queue.cc:260] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.801366 1200 ts_tablet_manager.cc:1434] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:54:18.802158 1200 tablet_bootstrap.cc:492] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.803529 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1555379f7be54ebbadeddc4f04c4c669"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:18.804211 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1555379f7be54ebbadeddc4f04c4c669 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:18.806010 858 consensus_peers.cc:597] T 74f39941c13847d79e2b2c3ddd176533 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74f39941c13847d79e2b2c3ddd176533. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:18.806756 1200 tablet_bootstrap.cc:654] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.808099 1201 tablet_bootstrap.cc:492] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:18.808295 1201 ts_tablet_manager.cc:1403] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.211s user 0.018s sys 0.037s
I20260619 19:54:18.739081 2026 raft_consensus.cc:2243] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.808854 2026 raft_consensus.cc:2272] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.809418 2026 ts_tablet_manager.cc:1916] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.809499 1201 raft_consensus.cc:359] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.809712 1201 raft_consensus.cc:385] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.809805 1201 raft_consensus.cc:740] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.810056 1201 consensus_queue.cc:260] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.810197 1208 tablet_bootstrap.cc:492] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.810405 1208 ts_tablet_manager.cc:1403] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.215s user 0.007s sys 0.011s
I20260619 19:54:18.810694 1201 ts_tablet_manager.cc:1434] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:18.812137 1208 raft_consensus.cc:359] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.812309 3168 raft_consensus.cc:493] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.812434 1208 raft_consensus.cc:385] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.812469 3168 raft_consensus.cc:515] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.812569 1208 raft_consensus.cc:740] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.813058 1201 tablet_bootstrap.cc:492] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:18.813130 3168 leader_election.cc:290] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.813719 1208 consensus_queue.cc:260] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.814421 1208 ts_tablet_manager.cc:1434] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:18.814767 1201 tablet_bootstrap.cc:654] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.815829 1208 tablet_bootstrap.cc:492] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.825950 1201 tablet_bootstrap.cc:492] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:18.826509 1201 ts_tablet_manager.cc:1403] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260619 19:54:18.826845 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d01d2d98b64226b619255500498ffe" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.827248 1201 raft_consensus.cc:359] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:18.827486 1201 raft_consensus.cc:385] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.827589 1201 raft_consensus.cc:740] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.827801 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d01d2d98b64226b619255500498ffe" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:18.827951 1201 consensus_queue.cc:260] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:18.828797 1201 ts_tablet_manager.cc:1434] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:18.829103 1201 tablet_bootstrap.cc:492] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:18.829298 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90feb11ad7c447babcae31a6fc94d8de consensus state has no leader
I20260619 19:54:18.830541 1201 tablet_bootstrap.cc:654] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.831925 1973 ts_tablet_manager.cc:1929] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:18.832147 1973 log.cc:1199] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:54:18.833910 1200 tablet_bootstrap.cc:492] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.834057 1200 ts_tablet_manager.cc:1403] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.005s
I20260619 19:54:18.834748 1200 raft_consensus.cc:359] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.834923 1200 raft_consensus.cc:385] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.834980 1200 raft_consensus.cc:740] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.835242 1200 consensus_queue.cc:260] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:18.835779 996 leader_election.cc:343] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:18.836859 996 leader_election.cc:343] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:18.836992 996 leader_election.cc:304] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:18.837684 3168 raft_consensus.cc:2749] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:18.838716 1200 ts_tablet_manager.cc:1434] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 19:54:18.839023 1200 tablet_bootstrap.cc:492] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.840647 1200 tablet_bootstrap.cc:654] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.841087 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3998f275f66f44d48a5354c5e73ceb50 (DEFAULT_TABLE table=default.Table_e1485977ffee48529713dafd37bf30f0 [id=8bd5df9b5d854bee8a629167893cbdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:18.842756 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3998f275f66f44d48a5354c5e73ceb50. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:18.853524 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 766b8781524a4dcda809632e439af264 consensus state has no leader
I20260619 19:54:18.853971 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_194296d408ce42ee8dfb04120cc3af1c" } modify_external_catalogs: true
I20260619 19:54:18.854173 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_194296d408ce42ee8dfb04120cc3af1c" } modify_external_catalogs: true
I20260619 19:54:18.869004 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c008f33c8ae74120a621a08954129d2a" } modify_external_catalogs: true
I20260619 19:54:18.869221 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c008f33c8ae74120a621a08954129d2a" } modify_external_catalogs: true
I20260619 19:54:18.833490 1208 tablet_bootstrap.cc:654] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.871663 1973 ts_tablet_manager.cc:1950] T d0a9c96d9c034a4a8a4d05d8518ebcec P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.872124 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 596) took 4991 ms. Trace:
I20260619 19:54:18.872272 1973 rpcz_store.cc:276] 0619 19:54:13.880284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.881960 (+ 1676us) service_pool.cc:224] Handling call
0619 19:54:18.658882 (+4776922us) ts_tablet_manager.cc:1151] Deleting tablet d0a9c96d9c034a4a8a4d05d8518ebcec
0619 19:54:18.658890 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.828865 (+169975us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.831859 (+ 2994us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.872103 (+ 40244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4772583}
I20260619 19:54:18.872864 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d0a9c96d9c034a4a8a4d05d8518ebcec (table default.Table_5e374217e35c4c1aae543439fcf83a5c [id=935808dc656d4d6da2a6ad10bb9dbf7b]) successfully deleted
I20260619 19:54:18.873029 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 593) took 5019 ms. Trace:
I20260619 19:54:18.873114 1973 rpcz_store.cc:276] 0619 19:54:13.853132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.853893 (+ 761us) service_pool.cc:224] Handling call
0619 19:54:18.872861 (+5018968us) ts_tablet_manager.cc:1151] Deleting tablet a8b0d5d52f264281993fdb86c8658b88
0619 19:54:18.872873 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.873011 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4986439}
W20260619 19:54:18.873557 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a8b0d5d52f264281993fdb86c8658b88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8b0d5d52f264281993fdb86c8658b88 already in progress: creating tablet
I20260619 19:54:18.876344 2026 ts_tablet_manager.cc:1929] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:18.876489 2026 log.cc:1199] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/a54231986cca44258942dbc3373870b2
I20260619 19:54:18.876852 2026 ts_tablet_manager.cc:1950] T a54231986cca44258942dbc3373870b2 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:18.877823 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 324) took 13071 ms. Trace:
I20260619 19:54:18.880272 523 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a2911b5cfd2494287432e818d4ae19e from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:18.881510 1208 tablet_bootstrap.cc:492] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.881659 1208 ts_tablet_manager.cc:1403] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.006s
I20260619 19:54:18.882407 1208 raft_consensus.cc:359] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.882575 1208 raft_consensus.cc:385] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.882630 1208 raft_consensus.cc:740] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.882831 1208 consensus_queue.cc:260] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.893136 1208 ts_tablet_manager.cc:1434] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
W20260619 19:54:18.898325 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b1fbb31c1084a4aa851a7f7a2ad942f consensus state has no leader
I20260619 19:54:18.900249 1208 tablet_bootstrap.cc:492] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.900388 528 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5eb4005068684928b3b27ff73b108d1b (table default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566]). Expected version 1 got 0
I20260619 19:54:18.900702 528 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 2 got 0
I20260619 19:54:18.900915 528 catalog_manager.cc:5696] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:18.901458 528 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:18.903340 749 tablet_service.cc:1558] Processing DeleteTablet for tablet d703c5c2820642aab6dd1e500ce1e9fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:04 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.904454 1208 tablet_bootstrap.cc:654] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.909332 754 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a9c96d9c034a4a8a4d05d8518ebcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:13 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.917052 1208 tablet_bootstrap.cc:492] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:18.917623 1208 ts_tablet_manager.cc:1403] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.004s
I20260619 19:54:18.918649 1208 raft_consensus.cc:359] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.919519 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 598) took 5038 ms. Trace:
I20260619 19:54:18.920284 1973 rpcz_store.cc:276] 0619 19:54:13.880509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:13.881095 (+ 586us) service_pool.cc:224] Handling call
0619 19:54:18.919292 (+5038197us) ts_tablet_manager.cc:1151] Deleting tablet f96563f57f844df4814397f76ec42007
0619 19:54:18.919306 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.919461 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5032753}
W20260619 19:54:18.920974 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f96563f57f844df4814397f76ec42007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96563f57f844df4814397f76ec42007 already in progress: creating tablet
I20260619 19:54:18.923034 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 602) took 4818 ms. Trace:
I20260619 19:54:18.923503 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f658e85be0c843f2b02e4567a80521c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.924160 1200 tablet_bootstrap.cc:492] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:18.924306 1200 ts_tablet_manager.cc:1403] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.085s user 0.021s sys 0.021s
I20260619 19:54:18.924978 1200 raft_consensus.cc:359] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.925150 1200 raft_consensus.cc:385] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.925205 1200 raft_consensus.cc:740] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.916204 1201 tablet_bootstrap.cc:492] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:18.925447 1201 ts_tablet_manager.cc:1403] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.096s user 0.016s sys 0.021s
I20260619 19:54:18.925454 1200 consensus_queue.cc:260] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.926159 1201 raft_consensus.cc:359] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.926319 1201 raft_consensus.cc:385] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.926369 1201 raft_consensus.cc:740] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.926558 1201 consensus_queue.cc:260] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.927053 1201 ts_tablet_manager.cc:1434] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:18.927351 1201 tablet_bootstrap.cc:492] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:18.927425 1200 ts_tablet_manager.cc:1434] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:18.928686 1200 tablet_bootstrap.cc:492] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:18.928810 1201 tablet_bootstrap.cc:654] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.929365 3082 raft_consensus.cc:493] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.930986 1200 tablet_bootstrap.cc:654] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:18.931638 2026 rpcz_store.cc:276] 0619 19:54:05.830809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.840395 (+ 9586us) service_pool.cc:224] Handling call
0619 19:54:18.738753 (+12898358us) ts_tablet_manager.cc:1151] Deleting tablet a54231986cca44258942dbc3373870b2
0619 19:54:18.738763 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.837637 (+ 98874us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.876269 (+ 38632us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.877797 (+ 1528us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12898089}
I20260619 19:54:18.929520 3082 raft_consensus.cc:515] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.932934 3082 leader_election.cc:290] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:18.933089 1973 rpcz_store.cc:276] 0619 19:54:14.105035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.105124 (+ 89us) service_pool.cc:224] Handling call
0619 19:54:18.922850 (+4817726us) ts_tablet_manager.cc:1151] Deleting tablet 983faf8557814093bc427291711f3fce
0619 19:54:18.922864 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.922983 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4788286}
W20260619 19:54:18.934055 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 983faf8557814093bc427291711f3fce because the tablet was not found. No further retry: Not found: Tablet not found: 983faf8557814093bc427291711f3fce
I20260619 19:54:18.941907 1973 tablet_replica.cc:333] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:18.942159 1973 raft_consensus.cc:2243] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.942359 1973 raft_consensus.cc:2272] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:18.942482 719 leader_election.cc:343] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:18.942942 1973 ts_tablet_manager.cc:1916] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.941800 1208 raft_consensus.cc:385] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:18.947041 1208 raft_consensus.cc:740] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:18.947502 1208 consensus_queue.cc:260] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:18.952889 720 leader_election.cc:343] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:18.956135 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f8e48a3e5c1642f6b12adb0033f74404
I20260619 19:54:18.958110 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e48a3e5c1642f6b12adb0033f74404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.958400 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6
I20260619 19:54:18.959537 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e48a3e5c1642f6b12adb0033f74404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.959585 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 326) took 12984 ms. Trace:
I20260619 19:54:18.959636 1994 tablet_replica.cc:333] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:18.959739 898 tablet_service.cc:1558] Processing DeleteTablet for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:18.959848 1994 raft_consensus.cc:2243] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:18.960112 1994 raft_consensus.cc:2272] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.960500 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:18.960635 1994 ts_tablet_manager.cc:1916] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.961283 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7e3b1916ed824eccaf051b9832b14459" } modify_external_catalogs: true
I20260619 19:54:18.959677 2026 rpcz_store.cc:276] 0619 19:54:05.975187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:05.975243 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:18.938483 (+12963240us) ts_tablet_manager.cc:1151] Deleting tablet 7a0c189a1a614e0cbd0862291eb0962a
0619 19:54:18.959456 (+ 20973us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.959564 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12962974}
I20260619 19:54:18.961488 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7e3b1916ed824eccaf051b9832b14459" } modify_external_catalogs: true
W20260619 19:54:18.961771 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 7a0c189a1a614e0cbd0862291eb0962a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a0c189a1a614e0cbd0862291eb0962a already in progress: creating tablet
I20260619 19:54:18.962074 2026 tablet_replica.cc:333] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:18.962261 2026 raft_consensus.cc:2243] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:18.962569 2026 pending_rounds.cc:70] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:18.962618 2026 pending_rounds.cc:77] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 2 index: 4 } timestamp: 7298657687043944448 op_type: NO_OP noop_request { }
I20260619 19:54:18.962702 2026 raft_consensus.cc:2889] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:18.962771 2026 raft_consensus.cc:2272] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.963323 754 tablet_service.cc:1558] Processing DeleteTablet for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.965044 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8abcb74713e74debb89e2a80d9f8fdea" } new_table_name: "default.Table_9520b80a3d694580acf4a715a2ba15c8" modify_external_catalogs: true
I20260619 19:54:18.966903 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_01335e4fae1a405488b2bb5fd6d71576"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:18.967272 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_82c02ca7771f4f82b3e8c9d066e7463e" } new_table_name: "default.Table_13ba00e41a354f01a1fc3043a75a933f" modify_external_catalogs: true
W20260619 19:54:18.967607 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01335e4fae1a405488b2bb5fd6d71576 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.967721 1994 ts_tablet_manager.cc:1929] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:18.967836 1994 log.cc:1199] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/f8e48a3e5c1642f6b12adb0033f74404
I20260619 19:54:18.969637 1973 ts_tablet_manager.cc:1929] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:18.969774 1973 log.cc:1199] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fe814880d9984bbd83fa121cb2a34eac
I20260619 19:54:18.969966 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f9c88e691c944cbb8c6e440fb6e88f4c" } modify_external_catalogs: true
I20260619 19:54:18.970068 1208 ts_tablet_manager.cc:1434] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.052s user 0.000s sys 0.002s
I20260619 19:54:18.970182 1994 ts_tablet_manager.cc:1950] T f8e48a3e5c1642f6b12adb0033f74404 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:18.970166 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f9c88e691c944cbb8c6e440fb6e88f4c" } modify_external_catalogs: true
I20260619 19:54:18.970890 1973 ts_tablet_manager.cc:1950] T fe814880d9984bbd83fa121cb2a34eac P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:18.971391 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_25922a60fdaf453e99a91488af6264ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:18.971560 720 leader_election.cc:304] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:18.971915 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25922a60fdaf453e99a91488af6264ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:18.971990 3123 raft_consensus.cc:2749] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:18.972643 3082 raft_consensus.cc:493] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:18.972766 3082 raft_consensus.cc:515] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.973026 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet f8e48a3e5c1642f6b12adb0033f74404 (table default.Table_194296d408ce42ee8dfb04120cc3af1c [id=55b6b9eae3ed41a487ea1b9468cd518f]) successfully deleted
W20260619 19:54:18.973301 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 already in progress: creating tablet
I20260619 19:54:18.973882 1208 tablet_bootstrap.cc:492] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:18.974463 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 603) took 4868 ms. Trace:
I20260619 19:54:18.974536 1973 rpcz_store.cc:276] 0619 19:54:14.105599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.105658 (+ 59us) service_pool.cc:224] Handling call
0619 19:54:18.933365 (+4827707us) ts_tablet_manager.cc:1151] Deleting tablet fe814880d9984bbd83fa121cb2a34eac
0619 19:54:18.936629 (+ 3264us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.956580 (+ 19951us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.969572 (+ 12992us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:18.974448 (+ 4876us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4798734}
I20260619 19:54:18.974812 1973 tablet_replica.cc:333] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:18.974974 1973 raft_consensus.cc:2243] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:18.975104 1973 raft_consensus.cc:2272] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:18.975632 1973 ts_tablet_manager.cc:1916] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.976261 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e48a3e5c1642f6b12adb0033f74404 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:18.979225 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fe814880d9984bbd83fa121cb2a34eac (table default.Table_6c755150293e4861b3e1403d72ead695 [id=55ec6de1c2744eb39dba9656343893b9]) successfully deleted
I20260619 19:54:18.982499 2953 raft_consensus.cc:493] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.982666 2953 raft_consensus.cc:515] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.983352 2953 leader_election.cc:290] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.984632 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658e85be0c843f2b02e4567a80521c4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:18.984812 774 raft_consensus.cc:2468] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:18.984906 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0792952592fc49f689802e7d04d7a474" } modify_external_catalogs: true
I20260619 19:54:18.985173 3082 leader_election.cc:290] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:18.985419 859 leader_election.cc:343] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f658e85be0c843f2b02e4567a80521c4
I20260619 19:54:18.985824 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0792952592fc49f689802e7d04d7a474" } modify_external_catalogs: true
W20260619 19:54:18.988505 720 leader_election.cc:343] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 801f08f4daa842238460506ccd0c466f
I20260619 19:54:18.990789 858 leader_election.cc:304] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:18.991173 3047 raft_consensus.cc:493] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:18.991303 3047 raft_consensus.cc:515] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:18.991755 2026 ts_tablet_manager.cc:1916] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:18.991925 3047 leader_election.cc:290] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:18.992069 3047 raft_consensus.cc:2804] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:18.992121 3047 raft_consensus.cc:493] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:18.992172 3047 raft_consensus.cc:3060] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:18.994694 3047 raft_consensus.cc:515] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:18.999902 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a331d2baf5d4f3081f9eab3589fddbd consensus state has no leader
I20260619 19:54:19.000192 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb4005068684928b3b27ff73b108d1b" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.000442 1054 raft_consensus.cc:2468] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.000360 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b900de7a833f4bef95b679661a5b879c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.000764 898 tablet_service.cc:1558] Processing DeleteTablet for tablet fcaeebaaa93c479bafff14d312d526ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.001078 859 leader_election.cc:304] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:19.001140 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b900de7a833f4bef95b679661a5b879c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.001341 2953 raft_consensus.cc:2804] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.001412 2953 raft_consensus.cc:493] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.001464 2953 raft_consensus.cc:3060] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.001530 896 tablet_service.cc:1558] Processing DeleteTablet for tablet a54231986cca44258942dbc3373870b2 with delete_type TABLET_DATA_DELETED (replaced by tablet d6bc861cb7d941f380671105fd338538) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.000797 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.001823 916 raft_consensus.cc:2468] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:19.003996 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8596f5d31bc14fe7bc5a232cacd51819"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.004154 2953 raft_consensus.cc:515] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:19.004633 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8596f5d31bc14fe7bc5a232cacd51819 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.005000 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb4005068684928b3b27ff73b108d1b" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.005208 774 raft_consensus.cc:2468] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.005923 2953 leader_election.cc:290] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.005955 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb4005068684928b3b27ff73b108d1b" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:19.006126 1054 raft_consensus.cc:3060] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.007700 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet cffd890a5f594a4b91cb2f5c3235fcad
I20260619 19:54:19.007915 3047 leader_election.cc:290] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:19.009087 859 leader_election.cc:343] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f658e85be0c843f2b02e4567a80521c4
I20260619 19:54:19.009105 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet cffd890a5f594a4b91cb2f5c3235fcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.009351 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 56640f773efb4123b93f4ca3799ddde7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:19.010478 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b1fbb31c1084a4aa851a7f7a2ad942f consensus state has no leader
I20260619 19:54:19.011576 1054 raft_consensus.cc:2468] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.012156 859 leader_election.cc:304] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:19.012669 3047 raft_consensus.cc:2804] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.012847 3047 raft_consensus.cc:697] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
W20260619 19:54:19.013084 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cffd890a5f594a4b91cb2f5c3235fcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cffd890a5f594a4b91cb2f5c3235fcad already in progress: creating tablet
I20260619 19:54:19.013211 3047 consensus_queue.cc:237] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.016173 900 tablet_service.cc:1558] Processing DeleteTablet for tablet cffd890a5f594a4b91cb2f5c3235fcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.017115 1973 ts_tablet_manager.cc:1929] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.017334 1973 log.cc:1199] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/47ace991ad1a4d52ab609940aacf6681
I20260619 19:54:19.022490 2026 ts_tablet_manager.cc:1929] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.4
I20260619 19:54:19.023950 1208 tablet_bootstrap.cc:654] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.024933 719 leader_election.cc:304] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.025283 3082 raft_consensus.cc:2804] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:19.025377 3082 raft_consensus.cc:493] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:19.025449 3082 raft_consensus.cc:3060] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:19.026099 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f658e85be0c843f2b02e4567a80521c4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:19.026271 774 raft_consensus.cc:3060] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.027281 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb4005068684928b3b27ff73b108d1b" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:19.027441 781 raft_consensus.cc:3060] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.028764 3082 raft_consensus.cc:515] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.030051 781 raft_consensus.cc:2468] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.030216 3082 leader_election.cc:290] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:19.030961 720 leader_election.cc:343] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 801f08f4daa842238460506ccd0c466f
I20260619 19:54:19.032217 774 raft_consensus.cc:2468] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.036108 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_cb61a4cd0fb34e5fac83fbb8e82629a6" } new_table_name: "default.Table_3853a71b95df4ea0a94a14786dd429b2" modify_external_catalogs: true
W20260619 19:54:19.027485 858 consensus_peers.cc:597] T 3ce88d3d4ea340dcaa9d8e26f9a047a7 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ce88d3d4ea340dcaa9d8e26f9a047a7. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:19.041354 858 leader_election.cc:304] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.033134 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "801f08f4daa842238460506ccd0c466f" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:19.041803 916 raft_consensus.cc:3060] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:19.043722 3116 raft_consensus.cc:2804] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.043854 3116 raft_consensus.cc:697] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:19.044107 3116 consensus_queue.cc:237] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.044122 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_18160f4089474041ada260354eb41a97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:19.044735 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18160f4089474041ada260354eb41a97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.053103 916 raft_consensus.cc:2468] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
I20260619 19:54:19.053682 3168 raft_consensus.cc:493] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.053858 3168 raft_consensus.cc:515] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.054468 3168 leader_election.cc:290] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.055251 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7877d111a0438da74b7bcf396e2c71" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.055536 719 leader_election.cc:304] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.056140 3082 raft_consensus.cc:2804] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:19.056407 3082 raft_consensus.cc:697] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:19.056684 3082 consensus_queue.cc:237] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.057885 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7877d111a0438da74b7bcf396e2c71" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:19.058622 996 leader_election.cc:343] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:19.060562 996 leader_election.cc:343] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.060727 996 leader_election.cc:304] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:19.061225 3168 raft_consensus.cc:2749] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.064201 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e51a6ce3d9ea48d09b42531d3923a957" } new_table_name: "default.Table_b3d57687272044e884cf734b328e2df2" modify_external_catalogs: true
I20260619 19:54:19.065363 1973 ts_tablet_manager.cc:1950] T 47ace991ad1a4d52ab609940aacf6681 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.065380 3047 raft_consensus.cc:493] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.065614 3047 raft_consensus.cc:515] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.067255 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_12e89619bc914902b7f38712ecd70ba3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.067870 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 604) took 4961 ms. Trace:
W20260619 19:54:19.068069 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12e89619bc914902b7f38712ecd70ba3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.068508 1973 rpcz_store.cc:276] 0619 19:54:14.106043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.106099 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:18.974774 (+4868675us) ts_tablet_manager.cc:1151] Deleting tablet 47ace991ad1a4d52ab609940aacf6681
0619 19:54:18.974781 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:18.998592 (+ 23811us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.017048 (+ 18456us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.067850 (+ 50802us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4840106}
I20260619 19:54:19.069366 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 47ace991ad1a4d52ab609940aacf6681 (table default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a]) successfully deleted
I20260619 19:54:19.069439 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f69d2e3ee384eb9997bed7d594c919d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.069623 774 raft_consensus.cc:2468] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.069895 1973 tablet_replica.cc:333] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.069990 858 leader_election.cc:304] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.070294 1973 raft_consensus.cc:2243] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.070348 2953 raft_consensus.cc:2804] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.070430 2953 raft_consensus.cc:493] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.070492 2953 raft_consensus.cc:3060] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.071761 1973 raft_consensus.cc:2272] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:19.071832 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 798c54ef8cde4020903153f72d6e3b1a consensus state has no leader
I20260619 19:54:19.072341 1973 ts_tablet_manager.cc:1916] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.073354 2953 raft_consensus.cc:515] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.074779 2953 leader_election.cc:290] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:19.074856 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f69d2e3ee384eb9997bed7d594c919d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:19.075080 3123 raft_consensus.cc:493] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.075217 3123 raft_consensus.cc:515] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.075845 3123 leader_election.cc:290] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.075973 1054 raft_consensus.cc:3060] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.076794 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f69d2e3ee384eb9997bed7d594c919d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.077513 3047 leader_election.cc:290] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:19.078707 1054 raft_consensus.cc:2468] T 9f69d2e3ee384eb9997bed7d594c919d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.079120 859 leader_election.cc:304] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:19.079609 3047 raft_consensus.cc:2804] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.079774 781 raft_consensus.cc:3060] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.080060 3047 raft_consensus.cc:697] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:19.083232 3047 consensus_queue.cc:237] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.082774 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d80f1e8037ef4877ba34575bdaf2d6fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:19.084664 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d80f1e8037ef4877ba34575bdaf2d6fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:19.085207 719 leader_election.cc:343] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: f305a99e3481419196532cb5c62c2500
I20260619 19:54:19.085489 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f69d2e3ee384eb9997bed7d594c919d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:19.085652 774 raft_consensus.cc:3060] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.087172 750 tablet_service.cc:1558] Processing DeleteTablet for tablet cffd890a5f594a4b91cb2f5c3235fcad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:19.087713 720 leader_election.cc:343] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f305a99e3481419196532cb5c62c2500
I20260619 19:54:19.087839 720 leader_election.cc:304] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.088037 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 7afe86e5d9c341cbadc821203e603af6
I20260619 19:54:19.088200 3123 raft_consensus.cc:2749] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.089709 774 raft_consensus.cc:2468] T 9f69d2e3ee384eb9997bed7d594c919d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.090883 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 7afe86e5d9c341cbadc821203e603af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.091602 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 7afe86e5d9c341cbadc821203e603af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.091905 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 7afe86e5d9c341cbadc821203e603af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:19.093182 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7afe86e5d9c341cbadc821203e603af6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7afe86e5d9c341cbadc821203e603af6 already in progress: creating tablet
I20260619 19:54:19.099359 3048 raft_consensus.cc:493] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:19.099532 3048 raft_consensus.cc:515] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.100143 3048 leader_election.cc:290] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:19.101022 1201 tablet_bootstrap.cc:492] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.101162 1201 ts_tablet_manager.cc:1403] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.174s user 0.005s sys 0.003s
I20260619 19:54:19.101856 1201 raft_consensus.cc:359] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.102022 1201 raft_consensus.cc:385] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.102074 1201 raft_consensus.cc:740] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.102288 1201 consensus_queue.cc:260] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.102761 1201 ts_tablet_manager.cc:1434] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:19.102695 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ad28ce3b193d467594d095dd90fbe05a" } new_table_name: "default.Table_4920911a4b9b4696a3fa06c1033f9024" modify_external_catalogs: true
I20260619 19:54:19.103048 1201 tablet_bootstrap.cc:492] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:19.104827 859 leader_election.cc:343] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:19.105585 1201 tablet_bootstrap.cc:654] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:19.111891 858 leader_election.cc:343] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:19.112046 858 leader_election.cc:304] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.112692 2953 raft_consensus.cc:2749] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:19.117707 1208 tablet_bootstrap.cc:492] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.117964 1208 ts_tablet_manager.cc:1403] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.144s user 0.005s sys 0.006s
I20260619 19:54:19.118793 1208 raft_consensus.cc:359] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.119045 1208 raft_consensus.cc:385] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.119158 1208 raft_consensus.cc:740] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.119433 1208 consensus_queue.cc:260] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.120453 1208 ts_tablet_manager.cc:1434] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:19.120790 1208 tablet_bootstrap.cc:492] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.122193 1208 tablet_bootstrap.cc:654] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.124523 3115 raft_consensus.cc:493] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:19.124687 3115 raft_consensus.cc:515] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.125275 3115 leader_election.cc:290] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:19.126411 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d58f88d65ca4786a9a62876b3eeec0e consensus state has no leader
I20260619 19:54:19.127521 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1c6851ff802d47eabe403f442af83038"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:19.127655 859 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
W20260619 19:54:19.128811 858 leader_election.cc:343] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d651c8fb8ff244a5a09dd9ea593ecb14
I20260619 19:54:19.128916 858 leader_election.cc:304] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.129146 3048 raft_consensus.cc:2749] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:19.130534 1200 tablet_bootstrap.cc:492] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:19.130752 1200 ts_tablet_manager.cc:1403] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.202s user 0.014s sys 0.007s
I20260619 19:54:19.131597 1200 raft_consensus.cc:359] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.131858 1200 raft_consensus.cc:385] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.132475 1973 ts_tablet_manager.cc:1929] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:19.132473 1200 raft_consensus.cc:740] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.132622 1973 log.cc:1199] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/2c71f92f4e3040c09b67e287a19eea74
I20260619 19:54:19.132656 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_db402dcea7cd491e9df3af4494176e2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.133008 1973 ts_tablet_manager.cc:1950] T 2c71f92f4e3040c09b67e287a19eea74 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.133172 1200 consensus_queue.cc:260] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.133359 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 605) took 5026 ms. Trace:
I20260619 19:54:19.133447 1973 rpcz_store.cc:276] 0619 19:54:14.107160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.107252 (+ 92us) service_pool.cc:224] Handling call
0619 19:54:19.069097 (+4961845us) ts_tablet_manager.cc:1151] Deleting tablet 2c71f92f4e3040c09b67e287a19eea74
0619 19:54:19.069854 (+ 757us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.123493 (+ 53639us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.132406 (+ 8913us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.133342 (+ 936us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4934386}
I20260619 19:54:19.137739 1200 ts_tablet_manager.cc:1434] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260619 19:54:19.139204 1200 tablet_bootstrap.cc:492] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:19.147867 1208 tablet_bootstrap.cc:492] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.148057 1208 ts_tablet_manager.cc:1403] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260619 19:54:19.148742 1208 raft_consensus.cc:359] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.148908 1208 raft_consensus.cc:385] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.148952 1208 raft_consensus.cc:740] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.148947 3168 raft_consensus.cc:493] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.149118 3168 raft_consensus.cc:515] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.149561 3106 tablet.cc:1724] T 2943333e572e4f1384b78d96a27d9c63 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:19.149834 3168 leader_election.cc:290] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.152163 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:19.152808 996 leader_election.cc:343] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.155059 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.155674 1208 consensus_queue.cc:260] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:19.155759 996 leader_election.cc:343] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.155906 996 leader_election.cc:304] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:19.156432 1208 ts_tablet_manager.cc:1434] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260619 19:54:19.156467 3168 raft_consensus.cc:2749] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.156724 1208 tablet_bootstrap.cc:492] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.158092 1973 tablet_replica.cc:333] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.158913 1973 raft_consensus.cc:2243] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.158967 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_23ed9bfc10694076b2162ad7e9d92712"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.161518 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1491bf4decd34cceb722de0e75008614" } modify_external_catalogs: true
I20260619 19:54:19.161772 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1491bf4decd34cceb722de0e75008614" } modify_external_catalogs: true
I20260619 19:54:19.161806 1973 raft_consensus.cc:2272] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.162315 1973 ts_tablet_manager.cc:1916] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.164968 2026 log.cc:1199] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/221cc85629ca41e9ad71adfe0beb392a
I20260619 19:54:19.165838 2026 ts_tablet_manager.cc:1950] T 221cc85629ca41e9ad71adfe0beb392a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:19.169302 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e2d05f5175346f9b21958b139ae80f1 consensus state has no leader
I20260619 19:54:19.169766 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e" } modify_external_catalogs: true
I20260619 19:54:19.170009 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_897e42b48d2f45d8bbe68f6cbbc5ac5e" } modify_external_catalogs: true
I20260619 19:54:19.171556 1208 tablet_bootstrap.cc:654] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.173563 1200 tablet_bootstrap.cc:654] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:19.175534 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23ed9bfc10694076b2162ad7e9d92712 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.134084 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 2c71f92f4e3040c09b67e287a19eea74 (table default.Table_64d25d0d86ef4a70a981ebed6a29e834 [id=2269d802204a4c9189f2eda909734b08]) successfully deleted
W20260619 19:54:19.176440 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c6851ff802d47eabe403f442af83038 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:19.177649 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db402dcea7cd491e9df3af4494176e2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.180152 3168 raft_consensus.cc:493] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.180308 3168 raft_consensus.cc:515] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.180951 3168 leader_election.cc:290] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.181684 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0991105460f749e1854d512304ff56cd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:19.182242 996 leader_election.cc:343] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.183221 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0991105460f749e1854d512304ff56cd" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:19.183831 996 leader_election.cc:343] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.183943 996 leader_election.cc:304] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:19.184378 3168 raft_consensus.cc:2749] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.185081 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 327) took 13132 ms. Trace:
I20260619 19:54:19.185230 2026 rpcz_store.cc:276] 0619 19:54:06.053130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.053197 (+ 67us) service_pool.cc:224] Handling call
0619 19:54:18.962024 (+12908827us) ts_tablet_manager.cc:1151] Deleting tablet 221cc85629ca41e9ad71adfe0beb392a
0619 19:54:18.962034 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.019151 (+ 57117us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.022420 (+ 3269us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.185057 (+162637us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12908621}
I20260619 19:54:19.185832 2026 tablet_replica.cc:333] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:19.185966 1973 ts_tablet_manager.cc:1929] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.185977 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 221cc85629ca41e9ad71adfe0beb392a (table default.Table_94d5b0a1504044b7a1934b5c726b29d4 [id=96dda797fa474e119e765b5d9946bfb7]) successfully deleted
I20260619 19:54:19.186087 1973 log.cc:1199] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/10f6e202e8fd4a7292774d5eb4c7266b
I20260619 19:54:19.186170 2026 raft_consensus.cc:2243] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.186378 1973 ts_tablet_manager.cc:1950] T 10f6e202e8fd4a7292774d5eb4c7266b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.186390 2026 raft_consensus.cc:2272] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.187017 2026 ts_tablet_manager.cc:1916] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.192220 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 606) took 5084 ms. Trace:
I20260619 19:54:19.192327 1973 rpcz_store.cc:276] 0619 19:54:14.107730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.107907 (+ 177us) service_pool.cc:224] Handling call
0619 19:54:19.158046 (+5050139us) ts_tablet_manager.cc:1151] Deleting tablet 10f6e202e8fd4a7292774d5eb4c7266b
0619 19:54:19.158055 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.165263 (+ 7208us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.185912 (+ 20649us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.192198 (+ 6286us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5023295}
I20260619 19:54:19.192703 1973 tablet_replica.cc:333] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.192922 1973 raft_consensus.cc:2243] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.193084 1973 raft_consensus.cc:2272] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.194223 531 master_service.cc:960] ReplaceTablet: received request to replace tablet ddfe76640e5641fdb02ef53fddd8df2a from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:19.196296 3106 tablet.cc:1724] T 1e65ca84182d40c280ec2b0555c0de86 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:19.199646 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 10f6e202e8fd4a7292774d5eb4c7266b (table default.Table_6d1f0f1124cb46138d7584cfd183ea34 [id=8eaf4a5b0ebb448bbb0fdd09953c2bd3]) successfully deleted
I20260619 19:54:19.204224 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_31824e64fa474d55b20d52c779cb886f" } new_table_name: "default.Table_a6d2655e6c1645f48c94f6a3445c826e" modify_external_catalogs: true
I20260619 19:54:19.208582 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2cfcddad05dd4568a710cb6fd4a38935"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.209321 1973 ts_tablet_manager.cc:1916] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.222666 1200 tablet_bootstrap.cc:492] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:19.222831 1200 ts_tablet_manager.cc:1403] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.000s
I20260619 19:54:19.223928 1200 raft_consensus.cc:359] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.224320 1200 raft_consensus.cc:385] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.224400 1200 raft_consensus.cc:740] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.224707 1200 consensus_queue.cc:260] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.232005 3168 raft_consensus.cc:493] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.232189 3168 raft_consensus.cc:515] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.232791 3168 leader_election.cc:290] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.233268 1201 tablet_bootstrap.cc:492] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.233443 1201 ts_tablet_manager.cc:1403] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.130s user 0.015s sys 0.011s
I20260619 19:54:19.234114 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.234181 1201 raft_consensus.cc:359] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.234498 1201 raft_consensus.cc:385] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.234594 1201 raft_consensus.cc:740] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.234880 1201 consensus_queue.cc:260] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:19.235337 996 leader_election.cc:343] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.235606 1201 ts_tablet_manager.cc:1434] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:19.236040 1201 tablet_bootstrap.cc:492] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.236526 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:19.238052 996 leader_election.cc:343] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.238183 996 leader_election.cc:304] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:19.238561 3168 raft_consensus.cc:2749] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.239805 1200 ts_tablet_manager.cc:1434] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260619 19:54:19.240238 1200 tablet_bootstrap.cc:492] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:19.241146 3116 raft_consensus.cc:493] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.241425 3116 raft_consensus.cc:515] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.242002 3047 raft_consensus.cc:493] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:19.242100 3116 leader_election.cc:290] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.242157 3047 raft_consensus.cc:515] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.242861 3047 leader_election.cc:290] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.243005 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.243420 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.245265 1201 tablet_bootstrap.cc:654] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:19.245445 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cfcddad05dd4568a710cb6fd4a38935 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.251458 781 raft_consensus.cc:1275] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Refusing update from remote peer 95181cc281b946c8b81aa825232d9498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260619 19:54:19.252065 3047 consensus_queue.cc:1048] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:19.261664 1973 ts_tablet_manager.cc:1929] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.262820 1200 tablet_bootstrap.cc:654] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.267326 1201 tablet_bootstrap.cc:492] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.267746 1201 ts_tablet_manager.cc:1403] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20260619 19:54:19.267946 3224 tablet.cc:1724] T 1e65ca84182d40c280ec2b0555c0de86 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:19.268640 1201 raft_consensus.cc:359] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.268814 1201 raft_consensus.cc:385] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.268865 1201 raft_consensus.cc:740] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.269049 1201 consensus_queue.cc:260] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.269511 1201 ts_tablet_manager.cc:1434] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:19.269798 1201 tablet_bootstrap.cc:492] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.270278 2953 raft_consensus.cc:493] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.270449 2953 raft_consensus.cc:515] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.271605 2953 leader_election.cc:290] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.262621 1208 tablet_bootstrap.cc:492] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.272478 1208 ts_tablet_manager.cc:1403] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.116s user 0.001s sys 0.011s
I20260619 19:54:19.271755 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5482cf46c91d426484938c387b785d61" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.273188 777 raft_consensus.cc:2468] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.273659 858 leader_election.cc:304] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.273747 1208 raft_consensus.cc:359] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.274072 1208 raft_consensus.cc:385] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.274175 1208 raft_consensus.cc:740] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.274484 2953 raft_consensus.cc:2804] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.274560 2953 raft_consensus.cc:493] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.274633 2953 raft_consensus.cc:3060] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.274407 1208 consensus_queue.cc:260] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.275509 1208 ts_tablet_manager.cc:1434] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:19.276074 1208 tablet_bootstrap.cc:492] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.276238 2026 ts_tablet_manager.cc:1929] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:19.278017 1208 tablet_bootstrap.cc:654] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.278650 1973 log.cc:1199] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9d905e7076014c818e1fb1ef09c15342
I20260619 19:54:19.279031 1973 ts_tablet_manager.cc:1950] T 9d905e7076014c818e1fb1ef09c15342 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.279388 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 607) took 5100 ms. Trace:
I20260619 19:54:19.279505 1973 rpcz_store.cc:276] 0619 19:54:14.178522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.178584 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:19.192645 (+5014061us) ts_tablet_manager.cc:1151] Deleting tablet 9d905e7076014c818e1fb1ef09c15342
0619 19:54:19.192657 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.218311 (+ 25654us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.261548 (+ 43237us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.279374 (+ 17826us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5013847}
I20260619 19:54:19.280078 1973 tablet_replica.cc:333] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.280071 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9d905e7076014c818e1fb1ef09c15342 (table default.Table_4d84da14868f41e5afe84ea58bd57ab9 [id=6e5582a72f36485783705cfb2f671ddb]) successfully deleted
I20260619 19:54:19.280296 1973 raft_consensus.cc:2243] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.280500 1973 raft_consensus.cc:2272] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.281073 1973 ts_tablet_manager.cc:1916] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.278085 2953 raft_consensus.cc:515] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.284404 2953 leader_election.cc:290] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.284672 2026 log.cc:1199] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/991c877feeae43c580d9471c25c4424c
I20260619 19:54:19.285081 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5482cf46c91d426484938c387b785d61" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:19.285780 777 raft_consensus.cc:3060] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.282315 1201 tablet_bootstrap.cc:654] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.287644 2026 ts_tablet_manager.cc:1950] T 991c877feeae43c580d9471c25c4424c P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:19.288136 3082 raft_consensus.cc:493] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.288322 3082 raft_consensus.cc:515] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.288527 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 328) took 13226 ms. Trace:
I20260619 19:54:19.288595 777 raft_consensus.cc:2468] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.289465 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.290910 3082 leader_election.cc:290] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.289155 858 leader_election.cc:304] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.290762 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a19f43793b4440b7a9d2652a75e6bd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.292292 2026 rpcz_store.cc:276] 0619 19:54:06.061825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.061883 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:19.185778 (+13123895us) ts_tablet_manager.cc:1151] Deleting tablet 991c877feeae43c580d9471c25c4424c
0619 19:54:19.185791 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.189936 (+ 4145us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.276175 (+ 86239us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.288504 (+ 12329us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13123705}
I20260619 19:54:19.292650 2953 raft_consensus.cc:2804] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.292829 2953 raft_consensus.cc:697] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:19.292879 719 leader_election.cc:304] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.293218 2953 consensus_queue.cc:237] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.294162 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 329) took 13108 ms. Trace:
I20260619 19:54:19.294653 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 991c877feeae43c580d9471c25c4424c (table default.Table_0bbd4672f505430eaf0de7479560b0ee [id=5962b400e8ef4a4a821a8f964c73d730]) successfully deleted
I20260619 19:54:19.294674 2026 rpcz_store.cc:276] 0619 19:54:06.183868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.184098 (+ 230us) service_pool.cc:224] Handling call
0619 19:54:19.292560 (+13108462us) ts_tablet_manager.cc:1151] Deleting tablet e055ee491a784c58a95c7780ed1dee6c
0619 19:54:19.292572 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.292672 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13108293}
W20260619 19:54:19.295315 858 consensus_peers.cc:597] T 88c9073ef30d456d8dc8609ddf1335ce P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:19.296211 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e055ee491a784c58a95c7780ed1dee6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e055ee491a784c58a95c7780ed1dee6c already in progress: creating tablet
I20260619 19:54:19.296753 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 330) took 13112 ms. Trace:
I20260619 19:54:19.298978 2026 rpcz_store.cc:276] 0619 19:54:06.184042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.184303 (+ 261us) service_pool.cc:224] Handling call
0619 19:54:19.296658 (+13112355us) ts_tablet_manager.cc:1151] Deleting tablet 6ef20e35c612400bbbf1c707a36ced8c
0619 19:54:19.296668 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.296736 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13112203}
I20260619 19:54:19.300323 1208 tablet_bootstrap.cc:492] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.300484 1208 ts_tablet_manager.cc:1403] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260619 19:54:19.301219 1208 raft_consensus.cc:359] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.301409 1208 raft_consensus.cc:385] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.301461 1208 raft_consensus.cc:740] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.301743 1208 consensus_queue.cc:260] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.302141 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 331) took 13115 ms. Trace:
I20260619 19:54:19.302386 2026 rpcz_store.cc:276] 0619 19:54:06.185935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.185984 (+ 49us) service_pool.cc:224] Handling call
0619 19:54:19.301286 (+13115302us) ts_tablet_manager.cc:1151] Deleting tablet 2a3fa43017fa4c278111c29d0d22f7da
0619 19:54:19.301299 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.301382 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13115151}
W20260619 19:54:19.304054 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 2a3fa43017fa4c278111c29d0d22f7da because the tablet was not found. No further retry: Not found: Tablet not found: 2a3fa43017fa4c278111c29d0d22f7da
I20260619 19:54:19.304216 3082 raft_consensus.cc:2749] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.304669 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 332) took 13068 ms. Trace:
I20260619 19:54:19.306490 1973 ts_tablet_manager.cc:1929] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:19.307283 2026 rpcz_store.cc:276] 0619 19:54:06.235905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.235953 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:19.304566 (+13068613us) ts_tablet_manager.cc:1151] Deleting tablet 5d772e0bd2d4420f836fa14ca2dadb24
0619 19:54:19.304577 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.304650 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13068404}
I20260619 19:54:19.309711 1201 tablet_bootstrap.cc:492] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.311112 1201 ts_tablet_manager.cc:1403] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.002s
W20260619 19:54:19.311403 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 5d772e0bd2d4420f836fa14ca2dadb24 because the tablet was not found. No further retry: Not found: Tablet not found: 5d772e0bd2d4420f836fa14ca2dadb24
I20260619 19:54:19.311884 1201 raft_consensus.cc:359] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.312059 1201 raft_consensus.cc:385] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.312109 1201 raft_consensus.cc:740] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.312300 1201 consensus_queue.cc:260] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.312719 1201 ts_tablet_manager.cc:1434] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260619 19:54:19.311501 1208 ts_tablet_manager.cc:1434] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20260619 19:54:19.313326 1208 tablet_bootstrap.cc:492] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.314904 1208 tablet_bootstrap.cc:654] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.315613 1973 log.cc:1199] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/88c9073ef30d456d8dc8609ddf1335ce
I20260619 19:54:19.316128 1973 ts_tablet_manager.cc:1950] T 88c9073ef30d456d8dc8609ddf1335ce P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.317034 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 608) took 5129 ms. Trace:
I20260619 19:54:19.323697 1973 rpcz_store.cc:276] 0619 19:54:14.187934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.188006 (+ 72us) service_pool.cc:224] Handling call
0619 19:54:19.280032 (+5092026us) ts_tablet_manager.cc:1151] Deleting tablet 88c9073ef30d456d8dc8609ddf1335ce
0619 19:54:19.280042 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.303027 (+ 22985us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.306430 (+ 3403us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.317011 (+ 10581us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5091775}
I20260619 19:54:19.324781 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 88c9073ef30d456d8dc8609ddf1335ce (table default.Table_81965bd42e674af7a540c53e595dc804 [id=47800ee54fac40698e9f6cbf26219788]) successfully deleted
I20260619 19:54:19.324868 1973 tablet_replica.cc:333] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.325069 1973 raft_consensus.cc:2243] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.325240 1973 raft_consensus.cc:2272] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.326846 1973 ts_tablet_manager.cc:1916] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.334002 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 333) took 12963 ms. Trace:
I20260619 19:54:19.334229 2026 rpcz_store.cc:276] 0619 19:54:06.370615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.370677 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:19.311856 (+12941179us) ts_tablet_manager.cc:1151] Deleting tablet b289d3068d184d47b671617213aa512a
0619 19:54:19.331379 (+ 19523us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.333966 (+ 2587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12940973}
W20260619 19:54:19.334844 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b289d3068d184d47b671617213aa512a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b289d3068d184d47b671617213aa512a already in progress: creating tablet
I20260619 19:54:19.334978 1208 tablet_bootstrap.cc:492] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.335122 1208 ts_tablet_manager.cc:1403] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20260619 19:54:19.335465 1201 tablet_bootstrap.cc:492] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.335908 1208 raft_consensus.cc:359] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.336087 1208 raft_consensus.cc:385] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.336143 1208 raft_consensus.cc:740] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.336335 1208 consensus_queue.cc:260] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.336853 1208 ts_tablet_manager.cc:1434] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:19.337365 1201 tablet_bootstrap.cc:654] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.337451 1208 tablet_bootstrap.cc:492] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.338286 3047 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:19.338426 3047 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.339008 3047 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:19.339524 1208 tablet_bootstrap.cc:654] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:19.340426 858 consensus_peers.cc:597] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:19.340610 858 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:19.348729 1201 tablet_bootstrap.cc:492] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.349020 1201 ts_tablet_manager.cc:1403] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.003s
I20260619 19:54:19.349267 1973 ts_tablet_manager.cc:1929] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:19.349532 1973 log.cc:1199] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/5fb6712fc0994154aa5022ec16cec1ae
I20260619 19:54:19.350049 1973 ts_tablet_manager.cc:1950] T 5fb6712fc0994154aa5022ec16cec1ae P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.350257 1201 raft_consensus.cc:359] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.350492 1201 raft_consensus.cc:385] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.350540 1201 raft_consensus.cc:740] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.350769 1201 consensus_queue.cc:260] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.351627 1201 ts_tablet_manager.cc:1434] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:19.352003 1201 tablet_bootstrap.cc:492] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.352367 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 609) took 5095 ms. Trace:
I20260619 19:54:19.352943 1973 rpcz_store.cc:276] 0619 19:54:14.256475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.256562 (+ 87us) service_pool.cc:224] Handling call
0619 19:54:19.324802 (+5068240us) ts_tablet_manager.cc:1151] Deleting tablet 5fb6712fc0994154aa5022ec16cec1ae
0619 19:54:19.324816 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.333070 (+ 8254us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.349198 (+ 16128us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.352342 (+ 3144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5068040}
I20260619 19:54:19.353891 1201 tablet_bootstrap.cc:654] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.353935 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 5fb6712fc0994154aa5022ec16cec1ae (table default.Table_f73f70bc21854a9ab4c2d2fda8fbd8cb [id=e609ecfc781f4164a11f7b02e3dfbe26]) successfully deleted
I20260619 19:54:19.354689 1208 tablet_bootstrap.cc:492] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.354842 1208 ts_tablet_manager.cc:1403] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260619 19:54:19.355607 1208 raft_consensus.cc:359] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.355820 1208 raft_consensus.cc:385] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.355875 1208 raft_consensus.cc:740] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.356068 1208 consensus_queue.cc:260] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.357846 1208 ts_tablet_manager.cc:1434] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:19.358796 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70184f5fb2bc459682ddbc9e0fc48b8d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.358963 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5482cf46c91d426484938c387b785d61" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.359200 1053 raft_consensus.cc:2468] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.359048 1057 raft_consensus.cc:2393] T 70184f5fb2bc459682ddbc9e0fc48b8d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:19.359754 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5482cf46c91d426484938c387b785d61" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:19.359951 1058 raft_consensus.cc:3060] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.360070 1208 tablet_bootstrap.cc:492] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.361136 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 610) took 5063 ms. Trace:
I20260619 19:54:19.361217 1973 rpcz_store.cc:276] 0619 19:54:14.297886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.297972 (+ 86us) service_pool.cc:224] Handling call
0619 19:54:19.353829 (+5055857us) ts_tablet_manager.cc:1151] Deleting tablet c47b97e1eeed4f20bfe001fa48dc0471
0619 19:54:19.353842 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.361116 (+ 7274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5055635}
I20260619 19:54:19.362612 1208 tablet_bootstrap.cc:654] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.363680 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 611) took 5016 ms. Trace:
I20260619 19:54:19.363758 1973 rpcz_store.cc:276] 0619 19:54:14.347507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.347571 (+ 64us) service_pool.cc:224] Handling call
0619 19:54:19.363539 (+5015968us) ts_tablet_manager.cc:1151] Deleting tablet 988e0a8b1b5b4f7cb68674af923454cf
0619 19:54:19.363549 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.363663 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5015754}
W20260619 19:54:19.364171 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c47b97e1eeed4f20bfe001fa48dc0471 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c47b97e1eeed4f20bfe001fa48dc0471 already in progress: creating tablet
I20260619 19:54:19.364224 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 612) took 5013 ms. Trace:
I20260619 19:54:19.364295 1973 rpcz_store.cc:276] 0619 19:54:14.350391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.350445 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:19.364127 (+5013682us) ts_tablet_manager.cc:1151] Deleting tablet 8fd9525ba72d45b089442a6e6a73cc74
0619 19:54:19.364136 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.364210 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5013521}
W20260619 19:54:19.364467 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 988e0a8b1b5b4f7cb68674af923454cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 988e0a8b1b5b4f7cb68674af923454cf already in progress: creating tablet
W20260619 19:54:19.364672 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8fd9525ba72d45b089442a6e6a73cc74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fd9525ba72d45b089442a6e6a73cc74 already in progress: creating tablet
I20260619 19:54:19.364739 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 613) took 5005 ms. Trace:
I20260619 19:54:19.365417 1058 raft_consensus.cc:2468] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.364823 1973 rpcz_store.cc:276] 0619 19:54:14.359484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.359538 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:19.364609 (+5005071us) ts_tablet_manager.cc:1151] Deleting tablet e84dba59116149e5aeb65d79a4d2e5fc
0619 19:54:19.364617 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.364725 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5004925}
I20260619 19:54:19.367643 1973 tablet_replica.cc:333] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:19.367641 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e84dba59116149e5aeb65d79a4d2e5fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e84dba59116149e5aeb65d79a4d2e5fc already in progress: creating tablet
I20260619 19:54:19.367908 1973 raft_consensus.cc:2243] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.368125 1973 raft_consensus.cc:2272] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.368716 1973 ts_tablet_manager.cc:1916] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:19.374716 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 77628.5us
W20260619 19:54:19.387707 858 consensus_peers.cc:597] T 2c71f92f4e3040c09b67e287a19eea74 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c71f92f4e3040c09b67e287a19eea74. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:19.374235 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:44433, user_credentials={real_user=slave}} blocked reactor thread for 117800us
W20260619 19:54:19.390978 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c8a5b81449c4b4bbcd22bf6cb7c522f consensus state has no leader
I20260619 19:54:19.392568 1201 tablet_bootstrap.cc:492] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.392731 1201 ts_tablet_manager.cc:1403] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.002s
I20260619 19:54:19.393144 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5f0c69fbe322403aad471900afe7bea7" } modify_external_catalogs: true
I20260619 19:54:19.393422 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5f0c69fbe322403aad471900afe7bea7" } modify_external_catalogs: true
I20260619 19:54:19.393498 1201 raft_consensus.cc:359] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.393682 1201 raft_consensus.cc:385] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.393729 1201 raft_consensus.cc:740] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.393910 1201 consensus_queue.cc:260] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.394402 1201 ts_tablet_manager.cc:1434] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:19.394726 1201 tablet_bootstrap.cc:492] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.395964 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 334) took 12988 ms. Trace:
I20260619 19:54:19.396106 2026 rpcz_store.cc:276] 0619 19:54:06.407416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.407469 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:19.334628 (+12927159us) ts_tablet_manager.cc:1151] Deleting tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f
0619 19:54:19.395749 (+ 61121us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.395943 (+ 194us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12926969}
I20260619 19:54:19.396557 1201 tablet_bootstrap.cc:654] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:19.396728 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f already in progress: creating tablet
I20260619 19:54:19.397153 2026 tablet_replica.cc:333] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:19.397397 2026 raft_consensus.cc:2243] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.397635 2026 raft_consensus.cc:2272] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.398243 2026 ts_tablet_manager.cc:1916] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.404462 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_906aa3cdbfd5474989f1f99803b0751d" } new_table_name: "default.Table_2c9cb6dfbd7f4c3e850b37657574964d" modify_external_catalogs: true
I20260619 19:54:19.413235 1973 ts_tablet_manager.cc:1929] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:19.413398 1973 log.cc:1199] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/ca6d7f30c5a84106bebebc42eedee654
I20260619 19:54:19.413769 1973 ts_tablet_manager.cc:1950] T ca6d7f30c5a84106bebebc42eedee654 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.414549 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 614) took 4874 ms. Trace:
I20260619 19:54:19.414659 1973 rpcz_store.cc:276] 0619 19:54:14.539900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:14.539971 (+ 71us) service_pool.cc:224] Handling call
0619 19:54:19.367586 (+4827615us) ts_tablet_manager.cc:1151] Deleting tablet ca6d7f30c5a84106bebebc42eedee654
0619 19:54:19.367596 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.372046 (+ 4450us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.398935 (+ 26889us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.414524 (+ 15589us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4827420}
I20260619 19:54:19.415196 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 615) took 4104 ms. Trace:
I20260619 19:54:19.415280 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet ca6d7f30c5a84106bebebc42eedee654 (table default.Table_247be2054e924a3885a4822bb5c4c2d3 [id=cb0dfc15d9414ae3b63638e94c05c0a5]) successfully deleted
I20260619 19:54:19.415283 1973 rpcz_store.cc:276] 0619 19:54:15.310789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.310854 (+ 65us) service_pool.cc:224] Handling call
0619 19:54:19.415026 (+4104172us) ts_tablet_manager.cc:1151] Deleting tablet 73029f4bc97349da9d5d2fae4321cd5f
0619 19:54:19.415038 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.415178 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4036147}
I20260619 19:54:19.415587 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 616) took 4104 ms. Trace:
W20260619 19:54:19.415884 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 73029f4bc97349da9d5d2fae4321cd5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73029f4bc97349da9d5d2fae4321cd5f already in progress: creating tablet
I20260619 19:54:19.416751 1201 tablet_bootstrap.cc:492] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.416887 1201 ts_tablet_manager.cc:1403] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.003s
I20260619 19:54:19.417733 1201 raft_consensus.cc:359] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:19.417804 859 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 8614b0ab1a3749a1a0aa441574f79ab1
I20260619 19:54:19.417929 1201 raft_consensus.cc:385] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.417997 1201 raft_consensus.cc:740] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.417976 859 leader_election.cc:304] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.418166 1201 consensus_queue.cc:260] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.418340 3116 raft_consensus.cc:2749] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:19.418656 1201 ts_tablet_manager.cc:1434] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:19.419184 859 leader_election.cc:304] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.419529 3116 raft_consensus.cc:3060] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.422277 3116 raft_consensus.cc:2749] T 70184f5fb2bc459682ddbc9e0fc48b8d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.415658 1973 rpcz_store.cc:276] 0619 19:54:15.310882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.311075 (+ 193us) service_pool.cc:224] Handling call
0619 19:54:19.415493 (+4104418us) ts_tablet_manager.cc:1151] Deleting tablet 9c977ca621224d7ab73a9e9f39540c86
0619 19:54:19.415502 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.415573 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4036550}
I20260619 19:54:19.423492 1973 tablet_replica.cc:333] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.423996 1973 raft_consensus.cc:2243] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:19.424247 1973 pending_rounds.cc:70] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:19.424288 1973 pending_rounds.cc:77] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7298657726698700800 op_type: NO_OP noop_request { }
I20260619 19:54:19.424386 1973 raft_consensus.cc:2889] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:19.424460 1973 raft_consensus.cc:2272] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:19.424866 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9c977ca621224d7ab73a9e9f39540c86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c977ca621224d7ab73a9e9f39540c86 already in progress: creating tablet
W20260619 19:54:19.427083 859 consensus_peers.cc:597] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2902c7f67a1402987315ee426ddf1d2. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:19.428756 3123 raft_consensus.cc:493] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:19.428993 3123 raft_consensus.cc:515] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.430287 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.430496 916 raft_consensus.cc:2468] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:19.430522 1973 ts_tablet_manager.cc:1916] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.431092 719 leader_election.cc:304] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.431514 3082 raft_consensus.cc:2804] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:19.431669 3082 raft_consensus.cc:493] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:19.431846 3082 raft_consensus.cc:3060] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:19.433210 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5eb4005068684928b3b27ff73b108d1b (table default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566]). Expected version 1 got 0
I20260619 19:54:19.435465 524 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 9e7877d111a0438da74b7bcf396e2c71 (table default.Table_7adacc85728b464dbf461645536524d3 [id=e1f11bc6739d4427b75f310028bef998]). Expected version 1 got 0
I20260619 19:54:19.435695 524 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet deba56eb121e4aa6b8ad7b13951723aa (table default.Table_d602ef9e9e5648128426b910a80e1f39 [id=2738114efd1f43d4a7f797f9b12f7398]). Expected version 1 got 0
I20260619 19:54:19.435573 3082 raft_consensus.cc:515] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.437419 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8614b0ab1a3749a1a0aa441574f79ab1" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:19.437731 916 raft_consensus.cc:3060] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:19.440616 916 raft_consensus.cc:2468] T 8614b0ab1a3749a1a0aa441574f79ab1 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 2.
I20260619 19:54:19.441314 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b18a61d955e4929998b90c6c8fa844e with delete_type TABLET_DATA_DELETED (replaced by tablet ca02c454eec840eb9289950b6da7b131) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.441594 1994 tablet_replica.cc:333] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:19.441792 1994 raft_consensus.cc:2243] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.441970 1994 raft_consensus.cc:2272] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.442673 1994 ts_tablet_manager.cc:1916] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.443583 719 leader_election.cc:304] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.448647 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 221cc85629ca41e9ad71adfe0beb392a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:05 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.448892 896 tablet_service.cc:1558] Processing DeleteTablet for tablet f658e85be0c843f2b02e4567a80521c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.449515 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 0091be765a2142eeb7d93609ed27428c (DEFAULT_TABLE table=default.Table_f3f755f497a44326b8f2c7e87db573bc [id=9ce8887ba5df4842aa2acb76224a311d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.449937 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0091be765a2142eeb7d93609ed27428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.450935 1200 tablet_bootstrap.cc:492] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:19.451061 1200 ts_tablet_manager.cc:1403] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.211s user 0.025s sys 0.000s
I20260619 19:54:19.451363 1973 ts_tablet_manager.cc:1929] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260619 19:54:19.451465 1973 log.cc:1199] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/801f08f4daa842238460506ccd0c466f
I20260619 19:54:19.451772 1973 ts_tablet_manager.cc:1950] T 801f08f4daa842238460506ccd0c466f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.451855 1200 raft_consensus.cc:359] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.452029 1200 raft_consensus.cc:385] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.452077 1200 raft_consensus.cc:740] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.452242 1200 consensus_queue.cc:260] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.452793 1200 ts_tablet_manager.cc:1434] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:19.453070 1200 tablet_bootstrap.cc:492] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:19.454388 1200 tablet_bootstrap.cc:654] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.455360 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 633) took 4017 ms. Trace:
I20260619 19:54:19.456214 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a82f6be881884cca84cd758a368b815c (DEFAULT_TABLE table=default.Table_211ccb0b3f0b4fea8e50ed8735b58916 [id=58bd545fc0ba4748ab2a5957fb9134ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.456617 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82f6be881884cca84cd758a368b815c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.456480 1973 rpcz_store.cc:276] 0619 19:54:15.437455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.452020 (+ 14565us) service_pool.cc:224] Handling call
0619 19:54:19.423434 (+3971414us) ts_tablet_manager.cc:1151] Deleting tablet 801f08f4daa842238460506ccd0c466f
0619 19:54:19.423447 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.433997 (+ 10550us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.451305 (+ 17308us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.455327 (+ 4022us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3971224}
I20260619 19:54:19.457024 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 632) took 4019 ms. Trace:
I20260619 19:54:19.457113 1973 rpcz_store.cc:276] 0619 19:54:15.437312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.455921 (+ 18609us) service_pool.cc:224] Handling call
0619 19:54:19.456845 (+4000924us) ts_tablet_manager.cc:1151] Deleting tablet a977e889c36b434388fc7a3a5cd42e8c
0619 19:54:19.456858 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.457003 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4000619}
I20260619 19:54:19.457432 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 638) took 3992 ms. Trace:
I20260619 19:54:19.457492 1973 rpcz_store.cc:276] 0619 19:54:15.464614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.471221 (+ 6607us) service_pool.cc:224] Handling call
0619 19:54:19.457339 (+3986118us) ts_tablet_manager.cc:1151] Deleting tablet d1d23b9d751c48ad858a35771b0ded61
0619 19:54:19.457347 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.457419 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3985923}
I20260619 19:54:19.457743 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 643) took 3971 ms. Trace:
I20260619 19:54:19.457798 1973 rpcz_store.cc:276] 0619 19:54:15.485893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.490906 (+ 5013us) service_pool.cc:224] Handling call
0619 19:54:19.457664 (+3966758us) ts_tablet_manager.cc:1151] Deleting tablet d2939b8aa0d44ad2a05a933db4ea64be
0619 19:54:19.457671 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.457731 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3966592}
I20260619 19:54:19.458030 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 642) took 3972 ms. Trace:
I20260619 19:54:19.458082 1973 rpcz_store.cc:276] 0619 19:54:15.485804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.496762 (+ 10958us) service_pool.cc:224] Handling call
0619 19:54:19.457955 (+3961193us) ts_tablet_manager.cc:1151] Deleting tablet f6ce69e12fd643ea88c26d941424c2ab
0619 19:54:19.457961 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.458019 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3960845}
I20260619 19:54:19.458400 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 641) took 3972 ms. Trace:
I20260619 19:54:19.458452 1973 rpcz_store.cc:276] 0619 19:54:15.485705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.721615 (+235910us) service_pool.cc:224] Handling call
0619 19:54:19.458322 (+3736707us) ts_tablet_manager.cc:1151] Deleting tablet ed116f9d309a45dfa9fb175247502448
0619 19:54:19.458329 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.458386 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3736485}
I20260619 19:54:19.458693 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 663) took 3652 ms. Trace:
I20260619 19:54:19.458743 1973 rpcz_store.cc:276] 0619 19:54:15.806702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.806886 (+ 184us) service_pool.cc:224] Handling call
0619 19:54:19.458614 (+3651728us) ts_tablet_manager.cc:1151] Deleting tablet 32ecd267aa34469cad9db0745178013b
0619 19:54:19.458620 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.458682 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3651547}
I20260619 19:54:19.458978 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 665) took 3646 ms. Trace:
I20260619 19:54:19.459028 1973 rpcz_store.cc:276] 0619 19:54:15.812775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.812920 (+ 145us) service_pool.cc:224] Handling call
0619 19:54:19.458907 (+3645987us) ts_tablet_manager.cc:1151] Deleting tablet 904dd2aac07347a5979f6607bbe5665f
0619 19:54:19.458913 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.458967 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3645753}
I20260619 19:54:19.459270 1973 tablet_replica.cc:333] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.459438 1973 raft_consensus.cc:2243] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.460747 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0091be765a2142eeb7d93609ed27428c (DEFAULT_TABLE table=default.Table_f3f755f497a44326b8f2c7e87db573bc [id=9ce8887ba5df4842aa2acb76224a311d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.461453 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 22e7bbccbd2a4be2af5d6f1be32657aa (DEFAULT_TABLE table=default.Table_b14adf8fae244e7ba3e4fe985bccbfce [id=7536d358eabe4e6f8bb8673ca2266bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.461654 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 801f08f4daa842238460506ccd0c466f (table default.Table_7960e324594b4ee68f9f29a77162cc92 [id=e21bf9fe2c944b2b801fe5304ec7f99d]) successfully deleted
I20260619 19:54:19.461815 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e7bbccbd2a4be2af5d6f1be32657aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:19.461926 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a977e889c36b434388fc7a3a5cd42e8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a977e889c36b434388fc7a3a5cd42e8c already in progress: creating tablet
W20260619 19:54:19.462147 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d1d23b9d751c48ad858a35771b0ded61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1d23b9d751c48ad858a35771b0ded61 already in progress: creating tablet
W20260619 19:54:19.462356 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d2939b8aa0d44ad2a05a933db4ea64be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2939b8aa0d44ad2a05a933db4ea64be already in progress: creating tablet
W20260619 19:54:19.462553 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f6ce69e12fd643ea88c26d941424c2ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6ce69e12fd643ea88c26d941424c2ab already in progress: creating tablet
W20260619 19:54:19.462762 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ed116f9d309a45dfa9fb175247502448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed116f9d309a45dfa9fb175247502448 already in progress: creating tablet
W20260619 19:54:19.462962 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 32ecd267aa34469cad9db0745178013b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32ecd267aa34469cad9db0745178013b already in progress: creating tablet
I20260619 19:54:19.463562 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2cfc4144ae324893b1fc813e30986a24 (DEFAULT_TABLE table=default.Table_0d01627300e842e2b4a9b29e3e8aebaf [id=1e1e0ef59a5c4c2cb458282611af9963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.463886 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cfc4144ae324893b1fc813e30986a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.463986 900 tablet_service.cc:1511] Processing CreateTablet for tablet a82f6be881884cca84cd758a368b815c (DEFAULT_TABLE table=default.Table_211ccb0b3f0b4fea8e50ed8735b58916 [id=58bd545fc0ba4748ab2a5957fb9134ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.467649 1200 tablet_bootstrap.cc:492] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:19.467785 1200 ts_tablet_manager.cc:1403] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
W20260619 19:54:19.468777 858 consensus_peers.cc:597] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41455237399b45efbe8190dcb01e764c. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:19.468863 1200 raft_consensus.cc:359] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.469048 1200 raft_consensus.cc:385] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.469112 1200 raft_consensus.cc:740] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
W20260619 19:54:19.469081 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 904dd2aac07347a5979f6607bbe5665f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 904dd2aac07347a5979f6607bbe5665f already in progress: creating tablet
I20260619 19:54:19.469343 1200 consensus_queue.cc:260] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.469372 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1881a6355bbd415c8fb506920fe86ce2 (DEFAULT_TABLE table=default.Table_26e4f1885f51419ca85efa668d514121 [id=c89dd17ddc2a4f1e9cdedf716fa85466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.469777 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1881a6355bbd415c8fb506920fe86ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.470180 1200 ts_tablet_manager.cc:1434] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:19.470336 898 tablet_service.cc:1511] Processing CreateTablet for tablet 22e7bbccbd2a4be2af5d6f1be32657aa (DEFAULT_TABLE table=default.Table_b14adf8fae244e7ba3e4fe985bccbfce [id=7536d358eabe4e6f8bb8673ca2266bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.470428 1200 tablet_bootstrap.cc:492] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:19.470705 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2cfc4144ae324893b1fc813e30986a24 (DEFAULT_TABLE table=default.Table_0d01627300e842e2b4a9b29e3e8aebaf [id=1e1e0ef59a5c4c2cb458282611af9963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.474195 1994 ts_tablet_manager.cc:1929] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.474308 1994 log.cc:1199] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/1b18a61d955e4929998b90c6c8fa844e
I20260619 19:54:19.474582 1994 ts_tablet_manager.cc:1950] T 1b18a61d955e4929998b90c6c8fa844e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:19.476379 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 1b18a61d955e4929998b90c6c8fa844e (table default.Table_4a534d852e184f36a8e7ea2922979897 [id=5d2c41238c64437a970164bc23f8368e]) successfully deleted
I20260619 19:54:19.477970 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 0c699cbfd0f04202885a301e19af8136 (DEFAULT_TABLE table=default.Table_accf378b438e453b85c3fbc643f51b49 [id=9c8c2c93c9a24e1f863da535a2940e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.478601 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 8959c2b88d82427781968f5b98b045da (DEFAULT_TABLE table=default.Table_97f7804c5583458ca9d73013d1351e6d [id=f6d3479ef7fe4752aa2f2a3bff07bf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.479321 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c699cbfd0f04202885a301e19af8136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.480125 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1881a6355bbd415c8fb506920fe86ce2 (DEFAULT_TABLE table=default.Table_26e4f1885f51419ca85efa668d514121 [id=c89dd17ddc2a4f1e9cdedf716fa85466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.480530 899 tablet_service.cc:1511] Processing CreateTablet for tablet d58ba14b5ec544d9b4a683a725c80540 (DEFAULT_TABLE table=default.Table_249836bd3ffd4db8ac846ceca943afd8 [id=ae29a695b0354f7aaa2fc6ba45ff44dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.481068 890 tablet_service.cc:1511] Processing CreateTablet for tablet 0c699cbfd0f04202885a301e19af8136 (DEFAULT_TABLE table=default.Table_accf378b438e453b85c3fbc643f51b49 [id=9c8c2c93c9a24e1f863da535a2940e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.481104 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8959c2b88d82427781968f5b98b045da (DEFAULT_TABLE table=default.Table_97f7804c5583458ca9d73013d1351e6d [id=f6d3479ef7fe4752aa2f2a3bff07bf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.482221 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d58ba14b5ec544d9b4a683a725c80540 (DEFAULT_TABLE table=default.Table_249836bd3ffd4db8ac846ceca943afd8 [id=ae29a695b0354f7aaa2fc6ba45ff44dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.482602 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58ba14b5ec544d9b4a683a725c80540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.482959 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 84dec96b7f2c4732850b046a46ac957d (DEFAULT_TABLE table=default.Table_ff3a1abe6e54481ebeafa310778691f3 [id=206fd6271efa40339f00bb8a7c1d1b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.460282 750 tablet_service.cc:1511] Processing CreateTablet for tablet 0091be765a2142eeb7d93609ed27428c (DEFAULT_TABLE table=default.Table_f3f755f497a44326b8f2c7e87db573bc [id=9ce8887ba5df4842aa2acb76224a311d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.483364 1973 raft_consensus.cc:2272] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.483263 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8959c2b88d82427781968f5b98b045da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.483508 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0091be765a2142eeb7d93609ed27428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.483918 1973 ts_tablet_manager.cc:1916] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.464597 754 tablet_service.cc:1511] Processing CreateTablet for tablet a82f6be881884cca84cd758a368b815c (DEFAULT_TABLE table=default.Table_211ccb0b3f0b4fea8e50ed8735b58916 [id=58bd545fc0ba4748ab2a5957fb9134ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.464668 749 tablet_service.cc:1511] Processing CreateTablet for tablet 22e7bbccbd2a4be2af5d6f1be32657aa (DEFAULT_TABLE table=default.Table_b14adf8fae244e7ba3e4fe985bccbfce [id=7536d358eabe4e6f8bb8673ca2266bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.471376 758 tablet_service.cc:1511] Processing CreateTablet for tablet 2cfc4144ae324893b1fc813e30986a24 (DEFAULT_TABLE table=default.Table_0d01627300e842e2b4a9b29e3e8aebaf [id=1e1e0ef59a5c4c2cb458282611af9963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.471688 765 tablet_service.cc:1511] Processing CreateTablet for tablet 1881a6355bbd415c8fb506920fe86ce2 (DEFAULT_TABLE table=default.Table_26e4f1885f51419ca85efa668d514121 [id=c89dd17ddc2a4f1e9cdedf716fa85466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.481482 759 tablet_service.cc:1511] Processing CreateTablet for tablet d58ba14b5ec544d9b4a683a725c80540 (DEFAULT_TABLE table=default.Table_249836bd3ffd4db8ac846ceca943afd8 [id=ae29a695b0354f7aaa2fc6ba45ff44dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.481544 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0c699cbfd0f04202885a301e19af8136 (DEFAULT_TABLE table=default.Table_accf378b438e453b85c3fbc643f51b49 [id=9c8c2c93c9a24e1f863da535a2940e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.481714 764 tablet_service.cc:1511] Processing CreateTablet for tablet 84dec96b7f2c4732850b046a46ac957d (DEFAULT_TABLE table=default.Table_ff3a1abe6e54481ebeafa310778691f3 [id=206fd6271efa40339f00bb8a7c1d1b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.481819 755 tablet_service.cc:1511] Processing CreateTablet for tablet 8959c2b88d82427781968f5b98b045da (DEFAULT_TABLE table=default.Table_97f7804c5583458ca9d73013d1351e6d [id=f6d3479ef7fe4752aa2f2a3bff07bf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.487469 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82f6be881884cca84cd758a368b815c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.487709 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1881a6355bbd415c8fb506920fe86ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.487866 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cfc4144ae324893b1fc813e30986a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.488059 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58ba14b5ec544d9b4a683a725c80540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.489151 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dec96b7f2c4732850b046a46ac957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.489254 1200 tablet_bootstrap.cc:654] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.491350 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c699cbfd0f04202885a301e19af8136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.495337 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dec96b7f2c4732850b046a46ac957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.499403 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8959c2b88d82427781968f5b98b045da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.503396 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e7bbccbd2a4be2af5d6f1be32657aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.506542 3234 raft_consensus.cc:2804] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 19:54:19.506650 3234 raft_consensus.cc:697] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:19.506852 3234 consensus_queue.cc:237] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.513928 1973 ts_tablet_manager.cc:1929] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.514092 1973 log.cc:1199] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/eb4b1e87f2e84bcaaa07ff9f687b9e3d
I20260619 19:54:19.514550 1973 ts_tablet_manager.cc:1950] T eb4b1e87f2e84bcaaa07ff9f687b9e3d P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.515537 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 669) took 3664 ms. Trace:
I20260619 19:54:19.515677 1973 rpcz_store.cc:276] 0619 19:54:15.851487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.851567 (+ 80us) service_pool.cc:224] Handling call
0619 19:54:19.459230 (+3607663us) ts_tablet_manager.cc:1151] Deleting tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d
0619 19:54:19.459237 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.496823 (+ 37586us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.513844 (+ 17021us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.515512 (+ 1668us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3570485}
I20260619 19:54:19.516098 1973 tablet_replica.cc:333] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.516356 1973 raft_consensus.cc:2243] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.516535 1973 raft_consensus.cc:2272] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.517238 1973 ts_tablet_manager.cc:1916] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.524438 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet eb4b1e87f2e84bcaaa07ff9f687b9e3d (table default.Table_384d87b1154345fd9feaa4bac544af49 [id=282cf765f9e04a38a724e2d4a6f3245c]) successfully deleted
I20260619 19:54:19.525010 3116 consensus_queue.cc:1048] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:19.526036 3248 consensus_queue.cc:1048] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:19.531759 3116 raft_consensus.cc:493] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.531903 3116 raft_consensus.cc:515] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.532429 3116 leader_election.cc:290] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.533298 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56640f773efb4123b93f4ca3799ddde7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.533497 777 raft_consensus.cc:2468] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.535493 3082 leader_election.cc:290] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.537089 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 88baec5f763547fd9e1b7dd49d96db17 (DEFAULT_TABLE table=default.Table_5754e690c96a48968ff02e778777a567 [id=1aaccb8ae5634705ae06bd7de4e19077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.537202 3123 leader_election.cc:290] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.537597 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88baec5f763547fd9e1b7dd49d96db17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.540153 1200 tablet_bootstrap.cc:492] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:19.540294 1200 ts_tablet_manager.cc:1403] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.070s user 0.006s sys 0.003s
I20260619 19:54:19.540992 1200 raft_consensus.cc:359] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.541155 1200 raft_consensus.cc:385] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.541278 1200 raft_consensus.cc:740] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.541477 1200 consensus_queue.cc:260] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.542001 1200 ts_tablet_manager.cc:1434] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:19.542287 1200 tablet_bootstrap.cc:492] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:19.542559 903 tablet_service.cc:1511] Processing CreateTablet for tablet 84dec96b7f2c4732850b046a46ac957d (DEFAULT_TABLE table=default.Table_ff3a1abe6e54481ebeafa310778691f3 [id=206fd6271efa40339f00bb8a7c1d1b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.543499 892 tablet_service.cc:1511] Processing CreateTablet for tablet 88baec5f763547fd9e1b7dd49d96db17 (DEFAULT_TABLE table=default.Table_5754e690c96a48968ff02e778777a567 [id=1aaccb8ae5634705ae06bd7de4e19077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.543773 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 50bc884e4c304309a326b21a3c059fd4 (DEFAULT_TABLE table=default.Table_fd82efdfad7d457190095d1d9d0359a1 [id=fd0b66ad5ed3441b8cd7ab05b3f5149a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.543982 858 leader_election.cc:304] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.544142 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bc884e4c304309a326b21a3c059fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.544217 1200 tablet_bootstrap.cc:654] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.544428 3116 raft_consensus.cc:2804] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.544518 3116 raft_consensus.cc:493] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260619 19:54:19.546742 859 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:19.546861 859 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.547461 3047 raft_consensus.cc:2749] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:54:19.547655 3168 raft_consensus.cc:493] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.547767 3168 raft_consensus.cc:515] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.548331 3168 leader_election.cc:290] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.549206 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244971a6b0b424db6d16d233b32a96e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.549372 919 raft_consensus.cc:2468] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:19.550135 996 leader_election.cc:304] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
W20260619 19:54:19.553676 720 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 8614b0ab1a3749a1a0aa441574f79ab1
W20260619 19:54:19.553995 720 leader_election.cc:343] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 8614b0ab1a3749a1a0aa441574f79ab1
I20260619 19:54:19.554106 1973 ts_tablet_manager.cc:1929] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.554207 1973 log.cc:1199] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f305a99e3481419196532cb5c62c2500
I20260619 19:54:19.554535 1973 ts_tablet_manager.cc:1950] T f305a99e3481419196532cb5c62c2500 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.557246 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c812e5c1b9a4403d939e2b99bdabb738 (DEFAULT_TABLE table=default.Table_8464dd18d8124733b29929afbe73c8ca [id=a9fdb4608a6a44cea5dd38f9520d3c17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.557363 3168 raft_consensus.cc:2804] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.557423 3168 raft_consensus.cc:493] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.557488 3168 raft_consensus.cc:3060] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.557682 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c812e5c1b9a4403d939e2b99bdabb738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.559969 3168 raft_consensus.cc:515] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.560288 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 670) took 3708 ms. Trace:
I20260619 19:54:19.560377 1973 rpcz_store.cc:276] 0619 19:54:15.851590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.851806 (+ 216us) service_pool.cc:224] Handling call
0619 19:54:19.516035 (+3664229us) ts_tablet_manager.cc:1151] Deleting tablet f305a99e3481419196532cb5c62c2500
0619 19:54:19.516048 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.551176 (+ 35128us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.554046 (+ 2870us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.560263 (+ 6217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3626429}
I20260619 19:54:19.560705 1973 tablet_replica.cc:333] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.560907 1973 raft_consensus.cc:2243] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:19.561467 859 consensus_peers.cc:597] T 5fb6712fc0994154aa5022ec16cec1ae P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fb6712fc0994154aa5022ec16cec1ae. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:19.561759 859 leader_election.cc:343] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 56640f773efb4123b93f4ca3799ddde7
I20260619 19:54:19.562315 2953 consensus_queue.cc:1048] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:19.563678 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_99ad2921377b43608418af63d31c135f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.564060 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244971a6b0b424db6d16d233b32a96e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:19.564203 919 raft_consensus.cc:3060] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:19.564307 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ad2921377b43608418af63d31c135f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.565687 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6b0e7c1abd8f4f6680e74faf06b14ea0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:19.566201 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b0e7c1abd8f4f6680e74faf06b14ea0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.566777 919 raft_consensus.cc:2468] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:19.567466 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d5682c9323624c1aa06d0babb65a1393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.567585 996 leader_election.cc:304] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:19.560974 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244971a6b0b424db6d16d233b32a96e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:19.567839 1973 raft_consensus.cc:2272] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.567873 3225 raft_consensus.cc:2804] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
W20260619 19:54:19.568008 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5682c9323624c1aa06d0babb65a1393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.568784 1973 ts_tablet_manager.cc:1916] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:19.568802 996 leader_election.cc:343] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.569958 3225 raft_consensus.cc:697] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:19.570233 3225 consensus_queue.cc:237] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.571447 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 2090db1e6d5646bbbef77ab6776fe3d2
W20260619 19:54:19.571593 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6bf3909a44147049c854f574bc1ecbb consensus state has no leader
I20260619 19:54:19.574152 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e244971a6b0b424db6d16d233b32a96e (table default.Table_589c54e306ea43ea998074767e53995f [id=84c367d2b1dd4a25813599ba3e8fd32f]). Expected version 1 got 0
I20260619 19:54:19.575376 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 0a2911b5cfd2494287432e818d4ae19e
I20260619 19:54:19.575572 3168 leader_election.cc:290] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.575875 523 catalog_manager.cc:6784] ReplaceTablet: tablet 0a2911b5cfd2494287432e818d4ae19e deleted and replaced by tablet 72bb0361a04c4b469a7bdf3eb6157707
I20260619 19:54:19.576676 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 2 got 0
I20260619 19:54:19.579442 894 tablet_service.cc:1511] Processing CreateTablet for tablet 50bc884e4c304309a326b21a3c059fd4 (DEFAULT_TABLE table=default.Table_fd82efdfad7d457190095d1d9d0359a1 [id=fd0b66ad5ed3441b8cd7ab05b3f5149a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.579768 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 2090db1e6d5646bbbef77ab6776fe3d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.579820 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2911b5cfd2494287432e818d4ae19e with delete_type TABLET_DATA_DELETED (replaced by tablet 72bb0361a04c4b469a7bdf3eb6157707) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.583493 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 2090db1e6d5646bbbef77ab6776fe3d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:19.584300 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 2090db1e6d5646bbbef77ab6776fe3d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2090db1e6d5646bbbef77ab6776fe3d2 already in progress: creating tablet
I20260619 19:54:19.584409 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 0991105460f749e1854d512304ff56cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.584795 1994 tablet_replica.cc:333] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:19.584973 1994 raft_consensus.cc:2243] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.585095 528 master_service.cc:960] ReplaceTablet: received request to replace tablet a7100b0bfa6d4e3baf4e7f90217f1fff from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:19.585119 1994 raft_consensus.cc:2272] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.585765 1994 ts_tablet_manager.cc:1916] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.588461 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ecd267aa34469cad9db0745178013b with delete_type TABLET_DATA_DELETED (replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.588734 523 catalog_manager.cc:5696] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:19.589188 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5eb4005068684928b3b27ff73b108d1b (table default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566]). Expected version 1 got 0
I20260619 19:54:19.589424 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:19.589725 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e244971a6b0b424db6d16d233b32a96e (table default.Table_589c54e306ea43ea998074767e53995f [id=84c367d2b1dd4a25813599ba3e8fd32f]). Expected version 1 got 0
I20260619 19:54:19.589978 523 catalog_manager.cc:5696] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:19.590514 523 catalog_manager.cc:5696] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:19.590838 523 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 2 got 0
I20260619 19:54:19.592630 1201 tablet_bootstrap.cc:492] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.594128 1201 tablet_bootstrap.cc:654] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.597661 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b1bb4e51cce643fab695507af03800af
I20260619 19:54:19.598433 1973 ts_tablet_manager.cc:1929] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260619 19:54:19.598619 1973 log.cc:1199] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b2902c7f67a1402987315ee426ddf1d2
I20260619 19:54:19.599303 1973 ts_tablet_manager.cc:1950] T b2902c7f67a1402987315ee426ddf1d2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.600435 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet b1bb4e51cce643fab695507af03800af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.607177 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet c791c14822324686bb4f4f31a87b7183
I20260619 19:54:19.607906 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_25922a60fdaf453e99a91488af6264ac" } new_table_name: "default.Table_22d566a824b24778b6d902f8c33aac85" modify_external_catalogs: true
I20260619 19:54:19.608729 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0091be765a2142eeb7d93609ed27428c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.608728 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 673) took 3756 ms. Trace:
I20260619 19:54:19.608788 1201 tablet_bootstrap.cc:492] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.608903 1201 ts_tablet_manager.cc:1403] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.007s
I20260619 19:54:19.608816 1973 rpcz_store.cc:276] 0619 19:54:15.851796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.851842 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:19.560657 (+3708815us) ts_tablet_manager.cc:1151] Deleting tablet b2902c7f67a1402987315ee426ddf1d2
0619 19:54:19.560667 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.574348 (+ 13681us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.598229 (+ 23881us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.608704 (+ 10475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3671034}
I20260619 19:54:19.609131 1973 tablet_replica.cc:333] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.609308 1973 raft_consensus.cc:2243] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.609385 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ddfe76640e5641fdb02ef53fddd8df2a
I20260619 19:54:19.609447 1973 raft_consensus.cc:2272] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.609628 1201 raft_consensus.cc:359] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.609767 531 catalog_manager.cc:6784] ReplaceTablet: tablet ddfe76640e5641fdb02ef53fddd8df2a deleted and replaced by tablet 3de788fe38794980a3b72264e038f8b3
I20260619 19:54:19.609773 1201 raft_consensus.cc:385] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.609819 1201 raft_consensus.cc:740] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.609946 531 master_service.cc:960] ReplaceTablet: received request to replace tablet ce5569cf131d418db24aa0a36869ea69 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:19.609968 1973 ts_tablet_manager.cc:1916] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.610054 1201 consensus_queue.cc:260] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.610790 1201 ts_tablet_manager.cc:1434] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:19.611037 1201 tablet_bootstrap.cc:492] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.611361 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82f6be881884cca84cd758a368b815c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.612566 1201 tablet_bootstrap.cc:654] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.612709 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet c791c14822324686bb4f4f31a87b7183 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.612917 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ddfe76640e5641fdb02ef53fddd8df2a with delete_type TABLET_DATA_DELETED (replaced by tablet 3de788fe38794980a3b72264e038f8b3) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.615849 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e7bbccbd2a4be2af5d6f1be32657aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.618033 895 tablet_service.cc:1558] Processing DeleteTablet for tablet b1bb4e51cce643fab695507af03800af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.618548 895 tablet_service.cc:1558] Processing DeleteTablet for tablet c791c14822324686bb4f4f31a87b7183 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.619164 895 tablet_service.cc:1558] Processing DeleteTablet for tablet ddfe76640e5641fdb02ef53fddd8df2a with delete_type TABLET_DATA_DELETED (replaced by tablet 3de788fe38794980a3b72264e038f8b3) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.619623 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cfc4144ae324893b1fc813e30986a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.620021 752 tablet_service.cc:1511] Processing CreateTablet for tablet 88baec5f763547fd9e1b7dd49d96db17 (DEFAULT_TABLE table=default.Table_5754e690c96a48968ff02e778777a567 [id=1aaccb8ae5634705ae06bd7de4e19077]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.620434 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88baec5f763547fd9e1b7dd49d96db17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.623392 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1881a6355bbd415c8fb506920fe86ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.623708 749 tablet_service.cc:1511] Processing CreateTablet for tablet 50bc884e4c304309a326b21a3c059fd4 (DEFAULT_TABLE table=default.Table_fd82efdfad7d457190095d1d9d0359a1 [id=fd0b66ad5ed3441b8cd7ab05b3f5149a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.624158 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bc884e4c304309a326b21a3c059fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.624166 1201 tablet_bootstrap.cc:492] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.624329 1201 ts_tablet_manager.cc:1403] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260619 19:54:19.627381 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58ba14b5ec544d9b4a683a725c80540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.627481 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2090db1e6d5646bbbef77ab6776fe3d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.627807 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2911b5cfd2494287432e818d4ae19e with delete_type TABLET_DATA_DELETED (replaced by tablet 72bb0361a04c4b469a7bdf3eb6157707) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.628091 764 tablet_service.cc:1558] Processing DeleteTablet for tablet b1bb4e51cce643fab695507af03800af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.630254 1201 raft_consensus.cc:359] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.630472 1201 raft_consensus.cc:385] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.630530 1201 raft_consensus.cc:740] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.630784 1201 consensus_queue.cc:260] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.631333 1201 ts_tablet_manager.cc:1434] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260619 19:54:19.631407 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c699cbfd0f04202885a301e19af8136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.631659 1201 tablet_bootstrap.cc:492] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.632367 3047 raft_consensus.cc:493] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.632473 3047 raft_consensus.cc:515] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.632995 3047 leader_election.cc:290] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.634876 777 raft_consensus.cc:3060] T e7a19f43793b4440b7a9d2652a75e6bd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.635370 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8959c2b88d82427781968f5b98b045da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.635520 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dec96b7f2c4732850b046a46ac957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.638258 1973 ts_tablet_manager.cc:1929] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:19.638301 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bc884e4c304309a326b21a3c059fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.638362 1973 log.cc:1199] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/05c9a91f95bb4bcdafe493bab8c393b4
I20260619 19:54:19.638706 1973 ts_tablet_manager.cc:1950] T 05c9a91f95bb4bcdafe493bab8c393b4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.639357 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88baec5f763547fd9e1b7dd49d96db17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.640386 1201 tablet_bootstrap.cc:654] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.644315 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 672) took 3792 ms. Trace:
I20260619 19:54:19.644476 3234 raft_consensus.cc:493] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.644639 3234 raft_consensus.cc:515] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.645239 3234 leader_election.cc:290] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.645516 3234 raft_consensus.cc:493] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.645622 3234 raft_consensus.cc:515] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.646612 3234 leader_election.cc:290] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.659955 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a444ebd84bb340b1b1c0d695d8157d8a
I20260619 19:54:19.661847 903 tablet_service.cc:1558] Processing DeleteTablet for tablet a444ebd84bb340b1b1c0d695d8157d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.661953 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a444ebd84bb340b1b1c0d695d8157d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.669965 1994 ts_tablet_manager.cc:1929] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.670660 1201 tablet_bootstrap.cc:492] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.670846 1201 ts_tablet_manager.cc:1403] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.002s
I20260619 19:54:19.671902 1201 raft_consensus.cc:359] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.672152 1201 raft_consensus.cc:385] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.672230 1201 raft_consensus.cc:740] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.672477 1201 consensus_queue.cc:260] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.673334 1201 ts_tablet_manager.cc:1434] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:54:19.673619 1201 tablet_bootstrap.cc:492] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.675670 1201 tablet_bootstrap.cc:654] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.677259 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a444ebd84bb340b1b1c0d695d8157d8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.684185 890 tablet_service.cc:1511] Processing CreateTablet for tablet c812e5c1b9a4403d939e2b99bdabb738 (DEFAULT_TABLE table=default.Table_8464dd18d8124733b29929afbe73c8ca [id=a9fdb4608a6a44cea5dd38f9520d3c17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.684749 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c812e5c1b9a4403d939e2b99bdabb738. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:19.684806 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 130578us
I20260619 19:54:19.685348 1208 tablet_bootstrap.cc:492] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.685616 1208 ts_tablet_manager.cc:1403] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.326s user 0.021s sys 0.055s
I20260619 19:54:19.686738 1208 raft_consensus.cc:359] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.686920 1208 raft_consensus.cc:385] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.686973 1208 raft_consensus.cc:740] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.687240 1208 consensus_queue.cc:260] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.687912 1208 ts_tablet_manager.cc:1434] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:19.688364 888 tablet_service.cc:1511] Processing CreateTablet for tablet d417d9fa7fd44fd4b5d477e6628e5c0e (DEFAULT_TABLE table=default.Table_d816fde10a7643eaa2813e6bf58bd23b [id=9f082bbc0a4244d898301009dda869f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.688510 1208 tablet_bootstrap.cc:492] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.688779 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d417d9fa7fd44fd4b5d477e6628e5c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.690279 1201 tablet_bootstrap.cc:492] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.690407 1201 ts_tablet_manager.cc:1403] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260619 19:54:19.691167 1201 raft_consensus.cc:359] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.691803 1201 raft_consensus.cc:385] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.691844 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.692713 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26af8ab52d470f8bd1b7c42a57e8a3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.692855 919 raft_consensus.cc:2468] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:19.691862 1201 raft_consensus.cc:740] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.693145 1201 consensus_queue.cc:260] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.693742 1201 ts_tablet_manager.cc:1434] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:19.693984 1994 log.cc:1199] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/0991105460f749e1854d512304ff56cd
I20260619 19:54:19.694335 1994 ts_tablet_manager.cc:1950] T 0991105460f749e1854d512304ff56cd P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:19.678402 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2911b5cfd2494287432e818d4ae19e with delete_type TABLET_DATA_DELETED (replaced by tablet 72bb0361a04c4b469a7bdf3eb6157707) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.694730 1201 tablet_bootstrap.cc:492] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.695792 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 0991105460f749e1854d512304ff56cd (table default.Table_a666e5f020f94fbbbb4aeb87d9f180fe [id=0880c684a7f344c2bb195bdc7d880080]) successfully deleted
I20260619 19:54:19.644475 1973 rpcz_store.cc:276] 0619 19:54:15.851728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.851982 (+ 254us) service_pool.cc:224] Handling call
0619 19:54:19.609086 (+3757104us) ts_tablet_manager.cc:1151] Deleting tablet 05c9a91f95bb4bcdafe493bab8c393b4
0619 19:54:19.609096 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.628259 (+ 19163us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.638203 (+ 9944us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.644283 (+ 6080us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3718802}
I20260619 19:54:19.696136 1973 tablet_replica.cc:333] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.687821 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.696555 1058 raft_consensus.cc:2468] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:19.696552 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f305a99e3481419196532cb5c62c2500 (table default.Table_1d74433076a3413f90471ec48b668e5f [id=7020f678d0034cd59f74dce2a0ecf0bf]) successfully deleted
I20260619 19:54:19.696745 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b2902c7f67a1402987315ee426ddf1d2 (table default.Table_5e38109b2d8b496290d95d8b61a1512b [id=902aaad2317e43f891464a10dd2e334f]) successfully deleted
I20260619 19:54:19.694689 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26af8ab52d470f8bd1b7c42a57e8a3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.697216 1054 raft_consensus.cc:2468] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:19.697398 1201 tablet_bootstrap.cc:654] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.696404 1994 tablet_replica.cc:333] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:19.697741 1994 raft_consensus.cc:2243] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.698083 1994 raft_consensus.cc:2272] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.698968 1994 ts_tablet_manager.cc:1916] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.700937 2953 raft_consensus.cc:493] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.696261 1208 tablet_bootstrap.cc:654] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.703034 3115 raft_consensus.cc:493] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.703363 3115 raft_consensus.cc:515] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.703536 1973 raft_consensus.cc:2243] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.703722 1973 raft_consensus.cc:2272] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.697238 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244971a6b0b424db6d16d233b32a96e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.699533 3229 raft_consensus.cc:493] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.702486 2953 raft_consensus.cc:515] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.703930 3229 raft_consensus.cc:515] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.704221 1973 ts_tablet_manager.cc:1916] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.704473 3229 leader_election.cc:290] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.702279 752 tablet_service.cc:1558] Processing DeleteTablet for tablet ddfe76640e5641fdb02ef53fddd8df2a with delete_type TABLET_DATA_DELETED (replaced by tablet 3de788fe38794980a3b72264e038f8b3) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.701463 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.705634 3115 leader_election.cc:290] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.705935 2953 leader_election.cc:290] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.712280 720 leader_election.cc:304] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:19.712942 3229 raft_consensus.cc:2804] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.713332 3229 raft_consensus.cc:493] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.713455 3229 raft_consensus.cc:3060] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.715013 1208 tablet_bootstrap.cc:492] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:19.715159 1208 ts_tablet_manager.cc:1403] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.004s
I20260619 19:54:19.715847 749 tablet_service.cc:1558] Processing DeleteTablet for tablet c791c14822324686bb4f4f31a87b7183 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.717581 3229 raft_consensus.cc:515] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.718614 3229 leader_election.cc:290] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:19.705678 996 leader_election.cc:343] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.709863 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d7d41377af42437b9d3654c37aa47c2e (DEFAULT_TABLE table=default.Table_ae09ea000f7b4152abf5b57286dc511a [id=057468f2bec44c8d9c608bdd30b010fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.721740 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d41377af42437b9d3654c37aa47c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.715878 1208 raft_consensus.cc:359] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.723227 1208 raft_consensus.cc:385] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.723323 1208 raft_consensus.cc:740] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.723621 1208 consensus_queue.cc:260] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.724704 3225 raft_consensus.cc:493] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.724733 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 05c9a91f95bb4bcdafe493bab8c393b4 (table default.Table_e1877af4dc434ff5a38408207ea93c47 [id=9217b336b73943539d0822ba734db057]) successfully deleted
I20260619 19:54:19.724880 3225 raft_consensus.cc:515] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.725596 3225 leader_election.cc:290] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:19.725931 719 leader_election.cc:343] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.726076 752 tablet_service.cc:1511] Processing CreateTablet for tablet d417d9fa7fd44fd4b5d477e6628e5c0e (DEFAULT_TABLE table=default.Table_d816fde10a7643eaa2813e6bf58bd23b [id=9f082bbc0a4244d898301009dda869f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.726476 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d417d9fa7fd44fd4b5d477e6628e5c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.726608 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55404d15d42244c6b42272143c44ff9c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:19.726750 749 tablet_service.cc:1511] Processing CreateTablet for tablet c812e5c1b9a4403d939e2b99bdabb738 (DEFAULT_TABLE table=default.Table_8464dd18d8124733b29929afbe73c8ca [id=a9fdb4608a6a44cea5dd38f9520d3c17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.727078 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c812e5c1b9a4403d939e2b99bdabb738. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:19.727210 996 leader_election.cc:343] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.727545 1201 tablet_bootstrap.cc:492] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.727681 1201 ts_tablet_manager.cc:1403] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260619 19:54:19.727953 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55404d15d42244c6b42272143c44ff9c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.728372 1201 raft_consensus.cc:359] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.728538 1201 raft_consensus.cc:385] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.728588 1201 raft_consensus.cc:740] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.728806 1201 consensus_queue.cc:260] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:19.729233 996 leader_election.cc:343] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.729373 996 leader_election.cc:304] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:19.729672 1201 ts_tablet_manager.cc:1434] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:19.730005 1201 tablet_bootstrap.cc:492] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.730139 3225 raft_consensus.cc:2749] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.731817 1201 tablet_bootstrap.cc:654] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.732929 1208 ts_tablet_manager.cc:1434] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260619 19:54:19.733409 1208 tablet_bootstrap.cc:492] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.726135 719 leader_election.cc:304] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.735230 3229 raft_consensus.cc:2804] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.735330 3229 raft_consensus.cc:493] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.735411 3229 raft_consensus.cc:3060] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.736085 1208 tablet_bootstrap.cc:654] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.739279 3229 raft_consensus.cc:515] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.740039 3229 leader_election.cc:290] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:19.741129 858 consensus_peers.cc:597] T 05c9a91f95bb4bcdafe493bab8c393b4 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05c9a91f95bb4bcdafe493bab8c393b4. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:19.743335 516 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2a2a2b56003d449a91ad211c58fd69b8 (table default.Table_2f18676481844db485c712680a0bf2e2 [id=ecb81e20d98a4769ada8a294a08cded0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2a2a2b56003d449a91ad211c58fd69b8 consensus state has no leader
I20260619 19:54:19.755023 1201 tablet_bootstrap.cc:492] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.755227 1201 ts_tablet_manager.cc:1403] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260619 19:54:19.756039 1201 raft_consensus.cc:359] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.756284 1201 raft_consensus.cc:385] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.756356 1201 raft_consensus.cc:740] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.756637 1201 consensus_queue.cc:260] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.757676 1201 ts_tablet_manager.cc:1434] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:19.758042 1201 tablet_bootstrap.cc:492] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.758373 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a7100b0bfa6d4e3baf4e7f90217f1fff
I20260619 19:54:19.758533 526 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_a38066af06d345a8a3689270a6962003 [id=1c5d70ace19742ad8ca95cb7549efb6f] alter complete (version 3)
I20260619 19:54:19.759006 528 catalog_manager.cc:6784] ReplaceTablet: tablet a7100b0bfa6d4e3baf4e7f90217f1fff deleted and replaced by tablet 6f37e153b53c471da1f304ae1ada0b2d
I20260619 19:54:19.760257 1201 tablet_bootstrap.cc:654] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.760659 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a7100b0bfa6d4e3baf4e7f90217f1fff with delete_type TABLET_DATA_DELETED (replaced by tablet 6f37e153b53c471da1f304ae1ada0b2d) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:19.762686 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ee5db39ab80c471994b4634a3071ec26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:19.763404 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee5db39ab80c471994b4634a3071ec26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:19.764690 858 leader_election.cc:343] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.765184 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:19.766366 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26af8ab52d470f8bd1b7c42a57e8a3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:19.766343 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ae09ea000f7b4152abf5b57286dc511a" } new_table_name: "default.Table_5dd1e69386ed4b9eaf4830cbd43148bf" modify_external_catalogs: true
I20260619 19:54:19.766506 919 raft_consensus.cc:3060] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.767814 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0aeed027a93f49b6952c63c85c9a8238"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:19.768360 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0aeed027a93f49b6952c63c85c9a8238 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.769269 919 raft_consensus.cc:2468] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:19.770885 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e946647b6d04169af7519314919e899" } modify_external_catalogs: true
I20260619 19:54:19.771049 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e946647b6d04169af7519314919e899" } modify_external_catalogs: true
I20260619 19:54:19.772051 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b78d8a4d8dd42859be248b698257e2c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:19.772241 719 leader_election.cc:343] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: a54231986cca44258942dbc3373870b2
I20260619 19:54:19.772241 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c663c06d10e43958ab42dacc11cb486" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:19.772419 719 leader_election.cc:343] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.772514 780 raft_consensus.cc:2468] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:19.772547 719 leader_election.cc:304] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.772858 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_88df92ce495f4e90ae2deeec4485d7ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:19.773016 3248 raft_consensus.cc:2804] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.773123 3248 raft_consensus.cc:697] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
W20260619 19:54:19.773453 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88df92ce495f4e90ae2deeec4485d7ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:19.773358 3248 consensus_queue.cc:237] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.774358 2953 raft_consensus.cc:493] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.774461 2953 raft_consensus.cc:515] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.775030 2953 leader_election.cc:290] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.775004 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d602ef9e9e5648128426b910a80e1f39" } new_table_name: "default.Table_eaefb5c915d34ab79e4f47c839fd0ade" modify_external_catalogs: true
I20260619 19:54:19.776852 1201 tablet_bootstrap.cc:492] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.777091 1201 ts_tablet_manager.cc:1403] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260619 19:54:19.778618 1201 raft_consensus.cc:359] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.778851 1201 raft_consensus.cc:385] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.778939 1201 raft_consensus.cc:740] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.779209 1201 consensus_queue.cc:260] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.780090 1201 ts_tablet_manager.cc:1434] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:19.780857 1201 tablet_bootstrap.cc:492] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.782475 1201 tablet_bootstrap.cc:654] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.783612 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:19.784385 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 72135.3us
I20260619 19:54:19.786561 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:19.786796 1055 raft_consensus.cc:3060] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.790723 1055 raft_consensus.cc:2468] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
W20260619 19:54:19.783396 858 leader_election.cc:343] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:19.791621 858 consensus_peers.cc:597] T ca6d7f30c5a84106bebebc42eedee654 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca6d7f30c5a84106bebebc42eedee654. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:19.794062 858 leader_election.cc:304] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
W20260619 19:54:19.794440 858 leader_election.cc:343] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.794734 3115 raft_consensus.cc:2804] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.794804 3115 raft_consensus.cc:493] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.794876 3115 raft_consensus.cc:3060] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.796947 1973 ts_tablet_manager.cc:1929] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.797096 1973 log.cc:1199] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/e6dcf87d57044279a218cbb21c383352
I20260619 19:54:19.797425 1973 ts_tablet_manager.cc:1950] T e6dcf87d57044279a218cbb21c383352 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.798454 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 671) took 3946 ms. Trace:
I20260619 19:54:19.798552 1973 rpcz_store.cc:276] 0619 19:54:15.851661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.851923 (+ 262us) service_pool.cc:224] Handling call
0619 19:54:19.696086 (+3844163us) ts_tablet_manager.cc:1151] Deleting tablet e6dcf87d57044279a218cbb21c383352
0619 19:54:19.696096 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.754926 (+ 58830us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.796860 (+ 41934us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.798424 (+ 1564us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3805190}
I20260619 19:54:19.798980 1973 tablet_replica.cc:333] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.818164 3115 raft_consensus.cc:515] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.819067 3115 leader_election.cc:290] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.820003 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c663c06d10e43958ab42dacc11cb486" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:19.820196 780 raft_consensus.cc:3060] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.822993 780 raft_consensus.cc:2468] T 9c663c06d10e43958ab42dacc11cb486 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:19.824098 858 leader_election.cc:304] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.824549 3115 raft_consensus.cc:2804] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.824690 3115 raft_consensus.cc:697] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:19.824983 3115 consensus_queue.cc:237] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.827795 3229 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:19.828032 3229 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.828965 3229 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:19.833158 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.833745 3123 raft_consensus.cc:493] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.834061 3123 raft_consensus.cc:515] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.834705 3123 leader_election.cc:290] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.835650 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ddb8412ad145dd85916bf5d756a9f0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.835923 916 raft_consensus.cc:2468] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:19.839495 1201 tablet_bootstrap.cc:492] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.839766 1201 ts_tablet_manager.cc:1403] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.004s
I20260619 19:54:19.840869 1201 raft_consensus.cc:359] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.836450 719 leader_election.cc:304] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.844796 1201 raft_consensus.cc:385] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.844949 1201 raft_consensus.cc:740] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.845386 1201 consensus_queue.cc:260] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:19.856534 3123 raft_consensus.cc:2804] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:19.856683 3123 raft_consensus.cc:493] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:19.856755 3123 raft_consensus.cc:3060] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.863533 1973 raft_consensus.cc:2243] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.864305 1973 raft_consensus.cc:2272] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.865464 1973 ts_tablet_manager.cc:1916] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.865628 3265 tablet.cc:1724] T 1e65ca84182d40c280ec2b0555c0de86 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:19.710638 1033 tablet_service.cc:1511] Processing CreateTablet for tablet d417d9fa7fd44fd4b5d477e6628e5c0e (DEFAULT_TABLE table=default.Table_d816fde10a7643eaa2813e6bf58bd23b [id=9f082bbc0a4244d898301009dda869f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.867100 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d417d9fa7fd44fd4b5d477e6628e5c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.890767 3115 raft_consensus.cc:493] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.891047 3115 raft_consensus.cc:515] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.892472 3115 leader_election.cc:290] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.894711 3116 raft_consensus.cc:3060] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.897802 890 tablet_service.cc:1558] Processing DeleteTablet for tablet a7100b0bfa6d4e3baf4e7f90217f1fff with delete_type TABLET_DATA_DELETED (replaced by tablet 6f37e153b53c471da1f304ae1ada0b2d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:19.898319 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 801f08f4daa842238460506ccd0c466f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:15 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.898865 752 tablet_service.cc:1558] Processing DeleteTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 with delete_type TABLET_DATA_DELETED (replaced by tablet f9d9e816e001403a820caca4916f8824) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.898942 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 56640f773efb4123b93f4ca3799ddde7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.899176 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a54231986cca44258942dbc3373870b2 with delete_type TABLET_DATA_DELETED (replaced by tablet d6bc861cb7d941f380671105fd338538) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.899459 755 tablet_service.cc:1558] Processing DeleteTablet for tablet b2902c7f67a1402987315ee426ddf1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:00 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.899592 890 tablet_service.cc:1511] Processing CreateTablet for tablet d7d41377af42437b9d3654c37aa47c2e (DEFAULT_TABLE table=default.Table_ae09ea000f7b4152abf5b57286dc511a [id=057468f2bec44c8d9c608bdd30b010fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.900019 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d41377af42437b9d3654c37aa47c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.899945 755 tablet_service.cc:1511] Processing CreateTablet for tablet d7d41377af42437b9d3654c37aa47c2e (DEFAULT_TABLE table=default.Table_ae09ea000f7b4152abf5b57286dc511a [id=057468f2bec44c8d9c608bdd30b010fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.900286 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d41377af42437b9d3654c37aa47c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.908085 764 tablet_service.cc:1558] Processing DeleteTablet for tablet a7100b0bfa6d4e3baf4e7f90217f1fff with delete_type TABLET_DATA_DELETED (replaced by tablet 6f37e153b53c471da1f304ae1ada0b2d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:19.910835 3116 raft_consensus.cc:515] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.912454 3115 raft_consensus.cc:493] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.912600 3115 raft_consensus.cc:515] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.915242 3115 leader_election.cc:290] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.917032 1973 ts_tablet_manager.cc:1929] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.920236 1973 log.cc:1199] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/fb6bc52ee1fa4ac8967f937e59b4550c
I20260619 19:54:19.920804 3225 raft_consensus.cc:493] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.920953 1973 ts_tablet_manager.cc:1950] T fb6bc52ee1fa4ac8967f937e59b4550c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.920977 3225 raft_consensus.cc:515] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.921272 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 674) took 4069 ms. Trace:
I20260619 19:54:19.921343 1973 rpcz_store.cc:276] 0619 19:54:15.852135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.852182 (+ 47us) service_pool.cc:224] Handling call
0619 19:54:19.798921 (+3946739us) ts_tablet_manager.cc:1151] Deleting tablet fb6bc52ee1fa4ac8967f937e59b4550c
0619 19:54:19.798934 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.874151 (+ 75217us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.916942 (+ 42791us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.921254 (+ 4312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3907985}
I20260619 19:54:19.921624 3225 leader_election.cc:290] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.922043 3116 leader_election.cc:290] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.918226 720 leader_election.cc:304] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498
I20260619 19:54:19.922964 890 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd392623dfd452696c87344da5c4d0b (DEFAULT_TABLE table=default.Table_706383ef26e64f13b4c2c1ebbb8ad502 [id=4c7771912e0645e8b14d1f6b5a5584f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.922964 764 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd392623dfd452696c87344da5c4d0b (DEFAULT_TABLE table=default.Table_706383ef26e64f13b4c2c1ebbb8ad502 [id=4c7771912e0645e8b14d1f6b5a5584f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.923031 3248 raft_consensus.cc:2804] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.923362 3248 raft_consensus.cc:697] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:19.923889 3248 consensus_queue.cc:237] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.924783 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:19.925213 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd392623dfd452696c87344da5c4d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.925709 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:19.926486 996 leader_election.cc:343] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.927779 3273 raft_consensus.cc:493] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:19.927912 3273 raft_consensus.cc:515] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.928643 3116 raft_consensus.cc:493] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:19.928838 3116 raft_consensus.cc:515] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.929613 3273 leader_election.cc:290] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.929868 3116 leader_election.cc:290] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:19.930506 755 tablet_service.cc:1511] Processing CreateTablet for tablet e8dde8469510471993ad33a341d09a77 (DEFAULT_TABLE table=default.Table_c59b58766d634684a17e2a7591efb8f4 [id=b138e4c3fea745c0b5ea2a27dd4ee675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:19.930923 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8dde8469510471993ad33a341d09a77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:19.931407 996 leader_election.cc:343] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:19.931559 996 leader_election.cc:304] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:19.931984 3225 raft_consensus.cc:2749] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.933535 1200 tablet_bootstrap.cc:492] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:19.933688 1200 ts_tablet_manager.cc:1403] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.391s user 0.000s sys 0.004s
I20260619 19:54:19.934769 1200 raft_consensus.cc:359] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.935106 1200 raft_consensus.cc:385] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.935185 1200 raft_consensus.cc:740] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.935385 1200 consensus_queue.cc:260] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.936024 1200 ts_tablet_manager.cc:1434] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 19:54:19.936309 1200 tablet_bootstrap.cc:492] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:19.937271 1973 tablet_replica.cc:333] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.937479 1973 raft_consensus.cc:2243] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:19.937654 1973 raft_consensus.cc:2272] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.937966 1200 tablet_bootstrap.cc:654] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.938221 1973 ts_tablet_manager.cc:1916] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.939819 1208 tablet_bootstrap.cc:492] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
W20260619 19:54:19.922488 720 leader_election.cc:343] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: a54231986cca44258942dbc3373870b2
I20260619 19:54:19.939524 3274 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:19.940042 720 leader_election.cc:304] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.940301 3229 raft_consensus.cc:2749] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:19.939946 1208 ts_tablet_manager.cc:1403] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.207s user 0.024s sys 0.067s
I20260619 19:54:19.941713 1208 raft_consensus.cc:359] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.941888 1208 raft_consensus.cc:385] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.941956 1208 raft_consensus.cc:740] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.942162 1208 consensus_queue.cc:260] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.942644 1208 ts_tablet_manager.cc:1434] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 19:54:19.920346 3123 raft_consensus.cc:515] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.943611 3123 leader_election.cc:290] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:19.946594 1994 ts_tablet_manager.cc:1929] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.947074 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ddb8412ad145dd85916bf5d756a9f0" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:19.947315 916 raft_consensus.cc:3060] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:19.947914 1208 tablet_bootstrap.cc:492] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:19.949445 1208 tablet_bootstrap.cc:654] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.949971 916 raft_consensus.cc:2468] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:19.954867 719 leader_election.cc:304] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:19.955310 3229 raft_consensus.cc:2804] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:19.955423 3229 raft_consensus.cc:697] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:19.955705 3229 consensus_queue.cc:237] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.958310 2026 ts_tablet_manager.cc:1929] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:19.958499 2026 log.cc:1199] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/cc57b42a97fa437b93842f7cd379dbb7
I20260619 19:54:19.958884 2026 ts_tablet_manager.cc:1950] T cc57b42a97fa437b93842f7cd379dbb7 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:19.960655 1973 ts_tablet_manager.cc:1929] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:19.960764 1973 log.cc:1199] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/ba0cd4cd0661415d8b2b2339363e7aca
I20260619 19:54:19.961086 1973 ts_tablet_manager.cc:1950] T ba0cd4cd0661415d8b2b2339363e7aca P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.961383 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 675) took 4109 ms. Trace:
I20260619 19:54:19.961462 1973 rpcz_store.cc:276] 0619 19:54:15.852227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:15.852484 (+ 257us) service_pool.cc:224] Handling call
0619 19:54:19.937218 (+4084734us) ts_tablet_manager.cc:1151] Deleting tablet ba0cd4cd0661415d8b2b2339363e7aca
0619 19:54:19.937227 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.952324 (+ 15097us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.960602 (+ 8278us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.961368 (+ 766us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4046192}
I20260619 19:54:19.961872 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 688) took 3943 ms. Trace:
I20260619 19:54:19.961946 1973 rpcz_store.cc:276] 0619 19:54:16.018043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.018116 (+ 73us) service_pool.cc:224] Handling call
0619 19:54:19.961762 (+3943646us) ts_tablet_manager.cc:1151] Deleting tablet 1261a735922542a1a6c149986f236c1a
0619 19:54:19.961770 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.961859 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3787139}
I20260619 19:54:19.962182 1973 tablet_replica.cc:333] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.962692 1973 raft_consensus.cc:2243] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:19.963016 1973 raft_consensus.cc:2272] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.963636 1973 ts_tablet_manager.cc:1916] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:19.976064 720 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:19.976377 720 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:19.976771 3123 raft_consensus.cc:2749] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:19.977363 1973 ts_tablet_manager.cc:1929] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:19.977771 1973 log.cc:1199] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/dc5235127fb54d3dba90c9f9f8c134b4
W20260619 19:54:19.977985 720 leader_election.cc:343] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d5ddb8412ad145dd85916bf5d756a9f0
I20260619 19:54:19.979348 1973 ts_tablet_manager.cc:1950] T dc5235127fb54d3dba90c9f9f8c134b4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:19.979377 3123 consensus_queue.cc:1048] T 70184f5fb2bc459682ddbc9e0fc48b8d P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:19.979847 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 689) took 3692 ms. Trace:
W20260619 19:54:19.980456 720 leader_election.cc:343] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d5ddb8412ad145dd85916bf5d756a9f0
I20260619 19:54:19.980391 1973 rpcz_store.cc:276] 0619 19:54:16.287501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.309973 (+ 22472us) service_pool.cc:224] Handling call
0619 19:54:19.962140 (+3652167us) ts_tablet_manager.cc:1151] Deleting tablet dc5235127fb54d3dba90c9f9f8c134b4
0619 19:54:19.962149 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.966624 (+ 4475us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.976586 (+ 9962us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.979830 (+ 3244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3651968}
I20260619 19:54:19.981334 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 691) took 3693 ms. Trace:
I20260619 19:54:19.981684 1973 rpcz_store.cc:276] 0619 19:54:16.287724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.326620 (+ 38896us) service_pool.cc:224] Handling call
0619 19:54:19.981216 (+3654596us) ts_tablet_manager.cc:1151] Deleting tablet c322c38aae114a428f64a476a2ae9b5f
0619 19:54:19.981226 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.981318 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3617304}
I20260619 19:54:19.982326 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 690) took 3694 ms. Trace:
I20260619 19:54:19.982754 1973 rpcz_store.cc:276] 0619 19:54:16.287627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.313489 (+ 25862us) service_pool.cc:224] Handling call
0619 19:54:19.982204 (+3668715us) ts_tablet_manager.cc:1151] Deleting tablet c85407a4d392498290eae64df5f85edf
0619 19:54:19.982213 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.982310 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3600878}
I20260619 19:54:19.983655 1973 tablet_replica.cc:333] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:19.984086 1973 raft_consensus.cc:2243] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: Raft consensus shutting down.
I20260619 19:54:19.984676 1973 pending_rounds.cc:70] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:19.985044 1973 pending_rounds.cc:77] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7298657728542470144 op_type: NO_OP noop_request { }
I20260619 19:54:19.985417 1973 raft_consensus.cc:2889] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:19.985684 1973 raft_consensus.cc:2272] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:19.988381 1973 ts_tablet_manager.cc:1916] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:19.991770 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd392623dfd452696c87344da5c4d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.991868 1201 ts_tablet_manager.cc:1434] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.152s user 0.005s sys 0.010s
I20260619 19:54:19.992199 1201 tablet_bootstrap.cc:492] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:19.993585 1201 tablet_bootstrap.cc:654] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:19.997514 1201 tablet_bootstrap.cc:492] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:19.997427 525 catalog_manager.cc:5696] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:19.998041 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e244971a6b0b424db6d16d233b32a96e (table default.Table_589c54e306ea43ea998074767e53995f [id=84c367d2b1dd4a25813599ba3e8fd32f]). Expected version 1 got 0
I20260619 19:54:19.998088 1201 ts_tablet_manager.cc:1403] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260619 19:54:19.998775 1201 raft_consensus.cc:359] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.998936 1201 raft_consensus.cc:385] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:19.998998 1201 raft_consensus.cc:740] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:19.999889 1201 consensus_queue.cc:260] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.000608 1201 ts_tablet_manager.cc:1434] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:20.001138 3276 raft_consensus.cc:493] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.001276 3276 raft_consensus.cc:515] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.001911 3276 leader_election.cc:290] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.003523 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_0ef6a0ce90c54a00b62b75830829d925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.004336 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c0a658add5c45508b320516014a2c61 has no consensus state
W20260619 19:54:20.004619 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ef6a0ce90c54a00b62b75830829d925 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.008342 1201 tablet_bootstrap.cc:492] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:20.008240 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d01d2d98b64226b619255500498ffe" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.008528 783 raft_consensus.cc:2468] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.008240 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56640f773efb4123b93f4ca3799ddde7" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.008806 781 raft_consensus.cc:3060] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.008878 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7122fa5f94eeaa3b99cae107d8c9a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.009006 773 raft_consensus.cc:2468] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.008806 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0991105460f749e1854d512304ff56cd" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.010691 1201 tablet_bootstrap.cc:654] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.011655 781 raft_consensus.cc:2468] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:20.012255 858 consensus_peers.cc:597] T fe814880d9984bbd83fa121cb2a34eac P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe814880d9984bbd83fa121cb2a34eac. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:20.012503 858 leader_election.cc:304] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.012759 3115 raft_consensus.cc:2804] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.012840 3115 raft_consensus.cc:493] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.012897 3115 raft_consensus.cc:3060] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.014864 1208 tablet_bootstrap.cc:492] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:20.015002 1208 ts_tablet_manager.cc:1403] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.016s
I20260619 19:54:20.015452 3115 raft_consensus.cc:515] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.015825 1208 raft_consensus.cc:359] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.015990 1208 raft_consensus.cc:385] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.016042 1208 raft_consensus.cc:740] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.016106 3115 leader_election.cc:290] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.016294 1208 consensus_queue.cc:260] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.004778 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_006ae61ee68148499fe17d7317cbb2f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.017127 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_006ae61ee68148499fe17d7317cbb2f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.017884 3276 consensus_queue.cc:1048] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.005155 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ce5569cf131d418db24aa0a36869ea69
I20260619 19:54:20.018532 858 leader_election.cc:304] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.018744 531 catalog_manager.cc:6784] ReplaceTablet: tablet ce5569cf131d418db24aa0a36869ea69 deleted and replaced by tablet 734fd4fdd47249b8910c3d1aa3cba33b
I20260619 19:54:20.019183 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e39afedbe59f4303b26bc6217453a187"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.019716 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e39afedbe59f4303b26bc6217453a187 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:20.018831 858 leader_election.cc:343] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:20.020246 858 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:20.020421 858 leader_election.cc:304] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.021536 2953 raft_consensus.cc:2804] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.021621 2953 raft_consensus.cc:493] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.021680 2953 raft_consensus.cc:3060] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:20.022379 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7d41377af42437b9d3654c37aa47c2e consensus state has no leader
I20260619 19:54:20.022658 527 master_service.cc:960] ReplaceTablet: received request to replace tablet 3ddfe1bb8e174151b5872ee6dcebfdb7 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:20.024765 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d01d2d98b64226b619255500498ffe" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.024956 774 raft_consensus.cc:3060] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.025275 3116 raft_consensus.cc:2804] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.027288 1208 ts_tablet_manager.cc:1434] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260619 19:54:20.027575 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "710fae36dd674b1786aa75013284684e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.027752 781 raft_consensus.cc:2468] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.027748 527 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_3501993f2f45498d8b39e29320e10e04" } new_table_name: "default.Table_c64303b220974c23978cdf674133e2d7" modify_external_catalogs: true
I20260619 19:54:20.028688 774 raft_consensus.cc:2468] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.029901 1208 tablet_bootstrap.cc:492] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:20.031672 1208 tablet_bootstrap.cc:654] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.031785 3116 raft_consensus.cc:697] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.032059 3116 consensus_queue.cc:237] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:19.967557 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 6cd392623dfd452696c87344da5c4d0b (DEFAULT_TABLE table=default.Table_706383ef26e64f13b4c2c1ebbb8ad502 [id=4c7771912e0645e8b14d1f6b5a5584f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.037310 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cd392623dfd452696c87344da5c4d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.038057 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c663c06d10e43958ab42dacc11cb486" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.038239 1060 raft_consensus.cc:3060] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.040584 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_76beaec437ad4eadab6de9dadd1c20cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:20.041013 1060 raft_consensus.cc:2468] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:20.041203 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76beaec437ad4eadab6de9dadd1c20cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.042449 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_af5f422573394c6281b4b3063e66b303" } new_table_name: "default.Table_77aec596dec443a196ee52a9057d1a22" modify_external_catalogs: true
I20260619 19:54:19.970252 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb26af8ab52d470f8bd1b7c42a57e8a3" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:19.972818 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.974208 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e8dde8469510471993ad33a341d09a77 (DEFAULT_TABLE table=default.Table_c59b58766d634684a17e2a7591efb8f4 [id=b138e4c3fea745c0b5ea2a27dd4ee675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.043637 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8dde8469510471993ad33a341d09a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.942169 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet e6dcf87d57044279a218cbb21c383352 (table default.Table_e253cf6ca249466ebb47d8d6022e8287 [id=95b72fead3cb4ee9ab21f4af4cbc62d0]) successfully deleted
W20260619 19:54:20.045809 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 105563us
W20260619 19:54:20.045097 856 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.0.105.188:44433, user_credentials={real_user=slave}} blocked reactor thread for 101479us
I20260619 19:54:19.975559 1037 tablet_service.cc:1511] Processing CreateTablet for tablet ac483f6761354d4f967efecf729f8338 (DEFAULT_TABLE table=default.Table_8525cd90863645549faee9c678faf387 [id=926ef286ddd34e1092a0e0d890ac4c9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.046830 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac483f6761354d4f967efecf729f8338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:19.943468 3274 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.046200 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet cf2b360e04054330b4d943aa98f00f35
I20260619 19:54:20.049520 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_246afc7a4df84db6831cb1c61e31ca7d [id=9a77efaee2cd4b07aa78d2910aeeab77]) successfully deleted
I20260619 19:54:20.050011 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet ba0cd4cd0661415d8b2b2339363e7aca (table default.Table_dcf53365a32c41d199527fbf3350633f [id=bf53d86497694aa290a36bf920df9848]) successfully deleted
W20260619 19:54:20.050251 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1261a735922542a1a6c149986f236c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1261a735922542a1a6c149986f236c1a already in progress: creating tablet
I20260619 19:54:20.050348 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d" } modify_external_catalogs: true
I20260619 19:54:20.050485 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet dc5235127fb54d3dba90c9f9f8c134b4 (table default.Table_06f356714778440cbb5c03887dbb5727 [id=073968602f2b467ebaa182b22583f703]) successfully deleted
I20260619 19:54:20.050554 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dca5ac7066784bf28cd22e1c7e6fcf8d" } modify_external_catalogs: true
W20260619 19:54:20.050725 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c322c38aae114a428f64a476a2ae9b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c322c38aae114a428f64a476a2ae9b5f already in progress: creating tablet
W20260619 19:54:20.050974 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c85407a4d392498290eae64df5f85edf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c85407a4d392498290eae64df5f85edf already in progress: creating tablet
I20260619 19:54:20.051632 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d01d2d98b64226b619255500498ffe" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.982213 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c663c06d10e43958ab42dacc11cb486" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:19.989722 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:20.051911 1061 raft_consensus.cc:2468] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.051911 1055 raft_consensus.cc:2376] T 9c663c06d10e43958ab42dacc11cb486 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1. Re-sending same reply.
I20260619 19:54:20.016393 3225 raft_consensus.cc:493] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.052189 3225 raft_consensus.cc:515] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.052466 1051 raft_consensus.cc:2468] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.052830 3225 leader_election.cc:290] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.053514 1060 raft_consensus.cc:2468] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.053946 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet cf2b360e04054330b4d943aa98f00f35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.056003 3274 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:20.057260 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.057684 1054 raft_consensus.cc:3060] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:20.057859 996 leader_election.cc:343] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.060137 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e886b4f784f4431e8bd1f7fc7421797f" } modify_external_catalogs: true
I20260619 19:54:20.060410 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e886b4f784f4431e8bd1f7fc7421797f" } modify_external_catalogs: true
I20260619 19:54:20.061039 1054 raft_consensus.cc:2468] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:20.036553 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet ce5569cf131d418db24aa0a36869ea69 with delete_type TABLET_DATA_DELETED (replaced by tablet 734fd4fdd47249b8910c3d1aa3cba33b) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.061950 1994 log.cc:1199] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/32ecd267aa34469cad9db0745178013b
I20260619 19:54:20.062331 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.062523 774 raft_consensus.cc:2468] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.063632 1994 ts_tablet_manager.cc:1950] T 32ecd267aa34469cad9db0745178013b P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:20.066082 1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d01d2d98b64226b619255500498ffe" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.066279 1055 raft_consensus.cc:3060] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.066596 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_55803a427a8c45fb8c379a3a59e6957a" } modify_external_catalogs: true
I20260619 19:54:20.066795 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_55803a427a8c45fb8c379a3a59e6957a" } modify_external_catalogs: true
I20260619 19:54:20.067754 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4b0c0d9ef5a54d95930c855193a5669e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.068414 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b0c0d9ef5a54d95930c855193a5669e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.068976 1055 raft_consensus.cc:2468] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.070739 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 55404d15d42244c6b42272143c44ff9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.071094 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_171c4100b2f6490c8885fc92c64a08ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:20.071240 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 74813bf79789451f90bcf7779aff9290 with delete_type TABLET_DATA_DELETED (replaced by tablet 267319f83f5440cb986952279320648f) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:20.071730 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_171c4100b2f6490c8885fc92c64a08ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.073101 1994 tablet_replica.cc:333] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:20.073316 1994 raft_consensus.cc:2243] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:20.073596 859 leader_election.cc:343] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9b78d8a4d8dd42859be248b698257e2c
I20260619 19:54:20.073629 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 32ecd267aa34469cad9db0745178013b (table default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]) successfully deleted
I20260619 19:54:20.073731 859 leader_election.cc:304] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:20.073899 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet b1bb4e51cce643fab695507af03800af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1bb4e51cce643fab695507af03800af already in progress: creating tablet
W20260619 19:54:20.074148 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet c791c14822324686bb4f4f31a87b7183 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c791c14822324686bb4f4f31a87b7183 already in progress: creating tablet
W20260619 19:54:20.074337 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ddfe76640e5641fdb02ef53fddd8df2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddfe76640e5641fdb02ef53fddd8df2a already in progress: creating tablet
W20260619 19:54:20.074563 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a444ebd84bb340b1b1c0d695d8157d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a444ebd84bb340b1b1c0d695d8157d8a already in progress: creating tablet
W20260619 19:54:20.074738 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 0a2911b5cfd2494287432e818d4ae19e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a2911b5cfd2494287432e818d4ae19e already in progress: creating tablet
W20260619 19:54:20.074908 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a7100b0bfa6d4e3baf4e7f90217f1fff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7100b0bfa6d4e3baf4e7f90217f1fff already in progress: creating tablet
W20260619 19:54:20.075050 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cf2b360e04054330b4d943aa98f00f35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2b360e04054330b4d943aa98f00f35 already in progress: creating tablet
W20260619 19:54:20.075291 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ce5569cf131d418db24aa0a36869ea69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce5569cf131d418db24aa0a36869ea69 already in progress: creating tablet
I20260619 19:54:20.076171 3047 raft_consensus.cc:2749] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:20.076314 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet deba56eb121e4aa6b8ad7b13951723aa consensus state has no leader
I20260619 19:54:20.076529 3047 consensus_queue.cc:1048] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.076740 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b8daa904a52e492d9f9942b151daca0f" } modify_external_catalogs: true
I20260619 19:54:20.076926 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b8daa904a52e492d9f9942b151daca0f" } modify_external_catalogs: true
I20260619 19:54:20.077638 1973 ts_tablet_manager.cc:1929] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260619 19:54:20.077780 1973 log.cc:1199] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/8614b0ab1a3749a1a0aa441574f79ab1
I20260619 19:54:20.078258 1973 ts_tablet_manager.cc:1950] T 8614b0ab1a3749a1a0aa441574f79ab1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.078644 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 693) took 3567 ms. Trace:
I20260619 19:54:20.078752 1973 rpcz_store.cc:276] 0619 19:54:16.511361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.511419 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:19.983606 (+3472187us) ts_tablet_manager.cc:1151] Deleting tablet 8614b0ab1a3749a1a0aa441574f79ab1
0619 19:54:19.983617 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.039611 (+ 55994us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.077553 (+ 37942us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.078619 (+ 1066us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3394765}
I20260619 19:54:20.082973 1973 tablet_replica.cc:333] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.085043 1973 raft_consensus.cc:2243] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.086169 1973 raft_consensus.cc:2272] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.087216 1973 ts_tablet_manager.cc:1916] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.057333 2953 raft_consensus.cc:515] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.091799 2953 leader_election.cc:290] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:20.094641 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1fe5f6be6bf445509ab6a3bac320d525 consensus state has no leader
I20260619 19:54:20.095240 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7c2ee589217a4ed3a15f54172620b40f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.095995 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c2ee589217a4ed3a15f54172620b40f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.098707 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet df8513e281cb44d1986e7c54376e1bdc
I20260619 19:54:20.101554 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet bc2291967f0945efb7486079a93a6aad
I20260619 19:54:20.102489 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet df8513e281cb44d1986e7c54376e1bdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.102986 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet bc2291967f0945efb7486079a93a6aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.104067 1973 ts_tablet_manager.cc:1929] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:20.104199 1973 log.cc:1199] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/710fae36dd674b1786aa75013284684e
I20260619 19:54:20.104557 1973 ts_tablet_manager.cc:1950] T 710fae36dd674b1786aa75013284684e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.104904 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 696) took 3473 ms. Trace:
I20260619 19:54:20.104998 1973 rpcz_store.cc:276] 0619 19:54:16.631607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:16.631647 (+ 40us) service_pool.cc:224] Handling call
0619 19:54:20.082909 (+3451262us) ts_tablet_manager.cc:1151] Deleting tablet 710fae36dd674b1786aa75013284684e
0619 19:54:20.082921 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.100951 (+ 18030us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.103982 (+ 3031us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.104886 (+ 904us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3442150}
W20260619 19:54:20.108731 527 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4b2802ecd504e0a8b743e432bfc3fab consensus state has no leader
I20260619 19:54:20.061801 858 leader_election.cc:304] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.092305 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:20.111758 916 raft_consensus.cc:2468] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:20.112342 3047 raft_consensus.cc:2804] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:20.112525 3047 raft_consensus.cc:493] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.112690 3047 raft_consensus.cc:3060] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:20.106570 764 tablet_service.cc:1511] Processing CreateTablet for tablet ac483f6761354d4f967efecf729f8338 (DEFAULT_TABLE table=default.Table_8525cd90863645549faee9c678faf387 [id=926ef286ddd34e1092a0e0d890ac4c9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.116999 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac483f6761354d4f967efecf729f8338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.117133 3047 raft_consensus.cc:515] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.117795 3047 leader_election.cc:290] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.118207 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet cad702900111463fa298c76098746bfb
W20260619 19:54:20.118250 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 56479.1us
I20260619 19:54:20.118445 858 leader_election.cc:304] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.118685 858 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.119927 3047 raft_consensus.cc:2804] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.120234 3047 raft_consensus.cc:697] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.120487 3047 consensus_queue.cc:237] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.121479 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 52d01d2d98b64226b619255500498ffe
I20260619 19:54:20.121690 3276 raft_consensus.cc:2804] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 19:54:20.121767 3276 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:20.121826 3276 raft_consensus.cc:3060] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Advancing to term 2
I20260619 19:54:20.107939 755 tablet_service.cc:1558] Processing DeleteTablet for tablet ce5569cf131d418db24aa0a36869ea69 with delete_type TABLET_DATA_DELETED (replaced by tablet 734fd4fdd47249b8910c3d1aa3cba33b) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.108894 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cf2b360e04054330b4d943aa98f00f35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.124680 3276 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.125108 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 717) took 2755 ms. Trace:
I20260619 19:54:20.125221 1973 rpcz_store.cc:276] 0619 19:54:17.369383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.369445 (+ 62us) service_pool.cc:224] Handling call
0619 19:54:20.124939 (+2755494us) ts_tablet_manager.cc:1151] Deleting tablet 79bcc998cf6c4d3e851a437ccd2edb92
0619 19:54:20.124950 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.125085 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2755305}
I20260619 19:54:20.125695 3276 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:20.126364 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f7122fa5f94eeaa3b99cae107d8c9a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.126709 780 raft_consensus.cc:3060] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.126950 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 723) took 2751 ms. Trace:
I20260619 19:54:20.127058 1973 rpcz_store.cc:276] 0619 19:54:17.375200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.375379 (+ 179us) service_pool.cc:224] Handling call
0619 19:54:20.126815 (+2751436us) ts_tablet_manager.cc:1151] Deleting tablet f5057229e0d04eafb501356ad8f649ba
0619 19:54:20.126826 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.126934 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2751204}
I20260619 19:54:20.129032 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 728) took 2687 ms. Trace:
I20260619 19:54:20.129158 1973 rpcz_store.cc:276] 0619 19:54:17.441138 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.441185 (+ 47us) service_pool.cc:224] Handling call
0619 19:54:20.128889 (+2687704us) ts_tablet_manager.cc:1151] Deleting tablet a1c42c4e323a434bac1f6cb25a1a0281
0619 19:54:20.128899 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.128994 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2687539}
I20260619 19:54:20.130471 780 raft_consensus.cc:2468] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.102545 1200 tablet_bootstrap.cc:492] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:20.130892 1200 ts_tablet_manager.cc:1403] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.195s user 0.000s sys 0.004s
I20260619 19:54:20.132129 996 leader_election.cc:304] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:20.133278 858 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 710fae36dd674b1786aa75013284684e
I20260619 19:54:20.103209 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 335) took 13668 ms. Trace:
I20260619 19:54:20.106887 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.106995 888 tablet_service.cc:1511] Processing CreateTablet for tablet ac483f6761354d4f967efecf729f8338 (DEFAULT_TABLE table=default.Table_8525cd90863645549faee9c678faf387 [id=926ef286ddd34e1092a0e0d890ac4c9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.134655 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac483f6761354d4f967efecf729f8338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.134764 1201 tablet_bootstrap.cc:492] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:20.134877 1201 ts_tablet_manager.cc:1403] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.127s user 0.016s sys 0.010s
I20260619 19:54:20.107383 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b78d8a4d8dd42859be248b698257e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.108235 902 tablet_service.cc:1558] Processing DeleteTablet for tablet ce5569cf131d418db24aa0a36869ea69 with delete_type TABLET_DATA_DELETED (replaced by tablet 734fd4fdd47249b8910c3d1aa3cba33b) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.109191 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cf2b360e04054330b4d943aa98f00f35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:19 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.110219 890 tablet_service.cc:1511] Processing CreateTablet for tablet e8dde8469510471993ad33a341d09a77 (DEFAULT_TABLE table=default.Table_c59b58766d634684a17e2a7591efb8f4 [id=b138e4c3fea745c0b5ea2a27dd4ee675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.111263 859 leader_election.cc:304] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.144586 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8dde8469510471993ad33a341d09a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.148536 2026 rpcz_store.cc:276] 0619 19:54:06.434866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.434919 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:19.397100 (+12962181us) ts_tablet_manager.cc:1151] Deleting tablet cc57b42a97fa437b93842f7cd379dbb7
0619 19:54:19.397111 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:19.728361 (+331250us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:19.958244 (+229883us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.103182 (+144938us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12945508}
I20260619 19:54:20.149392 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 336) took 13678 ms. Trace:
I20260619 19:54:20.149572 2026 rpcz_store.cc:276] 0619 19:54:06.470717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.470777 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:20.149206 (+13678429us) ts_tablet_manager.cc:1151] Deleting tablet b289d3068d184d47b671617213aa512a
0619 19:54:20.149220 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.149370 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13677739}
I20260619 19:54:20.150082 2026 tablet_replica.cc:333] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:20.150445 2026 raft_consensus.cc:2243] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:20.151862 1994 raft_consensus.cc:2272] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.152645 1994 ts_tablet_manager.cc:1916] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.159960 3225 raft_consensus.cc:2804] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.160087 3225 raft_consensus.cc:493] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.160164 3225 raft_consensus.cc:3060] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.162917 3225 raft_consensus.cc:515] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.163604 3225 leader_election.cc:290] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.164181 3225 raft_consensus.cc:493] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.167573 3225 raft_consensus.cc:515] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.167973 1994 ts_tablet_manager.cc:1929] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:20.177066 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 8614b0ab1a3749a1a0aa441574f79ab1 (table default.Table_5b2e48a604b14d41b144c467b1738da5 [id=07abbfb4efc94a4a9104ba6600121313]) successfully deleted
I20260619 19:54:20.130811 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 729) took 2689 ms. Trace:
I20260619 19:54:20.184149 1973 rpcz_store.cc:276] 0619 19:54:17.441504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.441545 (+ 41us) service_pool.cc:224] Handling call
0619 19:54:20.130686 (+2689141us) ts_tablet_manager.cc:1151] Deleting tablet 55404d15d42244c6b42272143c44ff9c
0619 19:54:20.130698 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.130795 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2688983}
I20260619 19:54:20.184523 1973 tablet_replica.cc:333] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.184737 1973 raft_consensus.cc:2243] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.184931 1973 raft_consensus.cc:2272] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.134255 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b0e811cf2a4bf4a23351f9ba5b6173" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.185545 1973 ts_tablet_manager.cc:1916] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.185516 3275 raft_consensus.cc:493] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.175443 749 tablet_service.cc:1558] Processing DeleteTablet for tablet df8513e281cb44d1986e7c54376e1bdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.175803 755 tablet_service.cc:1558] Processing DeleteTablet for tablet bc2291967f0945efb7486079a93a6aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.185660 3275 raft_consensus.cc:515] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.176153 764 tablet_service.cc:1558] Processing DeleteTablet for tablet cad702900111463fa298c76098746bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.176626 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d01d2d98b64226b619255500498ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.179625 1208 tablet_bootstrap.cc:492] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:20.185999 1208 ts_tablet_manager.cc:1403] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.156s user 0.009s sys 0.029s
I20260619 19:54:20.186295 3275 leader_election.cc:290] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:20.187248 1208 raft_consensus.cc:359] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.187458 892 tablet_service.cc:1558] Processing DeleteTablet for tablet bc2291967f0945efb7486079a93a6aad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.187536 1208 raft_consensus.cc:385] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.187649 902 tablet_service.cc:1558] Processing DeleteTablet for tablet cad702900111463fa298c76098746bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.187644 1208 raft_consensus.cc:740] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.187793 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d01d2d98b64226b619255500498ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.187969 1208 consensus_queue.cc:260] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.189268 1208 ts_tablet_manager.cc:1434] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:20.189604 888 tablet_service.cc:1558] Processing DeleteTablet for tablet df8513e281cb44d1986e7c54376e1bdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.189851 1208 tablet_bootstrap.cc:492] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:20.192625 1208 tablet_bootstrap.cc:654] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.200951 1201 raft_consensus.cc:359] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.201224 1201 raft_consensus.cc:385] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.201289 1201 raft_consensus.cc:740] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.201524 1201 consensus_queue.cc:260] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.202854 1201 ts_tablet_manager.cc:1434] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.068s user 0.003s sys 0.000s
W20260619 19:54:20.203444 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 92206.1us
I20260619 19:54:20.204007 859 leader_election.cc:304] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:20.204665 859 leader_election.cc:343] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 56640f773efb4123b93f4ca3799ddde7
W20260619 19:54:20.204984 859 leader_election.cc:343] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 0991105460f749e1854d512304ff56cd
I20260619 19:54:20.205084 859 leader_election.cc:304] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:20.205523 859 leader_election.cc:343] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b4f7122fa5f94eeaa3b99cae107d8c9a
W20260619 19:54:20.205837 859 leader_election.cc:343] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:20.205928 859 leader_election.cc:304] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:20.206403 859 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 710fae36dd674b1786aa75013284684e
W20260619 19:54:20.206955 859 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:20.207450 3273 raft_consensus.cc:2804] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.207552 3274 raft_consensus.cc:2804] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.207659 3274 raft_consensus.cc:493] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.207721 3274 raft_consensus.cc:3060] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.208021 3047 raft_consensus.cc:2749] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:20.208544 2953 raft_consensus.cc:2749] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:20.209069 1201 tablet_bootstrap.cc:492] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:20.207540 3273 raft_consensus.cc:493] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.211966 3273 raft_consensus.cc:3060] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.214334 1201 tablet_bootstrap.cc:654] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.215015 3273 raft_consensus.cc:515] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.215670 3273 leader_election.cc:290] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.211099 3274 raft_consensus.cc:515] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.216156 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.216596 3274 leader_election.cc:290] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:20.217562 858 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.217768 858 leader_election.cc:304] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
W20260619 19:54:20.218216 858 leader_election.cc:343] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.218676 3115 raft_consensus.cc:2804] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.218787 3115 raft_consensus.cc:697] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.219007 3115 consensus_queue.cc:237] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.220098 3047 raft_consensus.cc:493] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.220224 3047 raft_consensus.cc:515] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.220788 3047 leader_election.cc:290] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.220901 3047 raft_consensus.cc:493] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:20.220992 3047 raft_consensus.cc:515] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.221480 3047 leader_election.cc:290] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:20.221760 3047 consensus_queue.cc:1048] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.229722 2026 raft_consensus.cc:2272] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.231472 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.232542 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.232712 774 raft_consensus.cc:3060] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.234604 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2939b8aa0d44ad2a05a933db4ea64be" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.234799 780 raft_consensus.cc:2468] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
W20260619 19:54:20.235476 858 leader_election.cc:343] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.235726 858 leader_election.cc:304] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.237042 774 raft_consensus.cc:2468] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.233235 2026 ts_tablet_manager.cc:1916] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.244356 3047 raft_consensus.cc:2804] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.244503 3047 raft_consensus.cc:493] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.244611 3047 raft_consensus.cc:3060] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.248844 3047 raft_consensus.cc:515] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.249810 3047 leader_election.cc:290] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:20.247717 858 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 983faf8557814093bc427291711f3fce
I20260619 19:54:20.251200 858 leader_election.cc:304] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.251605 3276 consensus_queue.cc:1048] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.251993 3047 raft_consensus.cc:2804] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.252156 3047 raft_consensus.cc:697] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.252188 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2939b8aa0d44ad2a05a933db4ea64be" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.252451 3047 consensus_queue.cc:237] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.252724 774 raft_consensus.cc:3060] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.168262 3225 leader_election.cc:290] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.177897 1200 raft_consensus.cc:359] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.254189 1994 log.cc:1199] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/55404d15d42244c6b42272143c44ff9c
I20260619 19:54:20.254243 1200 raft_consensus.cc:385] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.254318 1200 raft_consensus.cc:740] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.254573 1994 ts_tablet_manager.cc:1950] T 55404d15d42244c6b42272143c44ff9c P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:20.254541 1200 consensus_queue.cc:260] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.255625 1200 ts_tablet_manager.cc:1434] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.125s user 0.002s sys 0.000s
I20260619 19:54:20.255972 1200 tablet_bootstrap.cc:492] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.256043 1994 tablet_replica.cc:333] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:20.256223 1994 raft_consensus.cc:2243] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.256366 1994 raft_consensus.cc:2272] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.256456 774 raft_consensus.cc:2468] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.211696 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_01a59125e9354956a7df1f8f0b26b592" } new_table_name: "default.Table_13d32b679a454a75bea633c92bc0a154" modify_external_catalogs: true
I20260619 19:54:20.257920 1200 tablet_bootstrap.cc:654] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:20.258016 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 80945.4us
I20260619 19:54:20.258517 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 710fae36dd674b1786aa75013284684e (table default.Table_ce5d8cf6a7344aeeaa46f234df45ea2c [id=a60f9d6abee04893a759c7913479216f]) successfully deleted
W20260619 19:54:20.182163 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.130:37425, user_credentials={real_user=slave}} blocked reactor thread for 50071.1us
I20260619 19:54:20.258801 1201 tablet_bootstrap.cc:492] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:20.258788 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 79bcc998cf6c4d3e851a437ccd2edb92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79bcc998cf6c4d3e851a437ccd2edb92 already in progress: creating tablet
I20260619 19:54:20.258932 1201 ts_tablet_manager.cc:1403] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.000s
W20260619 19:54:20.259006 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f5057229e0d04eafb501356ad8f649ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5057229e0d04eafb501356ad8f649ba already in progress: creating tablet
I20260619 19:54:20.233453 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_a62ff56b27aa44c594c3e7438005ac8f" } new_table_name: "default.Table_8c9383724b564bcc9bcbd77398f5f0fa" modify_external_catalogs: true
W20260619 19:54:20.259274 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a1c42c4e323a434bac1f6cb25a1a0281 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1c42c4e323a434bac1f6cb25a1a0281 already in progress: creating tablet
W20260619 19:54:20.259486 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 55404d15d42244c6b42272143c44ff9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55404d15d42244c6b42272143c44ff9c already in progress: creating tablet
I20260619 19:54:20.259899 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet cc57b42a97fa437b93842f7cd379dbb7 (table default.Table_442f268fdee346aca6c6696de3acecc9 [id=e10e25458b1f4fe380c7e36037454fa8]) successfully deleted
I20260619 19:54:20.238853 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2300ea60526241559237eec272c8c895"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.260139 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b289d3068d184d47b671617213aa512a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b289d3068d184d47b671617213aa512a already in progress: creating tablet
I20260619 19:54:20.259868 1201 raft_consensus.cc:359] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.260309 1201 raft_consensus.cc:385] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.260372 1201 raft_consensus.cc:740] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.183398 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet cad702900111463fa298c76098746bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.260923 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:20.239445 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_639a2214cb334e2ea654335eece0cae1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:20.185137 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d01d2d98b64226b619255500498ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.262636 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74813bf79789451f90bcf7779aff9290" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:20.263082 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74813bf79789451f90bcf7779aff9290" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.263325 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.263520 780 raft_consensus.cc:2393] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:20.267519 1201 consensus_queue.cc:260] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.268173 1201 ts_tablet_manager.cc:1434] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260619 19:54:20.268818 1201 tablet_bootstrap.cc:492] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:20.269374 996 leader_election.cc:343] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.272217 996 leader_election.cc:304] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:20.272624 996 leader_election.cc:343] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.272718 996 leader_election.cc:304] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.261268 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 55404d15d42244c6b42272143c44ff9c (table default.Table_97f0e0bd83a94191a3339611d258d716 [id=e281514882fb422bbbe4d740eee2d029]) successfully deleted
W20260619 19:54:20.272837 996 raft_consensus.cc:2686] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:20.273726 3225 raft_consensus.cc:2749] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260619 19:54:20.274188 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_639a2214cb334e2ea654335eece0cae1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:20.277078 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2300ea60526241559237eec272c8c895 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.279313 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fd82efdfad7d457190095d1d9d0359a1" } modify_external_catalogs: true
I20260619 19:54:20.279567 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_fd82efdfad7d457190095d1d9d0359a1" } modify_external_catalogs: true
I20260619 19:54:20.280463 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_bba4acb0fbc1418f8d54d8849fab23e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.281123 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bba4acb0fbc1418f8d54d8849fab23e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.285133 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_87bdea79784342679a1c2fb1d32fd1c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:20.286571 3276 raft_consensus.cc:493] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.286731 3276 raft_consensus.cc:515] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.287315 3276 leader_election.cc:290] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:20.292138 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95f7527ee18540cea3d835e8988e6c5f consensus state has no leader
I20260619 19:54:20.302124 3248 raft_consensus.cc:493] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.302460 3248 raft_consensus.cc:515] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.306161 1200 tablet_bootstrap.cc:492] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
W20260619 19:54:20.307430 720 leader_election.cc:343] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 0991105460f749e1854d512304ff56cd
I20260619 19:54:20.307436 1200 ts_tablet_manager.cc:1403] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.010s
I20260619 19:54:20.308424 3248 leader_election.cc:290] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.308588 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0991105460f749e1854d512304ff56cd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:20.308877 918 raft_consensus.cc:2468] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:20.309404 719 leader_election.cc:304] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.309641 915 raft_consensus.cc:1275] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Refusing update from remote peer e78a44e2c8824fe7bce462e9d33f660c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 19:54:20.309898 3248 raft_consensus.cc:2804] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.310292 3248 raft_consensus.cc:493] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.310473 3248 raft_consensus.cc:3060] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.311015 858 leader_election.cc:304] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.312273 3276 raft_consensus.cc:2804] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.312412 3276 raft_consensus.cc:697] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.312680 3276 consensus_queue.cc:237] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.313462 3302 consensus_queue.cc:1048] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260619 19:54:20.317996 996 consensus_peers.cc:597] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:20.319442 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87bdea79784342679a1c2fb1d32fd1c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.317723 1200 raft_consensus.cc:359] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.319753 1200 raft_consensus.cc:385] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.321432 1200 raft_consensus.cc:740] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.327189 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:20.331000 1201 tablet_bootstrap.cc:654] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.331025 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.337486 1973 ts_tablet_manager.cc:1929] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:20.337862 1973 log.cc:1199] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:20.337812 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.337986 1054 raft_consensus.cc:3060] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.338816 1200 consensus_queue.cc:260] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.339358 1200 ts_tablet_manager.cc:1434] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260619 19:54:20.339648 1200 tablet_bootstrap.cc:492] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.340782 1054 raft_consensus.cc:2468] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.341650 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dbba24094d4630be45b7febe8cb29e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.341979 1973 ts_tablet_manager.cc:1950] T 42b0e811cf2a4bf4a23351f9ba5b6173 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.342023 1054 raft_consensus.cc:2393] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:20.343199 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 731) took 2900 ms. Trace:
I20260619 19:54:20.343959 1973 rpcz_store.cc:276] 0619 19:54:17.442340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.442388 (+ 48us) service_pool.cc:224] Handling call
0619 19:54:20.184462 (+2742074us) ts_tablet_manager.cc:1151] Deleting tablet 42b0e811cf2a4bf4a23351f9ba5b6173
0619 19:54:20.184475 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.334217 (+149742us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.337415 (+ 3198us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.343174 (+ 5759us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2741929}
W20260619 19:54:20.344944 858 leader_election.cc:343] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.345750 1973 tablet_replica.cc:333] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.346235 1973 raft_consensus.cc:2243] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.346781 1973 raft_consensus.cc:2272] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.347725 1973 ts_tablet_manager.cc:1916] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.348433 1200 tablet_bootstrap.cc:654] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.356155 1201 tablet_bootstrap.cc:492] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:20.356364 1201 ts_tablet_manager.cc:1403] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.088s user 0.007s sys 0.000s
I20260619 19:54:20.357322 1201 raft_consensus.cc:359] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.357553 1201 raft_consensus.cc:385] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.357625 1201 raft_consensus.cc:740] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.357949 1201 consensus_queue.cc:260] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.358186 3290 raft_consensus.cc:493] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.358341 3290 raft_consensus.cc:515] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.359633 3290 leader_election.cc:290] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.357525 1200 tablet_bootstrap.cc:492] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:20.361619 1201 ts_tablet_manager.cc:1434] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260619 19:54:20.362109 1201 tablet_bootstrap.cc:492] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:20.362986 1994 ts_tablet_manager.cc:1916] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.367815 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c453f79a82b94fc8b556c1272b0d609a" } new_table_name: "default.Table_6543aece5236445180dd69790bffe6ad" modify_external_catalogs: true
I20260619 19:54:20.367992 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d8cd01251f4cfa93ecddb391c1c91e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.369547 1201 tablet_bootstrap.cc:654] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.369438 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3142a60be0ce424e82d2af0d4e63c80e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:20.370050 1200 ts_tablet_manager.cc:1403] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.002s
W20260619 19:54:20.370168 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3142a60be0ce424e82d2af0d4e63c80e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.370513 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:20.370780 1054 raft_consensus.cc:2468] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.371246 1200 raft_consensus.cc:359] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.371465 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2eddd2ecabf543a7b170898e84e5a3d5" } new_table_name: "default.Table_d22feccee94b4285b81dc207e65f5c50" modify_external_catalogs: true
I20260619 19:54:20.372532 1200 raft_consensus.cc:385] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.372781 1200 raft_consensus.cc:740] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.373136 1200 consensus_queue.cc:260] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.374358 1200 ts_tablet_manager.cc:1434] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 19:54:20.376648 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 42b0e811cf2a4bf4a23351f9ba5b6173 (table default.Table_8b2950a5d623472892aa182117131970 [id=0342764f88ba49ce837448cf3e8fce60]) successfully deleted
I20260619 19:54:20.378756 1973 ts_tablet_manager.cc:1929] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:20.375655 3265 tablet.cc:1724] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260619 19:54:20.388818 858 leader_election.cc:343] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.388430 1200 tablet_bootstrap.cc:492] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.389346 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d8cd01251f4cfa93ecddb391c1c91e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:20.389596 1054 raft_consensus.cc:2468] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.393733 1200 tablet_bootstrap.cc:654] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.395659 1973 log.cc:1199] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/297f07f2d08d47dfa69f845dadb973b1
I20260619 19:54:20.396453 1973 ts_tablet_manager.cc:1950] T 297f07f2d08d47dfa69f845dadb973b1 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.398604 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 740) took 2853 ms. Trace:
W20260619 19:54:20.398921 858 consensus_peers.cc:597] T ba0cd4cd0661415d8b2b2339363e7aca P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba0cd4cd0661415d8b2b2339363e7aca. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:20.399425 1973 rpcz_store.cc:276] 0619 19:54:17.544915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.544970 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:20.345690 (+2800720us) ts_tablet_manager.cc:1151] Deleting tablet 297f07f2d08d47dfa69f845dadb973b1
0619 19:54:20.345702 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.359526 (+ 13824us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.378689 (+ 19163us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.398586 (+ 19897us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2800396}
I20260619 19:54:20.400450 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 297f07f2d08d47dfa69f845dadb973b1 (table default.Table_069216990ae746dca4b43043b9485658 [id=8d6402c45a4d4456935a213be45b3c51]) successfully deleted
I20260619 19:54:20.400796 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 739) took 2856 ms. Trace:
I20260619 19:54:20.404887 1973 rpcz_store.cc:276] 0619 19:54:17.544801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.545317 (+ 516us) service_pool.cc:224] Handling call
0619 19:54:20.400661 (+2855344us) ts_tablet_manager.cc:1151] Deleting tablet e38fa2f7e9b54b1bb3c659334f43f8d4
0619 19:54:20.400671 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.400774 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2855189}
I20260619 19:54:20.381946 3248 raft_consensus.cc:515] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.407542 3248 leader_election.cc:290] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.407644 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0991105460f749e1854d512304ff56cd" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:20.407876 918 raft_consensus.cc:3060] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.408088 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 736) took 2863 ms. Trace:
I20260619 19:54:20.408164 1973 rpcz_store.cc:276] 0619 19:54:17.544508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.545496 (+ 988us) service_pool.cc:224] Handling call
0619 19:54:20.407950 (+2862454us) ts_tablet_manager.cc:1151] Deleting tablet 6dcc6a33ac96439d9409ec194b40ab5f
0619 19:54:20.407960 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.408071 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862302}
I20260619 19:54:20.409982 1200 tablet_bootstrap.cc:492] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:20.410138 1200 ts_tablet_manager.cc:1403] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260619 19:54:20.410547 918 raft_consensus.cc:2468] T 0991105460f749e1854d512304ff56cd P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:20.411036 719 leader_election.cc:304] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:20.411432 3248 raft_consensus.cc:2804] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.412310 1201 tablet_bootstrap.cc:492] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:20.412492 1201 ts_tablet_manager.cc:1403] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.051s user 0.000s sys 0.003s
I20260619 19:54:20.412675 3248 raft_consensus.cc:697] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:20.412940 3248 consensus_queue.cc:237] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:20.413244 720 leader_election.cc:343] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 0991105460f749e1854d512304ff56cd
I20260619 19:54:20.413282 1201 raft_consensus.cc:359] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.413475 1201 raft_consensus.cc:385] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.413560 1201 raft_consensus.cc:740] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.413777 1201 consensus_queue.cc:260] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:20.413923 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e38fa2f7e9b54b1bb3c659334f43f8d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e38fa2f7e9b54b1bb3c659334f43f8d4 already in progress: creating tablet
I20260619 19:54:20.414026 3276 raft_consensus.cc:493] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:20.414251 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6dcc6a33ac96439d9409ec194b40ab5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6dcc6a33ac96439d9409ec194b40ab5f already in progress: creating tablet
I20260619 19:54:20.414235 3276 raft_consensus.cc:515] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.415086 3276 leader_election.cc:290] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.415654 1201 ts_tablet_manager.cc:1434] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260619 19:54:20.416111 859 leader_election.cc:343] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: b4f7122fa5f94eeaa3b99cae107d8c9a
I20260619 19:54:20.416357 1201 tablet_bootstrap.cc:492] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:20.416836 859 consensus_peers.cc:597] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f658e85be0c843f2b02e4567a80521c4. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:20.418188 1201 tablet_bootstrap.cc:654] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.418220 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 738) took 2873 ms. Trace:
I20260619 19:54:20.418321 1973 rpcz_store.cc:276] 0619 19:54:17.544707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.545673 (+ 966us) service_pool.cc:224] Handling call
0619 19:54:20.418069 (+2872396us) ts_tablet_manager.cc:1151] Deleting tablet d6bc861cb7d941f380671105fd338538
0619 19:54:20.418083 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.418199 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2872247}
W20260619 19:54:20.418589 859 leader_election.cc:343] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 710fae36dd674b1786aa75013284684e
I20260619 19:54:20.418723 859 leader_election.cc:304] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.419309 3276 raft_consensus.cc:2749] T 710fae36dd674b1786aa75013284684e P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260619 19:54:20.419941 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d6bc861cb7d941f380671105fd338538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6bc861cb7d941f380671105fd338538 already in progress: creating tablet
I20260619 19:54:20.420101 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 737) took 2875 ms. Trace:
I20260619 19:54:20.420806 1973 rpcz_store.cc:276] 0619 19:54:17.544609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.545834 (+ 1225us) service_pool.cc:224] Handling call
0619 19:54:20.419963 (+2874129us) ts_tablet_manager.cc:1151] Deleting tablet 0a8c49f78e984e1ebd0c4e79a457447c
0619 19:54:20.419974 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.420082 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2873996}
W20260619 19:54:20.421103 859 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:20.421247 859 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.421713 3276 raft_consensus.cc:2749] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260619 19:54:20.421628 1200 raft_consensus.cc:359] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:20.422308 859 leader_election.cc:343] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:20.422405 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0a8c49f78e984e1ebd0c4e79a457447c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a8c49f78e984e1ebd0c4e79a457447c already in progress: creating tablet
I20260619 19:54:20.422421 859 leader_election.cc:304] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.422856 3276 raft_consensus.cc:2749] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:20.422870 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 751) took 2548 ms. Trace:
I20260619 19:54:20.422942 1973 rpcz_store.cc:276] 0619 19:54:17.874273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.874338 (+ 65us) service_pool.cc:224] Handling call
0619 19:54:20.422764 (+2548426us) ts_tablet_manager.cc:1151] Deleting tablet 9f6ec149e1ac475f8038b328dae4af2a
0619 19:54:20.422775 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.422852 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2429261}
I20260619 19:54:20.423869 1200 raft_consensus.cc:385] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.424302 1200 raft_consensus.cc:740] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.424664 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 752) took 2550 ms. Trace:
W20260619 19:54:20.424786 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9f6ec149e1ac475f8038b328dae4af2a because the tablet was not found. No further retry: Not found: Tablet not found: 9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:20.425073 2026 ts_tablet_manager.cc:1929] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:20.425226 1200 consensus_queue.cc:260] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.425807 1973 rpcz_store.cc:276] 0619 19:54:17.874638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.874692 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:20.424572 (+2549880us) ts_tablet_manager.cc:1151] Deleting tablet 9f33c2c00b414fbebf1965510e1e2b96
0619 19:54:20.424586 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.424647 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2430991}
I20260619 19:54:20.428772 1200 ts_tablet_manager.cc:1434] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260619 19:54:20.429126 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 753) took 2521 ms. Trace:
W20260619 19:54:20.429284 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 9f33c2c00b414fbebf1965510e1e2b96 because the tablet was not found. No further retry: Not found: Tablet not found: 9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:20.429584 1973 rpcz_store.cc:276] 0619 19:54:17.908123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:17.928240 (+ 20117us) service_pool.cc:224] Handling call
0619 19:54:20.427904 (+2499664us) ts_tablet_manager.cc:1151] Deleting tablet c72c51c230b644f2b000bd9fb1098c44
0619 19:54:20.427916 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.429106 (+ 1190us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2356278}
I20260619 19:54:20.430183 1200 tablet_bootstrap.cc:492] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.430516 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.430704 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 762) took 2323 ms. Trace:
I20260619 19:54:20.430770 1973 rpcz_store.cc:276] 0619 19:54:18.107757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.107832 (+ 75us) service_pool.cc:224] Handling call
0619 19:54:20.430598 (+2322766us) ts_tablet_manager.cc:1151] Deleting tablet f87a0e3970cc4123bc7a75db2a63eab1
0619 19:54:20.430608 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.430689 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322457}
W20260619 19:54:20.432932 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c72c51c230b644f2b000bd9fb1098c44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c72c51c230b644f2b000bd9fb1098c44 already in progress: creating tablet
W20260619 19:54:20.433341 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f87a0e3970cc4123bc7a75db2a63eab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f87a0e3970cc4123bc7a75db2a63eab1 already in progress: creating tablet
I20260619 19:54:20.433431 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 763) took 2322 ms. Trace:
I20260619 19:54:20.433990 1973 rpcz_store.cc:276] 0619 19:54:18.111061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.111116 (+ 55us) service_pool.cc:224] Handling call
0619 19:54:20.433091 (+2321975us) ts_tablet_manager.cc:1151] Deleting tablet 8530dfb740284ad08b498a696d17ef9c
0619 19:54:20.433327 (+ 236us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.433412 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321667}
I20260619 19:54:20.435941 1200 tablet_bootstrap.cc:654] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.436311 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 766) took 2293 ms. Trace:
I20260619 19:54:20.437000 1973 rpcz_store.cc:276] 0619 19:54:18.142691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.145956 (+ 3265us) service_pool.cc:224] Handling call
0619 19:54:20.436201 (+2290245us) ts_tablet_manager.cc:1151] Deleting tablet a5e8c1996f334ea5a1af3771ed80c14d
0619 19:54:20.436211 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.436294 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2290039}
W20260619 19:54:20.437773 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8530dfb740284ad08b498a696d17ef9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8530dfb740284ad08b498a696d17ef9c already in progress: creating tablet
I20260619 19:54:20.438359 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 764) took 2319 ms. Trace:
I20260619 19:54:20.438983 1973 rpcz_store.cc:276] 0619 19:54:18.118674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.172323 (+ 53649us) service_pool.cc:224] Handling call
0619 19:54:20.438250 (+2265927us) ts_tablet_manager.cc:1151] Deleting tablet ee2b48219a234e7daf2a4bc12f250560
0619 19:54:20.438260 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.438343 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2265478}
I20260619 19:54:20.438056 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b8bd618a54364eb5878d8f234c13de38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.439536 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a5e8c1996f334ea5a1af3771ed80c14d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5e8c1996f334ea5a1af3771ed80c14d already in progress: creating tablet
W20260619 19:54:20.439836 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8bd618a54364eb5878d8f234c13de38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.440382 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 765) took 2299 ms. Trace:
I20260619 19:54:20.440450 1973 rpcz_store.cc:276] 0619 19:54:18.141205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.165654 (+ 24449us) service_pool.cc:224] Handling call
0619 19:54:20.440283 (+2274629us) ts_tablet_manager.cc:1151] Deleting tablet b7ff86ab886e433f9f7b82e70a035415
0619 19:54:20.440292 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.440368 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2199435}
W20260619 19:54:20.441077 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ee2b48219a234e7daf2a4bc12f250560 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee2b48219a234e7daf2a4bc12f250560 already in progress: creating tablet
W20260619 19:54:20.438468 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 198c9f7a044c4a62b178a32e562f7168 consensus state has no leader
I20260619 19:54:20.441839 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0d1560157edb47baa3153f7a5b863967" } modify_external_catalogs: true
I20260619 19:54:20.442001 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0d1560157edb47baa3153f7a5b863967" } modify_external_catalogs: true
I20260619 19:54:20.443032 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 772) took 1928 ms. Trace:
I20260619 19:54:20.443123 1973 rpcz_store.cc:276] 0619 19:54:18.514646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.514700 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:20.442918 (+1928218us) ts_tablet_manager.cc:1151] Deleting tablet 15b81edd27d14611b3a66c547117c532
0619 19:54:20.442932 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.443016 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1928040}
W20260619 19:54:20.443838 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b7ff86ab886e433f9f7b82e70a035415 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7ff86ab886e433f9f7b82e70a035415 already in progress: creating tablet
I20260619 19:54:20.445369 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 773) took 1930 ms. Trace:
W20260619 19:54:20.444722 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 15b81edd27d14611b3a66c547117c532 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b81edd27d14611b3a66c547117c532 already in progress: creating tablet
I20260619 19:54:20.446429 1973 rpcz_store.cc:276] 0619 19:54:18.514744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.514945 (+ 201us) service_pool.cc:224] Handling call
0619 19:54:20.445258 (+1930313us) ts_tablet_manager.cc:1151] Deleting tablet 1c0e601c022049fcb050f7b90b9f3a98
0619 19:54:20.445267 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.445352 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1930161}
I20260619 19:54:20.447381 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_021d1b5629484a168dc9dbf0e2bfa23d" } modify_external_catalogs: true
I20260619 19:54:20.447558 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_021d1b5629484a168dc9dbf0e2bfa23d" } modify_external_catalogs: true
W20260619 19:54:20.447623 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1c0e601c022049fcb050f7b90b9f3a98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c0e601c022049fcb050f7b90b9f3a98 already in progress: creating tablet
I20260619 19:54:20.448089 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 774) took 1933 ms. Trace:
W20260619 19:54:20.449759 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:20.450448 1973 rpcz_store.cc:276] 0619 19:54:18.514822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.515154 (+ 332us) service_pool.cc:224] Handling call
0619 19:54:20.447986 (+1932832us) ts_tablet_manager.cc:1151] Deleting tablet 8a6e5f969929426d95a49cf597bda491
0619 19:54:20.447996 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.448074 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1932704}
I20260619 19:54:20.451570 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 775) took 1936 ms. Trace:
I20260619 19:54:20.452764 1973 rpcz_store.cc:276] 0619 19:54:18.514896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.515249 (+ 353us) service_pool.cc:224] Handling call
0619 19:54:20.451462 (+1936213us) ts_tablet_manager.cc:1151] Deleting tablet 8f50b9f07f3b4d00b500adef6c67e36d
0619 19:54:20.451471 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.451555 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1936087}
I20260619 19:54:20.454228 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 780) took 1788 ms. Trace:
I20260619 19:54:20.455436 1973 rpcz_store.cc:276] 0619 19:54:18.666193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.666250 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:20.454117 (+1787867us) ts_tablet_manager.cc:1151] Deleting tablet 1642bc8d3f984e1c9d60093fa7abcc53
0619 19:54:20.454128 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.454214 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787700}
I20260619 19:54:20.456463 1973 tablet_replica.cc:333] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.457450 1973 raft_consensus.cc:2243] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.458527 1973 raft_consensus.cc:2272] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.461611 1973 ts_tablet_manager.cc:1916] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.461575 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "913f4e0c705a494e8f9514f34579ea69" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:20.461870 1060 raft_consensus.cc:2393] T 913f4e0c705a494e8f9514f34579ea69 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate b1f5f240547f42ec82f57e6c8af5ea89 in this term.
I20260619 19:54:20.462260 2026 log.cc:1199] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/8522f562665540ce99490ab90e02d801
I20260619 19:54:20.462881 2026 ts_tablet_manager.cc:1950] T 8522f562665540ce99490ab90e02d801 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:20.463944 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 339) took 13970 ms. Trace:
I20260619 19:54:20.464141 2026 rpcz_store.cc:276] 0619 19:54:06.493657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.507599 (+ 13942us) service_pool.cc:224] Handling call
0619 19:54:20.149996 (+13642397us) ts_tablet_manager.cc:1151] Deleting tablet 8522f562665540ce99490ab90e02d801
0619 19:54:20.150010 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.242219 (+ 92209us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.424978 (+182759us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.463899 (+ 38921us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78591,"tablet-delete.queue_time_us":13641740}
I20260619 19:54:20.465075 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 342) took 13918 ms. Trace:
I20260619 19:54:20.465242 2026 rpcz_store.cc:276] 0619 19:54:06.546813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.547468 (+ 655us) service_pool.cc:224] Handling call
0619 19:54:20.464915 (+13917447us) ts_tablet_manager.cc:1151] Deleting tablet ef509392f1b3472db598c8b414258932
0619 19:54:20.464928 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.465036 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13917043}
I20260619 19:54:20.465837 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 344) took 13900 ms. Trace:
I20260619 19:54:20.466850 2026 rpcz_store.cc:276] 0619 19:54:06.564908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.564967 (+ 59us) service_pool.cc:224] Handling call
0619 19:54:20.465726 (+13900759us) ts_tablet_manager.cc:1151] Deleting tablet 9b08ab9ad59049919649b96890b6785d
0619 19:54:20.465737 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.465796 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13900516}
I20260619 19:54:20.425803 3313 tablet.cc:1724] T e244971a6b0b424db6d16d233b32a96e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:20.426066 859 leader_election.cc:304] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.468034 2953 raft_consensus.cc:2804] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.468309 2953 raft_consensus.cc:697] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
W20260619 19:54:20.468655 859 leader_election.cc:343] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 983faf8557814093bc427291711f3fce
I20260619 19:54:20.468626 2953 consensus_queue.cc:237] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.468778 859 leader_election.cc:304] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.469314 3274 raft_consensus.cc:2749] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:20.469323 859 leader_election.cc:343] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d2939b8aa0d44ad2a05a933db4ea64be
I20260619 19:54:20.469692 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 8522f562665540ce99490ab90e02d801 (table default.Table_377571595e3f44ee8f2df88f6a261499 [id=b66ad69a759847bebf46963c43c5af2c]) successfully deleted
I20260619 19:54:20.469913 859 leader_election.cc:304] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:20.469942 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ef509392f1b3472db598c8b414258932 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef509392f1b3472db598c8b414258932 already in progress: creating tablet
I20260619 19:54:20.453886 1201 tablet_bootstrap.cc:492] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:20.470151 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8a6e5f969929426d95a49cf597bda491 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a6e5f969929426d95a49cf597bda491 already in progress: creating tablet
I20260619 19:54:20.456660 3276 consensus_queue.cc:1048] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:20.470283 859 leader_election.cc:343] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d2939b8aa0d44ad2a05a933db4ea64be
I20260619 19:54:20.470494 3290 raft_consensus.cc:2804] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.470587 3290 raft_consensus.cc:493] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.470711 3290 raft_consensus.cc:3060] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.470652 3274 consensus_queue.cc:1048] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.470736 859 leader_election.cc:304] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.471428 3274 raft_consensus.cc:2804] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.471529 3274 raft_consensus.cc:493] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.471629 3274 raft_consensus.cc:3060] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.470279 1201 ts_tablet_manager.cc:1403] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.002s
I20260619 19:54:20.473364 1201 raft_consensus.cc:359] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.473647 1201 raft_consensus.cc:385] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.474056 1201 raft_consensus.cc:740] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.473364 3290 raft_consensus.cc:515] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.474359 1201 consensus_queue.cc:260] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.474022 3274 raft_consensus.cc:515] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.474895 3290 leader_election.cc:290] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.474962 1201 ts_tablet_manager.cc:1434] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:20.475098 3274 leader_election.cc:290] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.475278 1201 tablet_bootstrap.cc:492] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:20.470590 3276 raft_consensus.cc:493] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.476327 3276 raft_consensus.cc:515] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.476992 3276 leader_election.cc:290] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:20.477336 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8f50b9f07f3b4d00b500adef6c67e36d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f50b9f07f3b4d00b500adef6c67e36d already in progress: creating tablet
I20260619 19:54:20.477675 1201 tablet_bootstrap.cc:654] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:20.477792 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 1642bc8d3f984e1c9d60093fa7abcc53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1642bc8d3f984e1c9d60093fa7abcc53 already in progress: creating tablet
I20260619 19:54:20.481554 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.482640 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d8cd01251f4cfa93ecddb391c1c91e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:20.425593 3115 consensus_queue.cc:1048] T 9f69d2e3ee384eb9997bed7d594c919d P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.483722 3276 raft_consensus.cc:493] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.483915 3276 raft_consensus.cc:515] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.484046 859 leader_election.cc:304] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.484515 3276 leader_election.cc:290] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.484664 3276 raft_consensus.cc:3060] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.487685 3276 raft_consensus.cc:2749] T 913f4e0c705a494e8f9514f34579ea69 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:20.489831 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b18a61d955e4929998b90c6c8fa844e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:20.490509 858 leader_election.cc:343] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:20.491218 858 leader_election.cc:343] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:20.491796 858 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fb6bc52ee1fa4ac8967f937e59b4550c
W20260619 19:54:20.492223 858 leader_election.cc:343] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.492311 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.492609 1058 raft_consensus.cc:3060] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.492333 1994 ts_tablet_manager.cc:1929] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:20.494575 1994 log.cc:1199] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/74813bf79789451f90bcf7779aff9290
I20260619 19:54:20.495071 1994 ts_tablet_manager.cc:1950] T 74813bf79789451f90bcf7779aff9290 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
W20260619 19:54:20.495859 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee64505bfcdf49b5820754cbbf822165 consensus state has no leader
I20260619 19:54:20.495290 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74d8cd01251f4cfa93ecddb391c1c91e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.496261 1054 raft_consensus.cc:3060] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.496302 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8c9383724b564bcc9bcbd77398f5f0fa" } new_table_name: "default.Table_ca0a0c0ff3a24e1e996251051e9927e8" modify_external_catalogs: true
I20260619 19:54:20.496806 1058 raft_consensus.cc:2468] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.496848 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:20.497193 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:20.499116 1041 tablet_service.cc:1511] Processing CreateTablet for tablet fae918a430a54550aea9e32250a32fb7 (DEFAULT_TABLE table=default.Table_99ad2921377b43608418af63d31c135f [id=003e0ab14c2a480da239a870ff4a2421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.499529 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae918a430a54550aea9e32250a32fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.500391 1054 raft_consensus.cc:2468] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.502074 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:20.502249 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b1f3a948deae4b969e1f0683be17b3ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.502357 859 leader_election.cc:343] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fb6bc52ee1fa4ac8967f937e59b4550c
I20260619 19:54:20.502560 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet deba56eb121e4aa6b8ad7b13951723aa (table default.Table_eaefb5c915d34ab79e4f47c839fd0ade [id=2738114efd1f43d4a7f797f9b12f7398]). Expected version 2 got 0
I20260619 19:54:20.502621 859 leader_election.cc:304] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:20.502882 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1f3a948deae4b969e1f0683be17b3ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.503042 2953 raft_consensus.cc:2749] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:20.503463 859 leader_election.cc:343] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1b18a61d955e4929998b90c6c8fa844e
I20260619 19:54:20.503587 859 leader_election.cc:304] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:20.503739 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcc4a4d70a14f95952af1405296aee7 (DEFAULT_TABLE table=default.Table_2cfcddad05dd4568a710cb6fd4a38935 [id=3716dfa4af7d4afb8ac29a039ee38f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.504110 2953 raft_consensus.cc:2749] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:20.504151 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcc4a4d70a14f95952af1405296aee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.505260 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 74813bf79789451f90bcf7779aff9290 (table default.Table_54d709f23afb40979d6661097264021d [id=c746b2f4a50f461aaed225866dac8ac0]) successfully deleted
W20260619 19:54:20.506141 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet df8513e281cb44d1986e7c54376e1bdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df8513e281cb44d1986e7c54376e1bdc already in progress: creating tablet
W20260619 19:54:20.506386 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet bc2291967f0945efb7486079a93a6aad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2291967f0945efb7486079a93a6aad already in progress: creating tablet
W20260619 19:54:20.506592 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet cad702900111463fa298c76098746bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cad702900111463fa298c76098746bfb already in progress: creating tablet
I20260619 19:54:20.506647 1994 tablet_replica.cc:333] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:20.506836 1994 raft_consensus.cc:2243] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.506984 1994 raft_consensus.cc:2272] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.507591 1994 ts_tablet_manager.cc:1916] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.502880 530 catalog_manager.cc:5696] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:20.508021 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e244971a6b0b424db6d16d233b32a96e (table default.Table_589c54e306ea43ea998074767e53995f [id=84c367d2b1dd4a25813599ba3e8fd32f]). Expected version 1 got 0
I20260619 19:54:20.509398 859 leader_election.cc:304] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.509953 3115 raft_consensus.cc:2804] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.510144 3115 raft_consensus.cc:697] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.510449 3115 consensus_queue.cc:237] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.511718 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 550e1e33fc384884aa60e1452a19e13b (DEFAULT_TABLE table=default.Table_1c6851ff802d47eabe403f442af83038 [id=79cbdebda2e34ef580b5915d1b015912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.511859 859 leader_election.cc:304] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.512105 3290 raft_consensus.cc:2804] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.512125 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550e1e33fc384884aa60e1452a19e13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.512217 3290 raft_consensus.cc:697] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.512447 3290 consensus_queue.cc:237] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.513052 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 39113dd369bb4fd6a7172b6879365900 (DEFAULT_TABLE table=default.Table_db402dcea7cd491e9df3af4494176e2c [id=c451a861ffbf4c9fb2ade54af009c1a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.513437 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39113dd369bb4fd6a7172b6879365900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.515494 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3c38ab28684ad1be2414a9200ef7fd (DEFAULT_TABLE table=default.Table_12e89619bc914902b7f38712ecd70ba3 [id=cc7a9623a4414bef8d6d20a3248d5a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.515954 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3c38ab28684ad1be2414a9200ef7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.520121 3115 raft_consensus.cc:493] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.520357 1200 tablet_bootstrap.cc:492] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:20.520295 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_20608453192e425a99f62a98fb413a8d" } modify_external_catalogs: true
I20260619 19:54:20.520406 3115 raft_consensus.cc:515] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.520584 1200 ts_tablet_manager.cc:1403] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.005s
I20260619 19:54:20.520589 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_20608453192e425a99f62a98fb413a8d" } modify_external_catalogs: true
I20260619 19:54:20.521500 1200 raft_consensus.cc:359] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.521598 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 345) took 13955 ms. Trace:
I20260619 19:54:20.521690 1200 raft_consensus.cc:385] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.521747 1200 raft_consensus.cc:740] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.521695 2026 rpcz_store.cc:276] 0619 19:54:06.565724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.565770 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:20.521432 (+13955662us) ts_tablet_manager.cc:1151] Deleting tablet 906212dd25ef46f2b381ce6a99c39343
0619 19:54:20.521445 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.521540 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13955467}
I20260619 19:54:20.521981 1200 consensus_queue.cc:260] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.522876 3115 leader_election.cc:290] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.524538 2026 tablet_replica.cc:333] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:20.525875 2026 raft_consensus.cc:2243] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:20.524899 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:20.530532 1054 raft_consensus.cc:2468] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:20.530696 2026 raft_consensus.cc:2272] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.531020 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.533121 1200 ts_tablet_manager.cc:1434] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260619 19:54:20.532361 859 leader_election.cc:304] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:20.535301 3290 raft_consensus.cc:2804] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.535415 3290 raft_consensus.cc:493] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.535513 3290 raft_consensus.cc:3060] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.535755 1200 tablet_bootstrap.cc:492] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.537922 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca9b32b723442ca984900317b442a66 (DEFAULT_TABLE table=default.Table_9b2db7fc24bd4e6b89758838f60b0ac5 [id=e1c1a0e389584dd2b2cf5d0e37ba6b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.538306 3290 raft_consensus.cc:515] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.538657 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca9b32b723442ca984900317b442a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.538800 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a302b58582164855b7ef7b1d7e7d90f2 (DEFAULT_TABLE table=default.Table_be35c2633c92422e8ba617ebeac078e8 [id=c6cfc20a1e7c495090f002206ae852af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.533879 1201 tablet_bootstrap.cc:492] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:20.539244 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a302b58582164855b7ef7b1d7e7d90f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.539486 1201 ts_tablet_manager.cc:1403] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.001s
I20260619 19:54:20.540343 1201 raft_consensus.cc:359] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.540527 1201 raft_consensus.cc:385] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.540596 1201 raft_consensus.cc:740] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.540799 1201 consensus_queue.cc:260] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.541483 1201 ts_tablet_manager.cc:1434] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:20.541855 1201 tablet_bootstrap.cc:492] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:20.543596 1201 tablet_bootstrap.cc:654] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.545840 1034 tablet_service.cc:1511] Processing CreateTablet for tablet cfee1e663cb34faea908461bdb0d02a9 (DEFAULT_TABLE table=default.Table_b900de7a833f4bef95b679661a5b879c [id=11b4fe9448d54df9b858b6bd123d8965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.547032 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfee1e663cb34faea908461bdb0d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.548014 2026 ts_tablet_manager.cc:1916] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.550408 1200 tablet_bootstrap.cc:654] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:20.551205 858 leader_election.cc:343] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.552337 3290 leader_election.cc:290] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:20.553180 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:20.554103 858 leader_election.cc:343] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.555894 1200 tablet_bootstrap.cc:492] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:20.556892 1200 ts_tablet_manager.cc:1403] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.001s
I20260619 19:54:20.557919 1200 raft_consensus.cc:359] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.559530 1200 raft_consensus.cc:385] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.559988 1200 raft_consensus.cc:740] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.560969 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 (DEFAULT_TABLE table=default.Table_021d1b5629484a168dc9dbf0e2bfa23d [id=4bd829ddaa0448619c28210b8a6c4e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.561471 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.564412 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:20.564728 1060 raft_consensus.cc:3060] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.567669 1060 raft_consensus.cc:2468] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:20.569286 1200 consensus_queue.cc:260] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.569944 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9f36b5de86014245b17ba026519b4848"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.570616 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f36b5de86014245b17ba026519b4848 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.571419 859 leader_election.cc:304] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.571900 3047 raft_consensus.cc:2804] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.572119 3047 raft_consensus.cc:697] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:20.572445 3047 consensus_queue.cc:237] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:20.587034 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95f7527ee18540cea3d835e8988e6c5f consensus state has no leader
I20260619 19:54:20.599267 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4692cafcd97149139d8dda620d16c92c" } modify_external_catalogs: true
W20260619 19:54:20.599342 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 121622us
I20260619 19:54:20.599498 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4692cafcd97149139d8dda620d16c92c" } modify_external_catalogs: true
I20260619 19:54:20.601065 752 tablet_service.cc:1511] Processing CreateTablet for tablet fae918a430a54550aea9e32250a32fb7 (DEFAULT_TABLE table=default.Table_99ad2921377b43608418af63d31c135f [id=003e0ab14c2a480da239a870ff4a2421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.601522 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae918a430a54550aea9e32250a32fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.610044 1973 ts_tablet_manager.cc:1929] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:20.610200 1973 log.cc:1199] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/774938222588473e90c513232c82aece
I20260619 19:54:20.615202 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 736aa49b4d984295a9aefb135b005e07
I20260619 19:54:20.615972 1208 tablet_bootstrap.cc:492] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:20.616113 1208 ts_tablet_manager.cc:1403] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.426s user 0.017s sys 0.057s
I20260619 19:54:20.616844 1208 raft_consensus.cc:359] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.617054 1208 raft_consensus.cc:385] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.617115 1208 raft_consensus.cc:740] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.617321 1208 consensus_queue.cc:260] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.618625 1208 ts_tablet_manager.cc:1434] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:20.595876 1994 ts_tablet_manager.cc:1929] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:20.600281 1039 tablet_service.cc:1511] Processing CreateTablet for tablet e2bd4e6a61da443192a1e8b0acf34eb8 (DEFAULT_TABLE table=default.Table_0f37a2b643f545a599d3bea1d614a0d4 [id=fe6ad661316f4fb98139d43f04800b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.619244 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2bd4e6a61da443192a1e8b0acf34eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.619745 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 736aa49b4d984295a9aefb135b005e07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.619961 1200 ts_tablet_manager.cc:1434] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.063s user 0.002s sys 0.000s
I20260619 19:54:20.622525 1200 tablet_bootstrap.cc:492] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.600770 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0a658add5c45508b320516014a2c61 (DEFAULT_TABLE table=default.Table_22d566a824b24778b6d902f8c33aac85 [id=632ffa431fcb4788a0e688dd6649f4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.624037 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0a658add5c45508b320516014a2c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.624372 1200 tablet_bootstrap.cc:654] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.626482 1208 tablet_bootstrap.cc:492] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:20.604429 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1ca289620849729353a9072c75b93d (DEFAULT_TABLE table=default.Table_d5682c9323624c1aa06d0babb65a1393 [id=a9076efba1f34eb9b03d3824c018ea04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.627482 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1ca289620849729353a9072c75b93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.605297 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 72bb0361a04c4b469a7bdf3eb6157707 (DEFAULT_TABLE table=default.Table_66674465fc2640b383f68327c9e1d710 [id=1d9cae00e2c24b7495a8c9146e22a51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.631685 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bb0361a04c4b469a7bdf3eb6157707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.611496 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3de788fe38794980a3b72264e038f8b3 (DEFAULT_TABLE table=default.Table_72cf4d7f1df6437590fc200e5936fa21 [id=51c7c5bc74a4428b85bac8ea15aab27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.634177 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3de788fe38794980a3b72264e038f8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.635434 3302 raft_consensus.cc:493] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.635560 3302 raft_consensus.cc:515] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.636126 3302 leader_election.cc:290] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.643167 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6532bdfd3c844ff2a25bee6ff1e0c25e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:20.644721 996 leader_election.cc:343] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.648833 1994 log.cc:1199] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/52d01d2d98b64226b619255500498ffe
I20260619 19:54:20.649349 1994 ts_tablet_manager.cc:1950] T 52d01d2d98b64226b619255500498ffe P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:20.650492 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 52d01d2d98b64226b619255500498ffe (table default.Table_b8daa904a52e492d9f9942b151daca0f [id=fd2aa005a84e43fcb05b3ddc511c1961]) successfully deleted
I20260619 19:54:20.650744 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 50bc884e4c304309a326b21a3c059fd4
W20260619 19:54:20.650950 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 736aa49b4d984295a9aefb135b005e07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 736aa49b4d984295a9aefb135b005e07 already in progress: creating tablet
I20260619 19:54:20.651590 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc884e4c304309a326b21a3c059fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:20.652498 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 50bc884e4c304309a326b21a3c059fd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50bc884e4c304309a326b21a3c059fd4 already in progress: creating tablet
I20260619 19:54:20.653525 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_bf2690d8812e4532a142f1bae859938d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.654009 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf2690d8812e4532a142f1bae859938d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.655531 1973 ts_tablet_manager.cc:1950] T 774938222588473e90c513232c82aece P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.655948 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 782) took 1965 ms. Trace:
I20260619 19:54:20.656091 1973 rpcz_store.cc:276] 0619 19:54:18.690042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.690153 (+ 111us) service_pool.cc:224] Handling call
0619 19:54:20.456422 (+1766269us) ts_tablet_manager.cc:1151] Deleting tablet 774938222588473e90c513232c82aece
0619 19:54:20.456430 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.491223 (+ 34793us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.609976 (+118753us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.655929 (+ 45953us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1765964}
I20260619 19:54:20.656610 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 783) took 1962 ms. Trace:
I20260619 19:54:20.656752 1973 rpcz_store.cc:276] 0619 19:54:18.694327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.694381 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:20.656486 (+1962105us) ts_tablet_manager.cc:1151] Deleting tablet d88ba4ee21f84d869cd33c9f6896efdf
0619 19:54:20.656497 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.656594 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1961890}
I20260619 19:54:20.657196 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 781) took 1967 ms. Trace:
I20260619 19:54:20.657322 1973 rpcz_store.cc:276] 0619 19:54:18.689915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.713721 (+ 23806us) service_pool.cc:224] Handling call
0619 19:54:20.657107 (+1943386us) ts_tablet_manager.cc:1151] Deleting tablet 4b88dd7d19514e83857e2c6108291b9f
0619 19:54:20.657117 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.657178 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1943185}
I20260619 19:54:20.657697 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 788) took 1899 ms. Trace:
I20260619 19:54:20.657828 1973 rpcz_store.cc:276] 0619 19:54:18.757902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.788313 (+ 30411us) service_pool.cc:224] Handling call
0619 19:54:20.657597 (+1869284us) ts_tablet_manager.cc:1151] Deleting tablet 5fcc9a948562461092da5bb781854652
0619 19:54:20.657606 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.657683 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1869017}
I20260619 19:54:20.658176 1973 tablet_replica.cc:333] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.658424 1973 raft_consensus.cc:2243] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.658674 1973 raft_consensus.cc:2272] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.660892 888 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcc4a4d70a14f95952af1405296aee7 (DEFAULT_TABLE table=default.Table_2cfcddad05dd4568a710cb6fd4a38935 [id=3716dfa4af7d4afb8ac29a039ee38f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.662251 750 tablet_service.cc:1511] Processing CreateTablet for tablet cfee1e663cb34faea908461bdb0d02a9 (DEFAULT_TABLE table=default.Table_b900de7a833f4bef95b679661a5b879c [id=11b4fe9448d54df9b858b6bd123d8965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.662307 764 tablet_service.cc:1511] Processing CreateTablet for tablet 39113dd369bb4fd6a7172b6879365900 (DEFAULT_TABLE table=default.Table_db402dcea7cd491e9df3af4494176e2c [id=c451a861ffbf4c9fb2ade54af009c1a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.662503 755 tablet_service.cc:1511] Processing CreateTablet for tablet 550e1e33fc384884aa60e1452a19e13b (DEFAULT_TABLE table=default.Table_1c6851ff802d47eabe403f442af83038 [id=79cbdebda2e34ef580b5915d1b015912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.662693 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfee1e663cb34faea908461bdb0d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.662653 749 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3c38ab28684ad1be2414a9200ef7fd (DEFAULT_TABLE table=default.Table_12e89619bc914902b7f38712ecd70ba3 [id=cc7a9623a4414bef8d6d20a3248d5a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.663015 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca9b32b723442ca984900317b442a66 (DEFAULT_TABLE table=default.Table_9b2db7fc24bd4e6b89758838f60b0ac5 [id=e1c1a0e389584dd2b2cf5d0e37ba6b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.663404 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550e1e33fc384884aa60e1452a19e13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.665711 1208 tablet_bootstrap.cc:654] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:20.667429 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3c38ab28684ad1be2414a9200ef7fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:20.672700 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 9b08ab9ad59049919649b96890b6785d because the tablet was not found. No further retry: Not found: Tablet not found: 9b08ab9ad59049919649b96890b6785d
W20260619 19:54:20.673017 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 906212dd25ef46f2b381ce6a99c39343 because the tablet was not found. No further retry: Not found: Tablet not found: 906212dd25ef46f2b381ce6a99c39343
I20260619 19:54:20.674044 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca9b32b723442ca984900317b442a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.680526 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39113dd369bb4fd6a7172b6879365900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.684213 765 tablet_service.cc:1511] Processing CreateTablet for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 (DEFAULT_TABLE table=default.Table_021d1b5629484a168dc9dbf0e2bfa23d [id=4bd829ddaa0448619c28210b8a6c4e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.684369 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0a658add5c45508b320516014a2c61 (DEFAULT_TABLE table=default.Table_22d566a824b24778b6d902f8c33aac85 [id=632ffa431fcb4788a0e688dd6649f4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.684845 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.684803 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1ca289620849729353a9072c75b93d (DEFAULT_TABLE table=default.Table_d5682c9323624c1aa06d0babb65a1393 [id=a9076efba1f34eb9b03d3824c018ea04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.685163 748 tablet_service.cc:1511] Processing CreateTablet for tablet e2bd4e6a61da443192a1e8b0acf34eb8 (DEFAULT_TABLE table=default.Table_0f37a2b643f545a599d3bea1d614a0d4 [id=fe6ad661316f4fb98139d43f04800b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.685509 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcc4a4d70a14f95952af1405296aee7 (DEFAULT_TABLE table=default.Table_2cfcddad05dd4568a710cb6fd4a38935 [id=3716dfa4af7d4afb8ac29a039ee38f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.687517 754 tablet_service.cc:1511] Processing CreateTablet for tablet 3de788fe38794980a3b72264e038f8b3 (DEFAULT_TABLE table=default.Table_72cf4d7f1df6437590fc200e5936fa21 [id=51c7c5bc74a4428b85bac8ea15aab27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.688283 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1ca289620849729353a9072c75b93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.688840 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2bd4e6a61da443192a1e8b0acf34eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.690423 1973 ts_tablet_manager.cc:1916] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.691543 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3de788fe38794980a3b72264e038f8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.701406 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0a658add5c45508b320516014a2c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.703213 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 736aa49b4d984295a9aefb135b005e07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.705405 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e393cb60e992410aba1eb02e3ddcf790"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.706044 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e393cb60e992410aba1eb02e3ddcf790 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.709283 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 774938222588473e90c513232c82aece (table default.Table_acb740f517fd4c61bff72f7ceafb5f75 [id=7f73d9f5b89c4d5798cb7f9d95595c8f]) successfully deleted
W20260619 19:54:20.711100 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d88ba4ee21f84d869cd33c9f6896efdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d88ba4ee21f84d869cd33c9f6896efdf already in progress: creating tablet
W20260619 19:54:20.712216 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 4b88dd7d19514e83857e2c6108291b9f because the tablet was not found. No further retry: Not found: Tablet not found: 4b88dd7d19514e83857e2c6108291b9f
W20260619 19:54:20.713321 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 5fcc9a948562461092da5bb781854652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fcc9a948562461092da5bb781854652 already in progress: creating tablet
I20260619 19:54:20.713591 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6df1e1c1b7784e2e8cbde58c6ae86f79
I20260619 19:54:20.716831 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:20.718117 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 already in progress: creating tablet
I20260619 19:54:20.720386 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc884e4c304309a326b21a3c059fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.720386 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.721967 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcc4a4d70a14f95952af1405296aee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.730336 750 tablet_service.cc:1511] Processing CreateTablet for tablet a302b58582164855b7ef7b1d7e7d90f2 (DEFAULT_TABLE table=default.Table_be35c2633c92422e8ba617ebeac078e8 [id=c6cfc20a1e7c495090f002206ae852af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.731022 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a302b58582164855b7ef7b1d7e7d90f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.736418 759 tablet_service.cc:1511] Processing CreateTablet for tablet 72bb0361a04c4b469a7bdf3eb6157707 (DEFAULT_TABLE table=default.Table_66674465fc2640b383f68327c9e1d710 [id=1d9cae00e2c24b7495a8c9146e22a51b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.739267 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bb0361a04c4b469a7bdf3eb6157707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.739388 899 tablet_service.cc:1511] Processing CreateTablet for tablet 39113dd369bb4fd6a7172b6879365900 (DEFAULT_TABLE table=default.Table_db402dcea7cd491e9df3af4494176e2c [id=c451a861ffbf4c9fb2ade54af009c1a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.739599 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b90a8481044b44ae91ce27949f54c338 (DEFAULT_TABLE table=default.Table_23ed9bfc10694076b2162ad7e9d92712 [id=93a21931eb54440ea821a1c732a342f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.739970 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90a8481044b44ae91ce27949f54c338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.739924 915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6532bdfd3c844ff2a25bee6ff1e0c25e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:20.744359 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4d2e5dfabbe24fa99291eec7549a23a8" } new_table_name: "default.Table_e2644afe20f34578b1ed720f4052965b" modify_external_catalogs: true
I20260619 19:54:20.747705 1208 tablet_bootstrap.cc:492] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:20.747929 1208 ts_tablet_manager.cc:1403] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.121s user 0.014s sys 0.005s
W20260619 19:54:20.750277 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 198c9f7a044c4a62b178a32e562f7168 (table default.Table_13d32b679a454a75bea633c92bc0a154 [id=c44fdc0b0cb7416eb9c47a3f314f3f1b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 198c9f7a044c4a62b178a32e562f7168 consensus state has no leader
I20260619 19:54:20.755048 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3c38ab28684ad1be2414a9200ef7fd (DEFAULT_TABLE table=default.Table_12e89619bc914902b7f38712ecd70ba3 [id=cc7a9623a4414bef8d6d20a3248d5a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.755704 898 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca9b32b723442ca984900317b442a66 (DEFAULT_TABLE table=default.Table_9b2db7fc24bd4e6b89758838f60b0ac5 [id=e1c1a0e389584dd2b2cf5d0e37ba6b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.756160 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 (DEFAULT_TABLE table=default.Table_021d1b5629484a168dc9dbf0e2bfa23d [id=4bd829ddaa0448619c28210b8a6c4e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.756660 894 tablet_service.cc:1511] Processing CreateTablet for tablet 7c1ca289620849729353a9072c75b93d (DEFAULT_TABLE table=default.Table_d5682c9323624c1aa06d0babb65a1393 [id=a9076efba1f34eb9b03d3824c018ea04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.757078 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0a658add5c45508b320516014a2c61 (DEFAULT_TABLE table=default.Table_22d566a824b24778b6d902f8c33aac85 [id=632ffa431fcb4788a0e688dd6649f4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.757398 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 736aa49b4d984295a9aefb135b005e07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.757573 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bc884e4c304309a326b21a3c059fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.759392 3229 consensus_queue.cc:1048] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.767217 890 tablet_service.cc:1511] Processing CreateTablet for tablet fae918a430a54550aea9e32250a32fb7 (DEFAULT_TABLE table=default.Table_99ad2921377b43608418af63d31c135f [id=003e0ab14c2a480da239a870ff4a2421]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:20.767665 858 consensus_peers.cc:597] T b2902c7f67a1402987315ee426ddf1d2 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2902c7f67a1402987315ee426ddf1d2. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:20.769464 3274 raft_consensus.cc:493] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.770817 915 raft_consensus.cc:2468] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:20.771582 1208 raft_consensus.cc:359] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.771934 1208 raft_consensus.cc:385] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.772060 1208 raft_consensus.cc:740] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.773222 3265 tablet.cc:1724] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:20.773816 3229 consensus_queue.cc:1048] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.775389 1208 consensus_queue.cc:260] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.776692 1208 ts_tablet_manager.cc:1434] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260619 19:54:20.784044 1973 ts_tablet_manager.cc:1929] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:20.784274 1973 log.cc:1199] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d703c5c2820642aab6dd1e500ce1e9fd
I20260619 19:54:20.784893 1973 ts_tablet_manager.cc:1950] T d703c5c2820642aab6dd1e500ce1e9fd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.785707 1208 tablet_bootstrap.cc:492] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:20.787213 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39113dd369bb4fd6a7172b6879365900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.790110 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.790407 902 tablet_service.cc:1511] Processing CreateTablet for tablet 550e1e33fc384884aa60e1452a19e13b (DEFAULT_TABLE table=default.Table_1c6851ff802d47eabe403f442af83038 [id=79cbdebda2e34ef580b5915d1b015912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.792222 996 leader_election.cc:304] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.792739 3292 raft_consensus.cc:2804] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:20.792821 3292 raft_consensus.cc:493] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:20.792881 3292 raft_consensus.cc:3060] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.800108 527 catalog_manager.cc:5696] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:20.800854 527 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
W20260619 19:54:20.801780 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb26af8ab52d470f8bd1b7c42a57e8a3 consensus state has no leader
I20260619 19:54:20.804253 901 tablet_service.cc:1511] Processing CreateTablet for tablet cfee1e663cb34faea908461bdb0d02a9 (DEFAULT_TABLE table=default.Table_b900de7a833f4bef95b679661a5b879c [id=11b4fe9448d54df9b858b6bd123d8965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.804335 3274 raft_consensus.cc:515] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.805094 900 tablet_service.cc:1511] Processing CreateTablet for tablet 3de788fe38794980a3b72264e038f8b3 (DEFAULT_TABLE table=default.Table_72cf4d7f1df6437590fc200e5936fa21 [id=51c7c5bc74a4428b85bac8ea15aab27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.807569 897 tablet_service.cc:1511] Processing CreateTablet for tablet e2bd4e6a61da443192a1e8b0acf34eb8 (DEFAULT_TABLE table=default.Table_0f37a2b643f545a599d3bea1d614a0d4 [id=fe6ad661316f4fb98139d43f04800b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.807718 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 80c5d0b279844831a9151898c54a30d0 (DEFAULT_TABLE table=default.Table_e28e5a1d6ce54aa0a21e4b6de743783a [id=c0bf41177f3e4ead97fa501ab91a13e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.808214 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c5d0b279844831a9151898c54a30d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.808177 903 tablet_service.cc:1511] Processing CreateTablet for tablet a302b58582164855b7ef7b1d7e7d90f2 (DEFAULT_TABLE table=default.Table_be35c2633c92422e8ba617ebeac078e8 [id=c6cfc20a1e7c495090f002206ae852af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.808754 3313 tablet.cc:1724] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:20.809990 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 1129a59f42d64637bab6e060b118c9ef (DEFAULT_TABLE table=default.Table_0ba255fd81f741d989e015a9cbe3310d [id=2fee2e6ec65e4177a2c227045a063c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.810187 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae918a430a54550aea9e32250a32fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.810350 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1129a59f42d64637bab6e060b118c9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.810834 887 tablet_service.cc:1511] Processing CreateTablet for tablet 72bb0361a04c4b469a7bdf3eb6157707 (DEFAULT_TABLE table=default.Table_66674465fc2640b383f68327c9e1d710 [id=1d9cae00e2c24b7495a8c9146e22a51b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:20.811246 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 141714us
I20260619 19:54:20.817528 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:20.817934 720 consensus_peers.cc:597] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5ddb8412ad145dd85916bf5d756a9f0. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:20.823590 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_12f3f767257c4504872f40fad9b28d1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.824190 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12f3f767257c4504872f40fad9b28d1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.829259 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 7d5375b8c78544de92c47cb56a9b8c25
I20260619 19:54:20.830878 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.831667 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d5375b8c78544de92c47cb56a9b8c25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:20.833521 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7d5375b8c78544de92c47cb56a9b8c25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d5375b8c78544de92c47cb56a9b8c25 already in progress: creating tablet
I20260619 19:54:20.837932 3293 raft_consensus.cc:493] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:20.838151 3293 raft_consensus.cc:515] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.838776 752 tablet_service.cc:1511] Processing CreateTablet for tablet b90a8481044b44ae91ce27949f54c338 (DEFAULT_TABLE table=default.Table_23ed9bfc10694076b2162ad7e9d92712 [id=93a21931eb54440ea821a1c732a342f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.838941 3293 leader_election.cc:290] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.839346 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90a8481044b44ae91ce27949f54c338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.834357 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d5375b8c78544de92c47cb56a9b8c25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:20.841137 748 tablet_service.cc:1511] Processing CreateTablet for tablet 80c5d0b279844831a9151898c54a30d0 (DEFAULT_TABLE table=default.Table_e28e5a1d6ce54aa0a21e4b6de743783a [id=c0bf41177f3e4ead97fa501ab91a13e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.841598 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae6164970ec4977a8c0c9fd24ab7275" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:20.843357 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2bd4e6a61da443192a1e8b0acf34eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.846719 3274 leader_election.cc:290] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:20.847225 996 leader_election.cc:343] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.851080 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c5d0b279844831a9151898c54a30d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.851621 3292 raft_consensus.cc:515] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.852360 3292 leader_election.cc:290] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:20.853226 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6532bdfd3c844ff2a25bee6ff1e0c25e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:20.854229 996 leader_election.cc:343] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.860383 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 791) took 1957 ms. Trace:
I20260619 19:54:20.861627 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7ff7d147fd6241d4881e6f30c1d38db5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.862251 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ff7d147fd6241d4881e6f30c1d38db5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.862576 3273 consensus_queue.cc:1048] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.864326 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfee1e663cb34faea908461bdb0d02a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.864547 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcc4a4d70a14f95952af1405296aee7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:20.865034 858 leader_election.cc:343] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.866751 1208 tablet_bootstrap.cc:654] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:20.866855 859 leader_election.cc:343] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.860575 1973 rpcz_store.cc:276] 0619 19:54:18.903201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.903261 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:20.658110 (+1754849us) ts_tablet_manager.cc:1151] Deleting tablet d703c5c2820642aab6dd1e500ce1e9fd
0619 19:54:20.658118 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.774085 (+115967us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.783930 (+ 9845us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.860358 (+ 76428us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1754644}
I20260619 19:54:20.873109 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 789) took 1970 ms. Trace:
I20260619 19:54:20.873329 1973 rpcz_store.cc:276] 0619 19:54:18.902701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.909257 (+ 6556us) service_pool.cc:224] Handling call
0619 19:54:20.872935 (+1963678us) ts_tablet_manager.cc:1151] Deleting tablet d0a9c96d9c034a4a8a4d05d8518ebcec
0619 19:54:20.872950 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.873057 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1963328}
I20260619 19:54:20.873823 1973 tablet_replica.cc:333] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.874147 1973 raft_consensus.cc:2243] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.875041 532 master_service.cc:960] ReplaceTablet: received request to replace tablet e4b2802ecd504e0a8b743e432bfc3fab from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:20.875418 1973 raft_consensus.cc:2272] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.878852 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d703c5c2820642aab6dd1e500ce1e9fd (table default.Table_7babf9e56d174c6abc66c591fff1eace [id=3000203e95cc423cb4ab88f7c33f76c8]) successfully deleted
W20260619 19:54:20.879282 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d0a9c96d9c034a4a8a4d05d8518ebcec because the tablet was not found. No further retry: Not found: Tablet not found: d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:54:20.883312 530 master_service.cc:960] ReplaceTablet: received request to replace tablet 79e86e744f254b7fbca1adfe43e3ade5 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:20.885921 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 31fa7a29b2c74e3caf2b4720eb53aec4 (DEFAULT_TABLE table=default.Table_54f50363519947bd8439607d2803a350 [id=c957ea1260b846b8b21e645185838093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.886380 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fa7a29b2c74e3caf2b4720eb53aec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.887831 1973 ts_tablet_manager.cc:1916] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.892292 2026 ts_tablet_manager.cc:1929] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:20.892493 2026 log.cc:1199] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/4b22024a0c434f8e8d4a370dbfb9a4e2
I20260619 19:54:20.894730 1200 tablet_bootstrap.cc:492] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:20.894898 1200 ts_tablet_manager.cc:1403] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.272s user 0.081s sys 0.103s
I20260619 19:54:20.895841 1200 raft_consensus.cc:359] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.896046 1200 raft_consensus.cc:385] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:20.896109 1200 raft_consensus.cc:740] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:20.896322 1200 consensus_queue.cc:260] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.897010 1200 ts_tablet_manager.cc:1434] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 19:54:20.897074 3123 consensus_queue.cc:1048] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.897291 1200 tablet_bootstrap.cc:492] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:20.899292 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1129a59f42d64637bab6e060b118c9ef (DEFAULT_TABLE table=default.Table_0ba255fd81f741d989e015a9cbe3310d [id=2fee2e6ec65e4177a2c227045a063c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.899698 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1129a59f42d64637bab6e060b118c9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.901180 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_89cd88f2d88d4d80922912884ea10e91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:20.901737 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89cd88f2d88d4d80922912884ea10e91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.908957 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 34f19f5ac03446a89376695b8321e820
I20260619 19:54:20.910156 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 34f19f5ac03446a89376695b8321e820 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:20.910440 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 34f19f5ac03446a89376695b8321e820 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:20.910897 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 34f19f5ac03446a89376695b8321e820 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34f19f5ac03446a89376695b8321e820 already in progress: creating tablet
I20260619 19:54:20.913414 750 tablet_service.cc:1511] Processing CreateTablet for tablet 31fa7a29b2c74e3caf2b4720eb53aec4 (DEFAULT_TABLE table=default.Table_54f50363519947bd8439607d2803a350 [id=c957ea1260b846b8b21e645185838093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.913581 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_15292b79d02e4cc393e24ec7842d26d2" } new_table_name: "default.Table_3bcff65c81e44138ab875b91fd9f83bf" modify_external_catalogs: true
I20260619 19:54:20.914011 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fa7a29b2c74e3caf2b4720eb53aec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.918182 748 tablet_service.cc:1511] Processing CreateTablet for tablet 913054325d034ccfaed32234a19a5c13 (DEFAULT_TABLE table=default.Table_01335e4fae1a405488b2bb5fd6d71576 [id=a9a8a947a7e14725b35abb6abca3bead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.918452 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 913054325d034ccfaed32234a19a5c13 (DEFAULT_TABLE table=default.Table_01335e4fae1a405488b2bb5fd6d71576 [id=a9a8a947a7e14725b35abb6abca3bead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.918740 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913054325d034ccfaed32234a19a5c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.920919 1973 ts_tablet_manager.cc:1929] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:20.923473 1973 log.cc:1199] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f658e85be0c843f2b02e4567a80521c4
I20260619 19:54:20.923080 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913054325d034ccfaed32234a19a5c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.923904 1973 ts_tablet_manager.cc:1950] T f658e85be0c843f2b02e4567a80521c4 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.924237 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 790) took 2021 ms. Trace:
I20260619 19:54:20.924320 1973 rpcz_store.cc:276] 0619 19:54:18.903028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.923434 (+ 20406us) service_pool.cc:224] Handling call
0619 19:54:20.873760 (+1950326us) ts_tablet_manager.cc:1151] Deleting tablet f658e85be0c843f2b02e4567a80521c4
0619 19:54:20.873772 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.904728 (+ 30956us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.920861 (+ 16133us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.924220 (+ 3359us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1949825}
I20260619 19:54:20.924773 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f658e85be0c843f2b02e4567a80521c4 (table default.Table_b79ac240d4f14940b5676186655549bc [id=303a823bc9844cc28a07eb1f14617bc8]) successfully deleted
I20260619 19:54:20.925983 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a0720c15c0bb41ae86490f1009c0f32c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:20.926573 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 793) took 1965 ms. Trace:
W20260619 19:54:20.926668 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0720c15c0bb41ae86490f1009c0f32c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:20.927522 1973 rpcz_store.cc:276] 0619 19:54:18.960944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.963264 (+ 2320us) service_pool.cc:224] Handling call
0619 19:54:20.926108 (+1962844us) ts_tablet_manager.cc:1151] Deleting tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6
0619 19:54:20.926118 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.926552 (+ 434us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1962661}
W20260619 19:54:20.928450 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7f5dd469f7d4c32b7f5f9f84dee3fb6 already in progress: creating tablet
I20260619 19:54:20.933257 1973 tablet_replica.cc:333] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:20.934031 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6f37e153b53c471da1f304ae1ada0b2d (DEFAULT_TABLE table=default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.934448 1973 raft_consensus.cc:2243] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:20.934715 1973 raft_consensus.cc:2272] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:20.935456 1973 ts_tablet_manager.cc:1916] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:20.935791 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f37e153b53c471da1f304ae1ada0b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.948786 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6532bdfd3c844ff2a25bee6ff1e0c25e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:20.948988 917 raft_consensus.cc:3060] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:20.949874 2953 raft_consensus.cc:493] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:20.950006 2953 raft_consensus.cc:515] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:20.951947 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6f37e153b53c471da1f304ae1ada0b2d (DEFAULT_TABLE table=default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.953299 918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae6164970ec4977a8c0c9fd24ab7275" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:20.955806 858 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:20.956188 1201 tablet_bootstrap.cc:492] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:20.956414 1201 ts_tablet_manager.cc:1403] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.415s user 0.015s sys 0.048s
I20260619 19:54:20.956596 2953 leader_election.cc:290] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:20.956794 2953 consensus_queue.cc:1048] T 9c663c06d10e43958ab42dacc11cb486 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.958179 859 leader_election.cc:304] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:20.958535 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 96443.8us
I20260619 19:54:20.958554 917 raft_consensus.cc:2468] T 6532bdfd3c844ff2a25bee6ff1e0c25e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:20.959023 2953 raft_consensus.cc:2749] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:20.959766 996 leader_election.cc:343] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:20.959901 996 leader_election.cc:304] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.960285 3292 raft_consensus.cc:2749] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:20.961931 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a302b58582164855b7ef7b1d7e7d90f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.967412 893 tablet_service.cc:1511] Processing CreateTablet for tablet 80c5d0b279844831a9151898c54a30d0 (DEFAULT_TABLE table=default.Table_e28e5a1d6ce54aa0a21e4b6de743783a [id=c0bf41177f3e4ead97fa501ab91a13e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.968043 884 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d5375b8c78544de92c47cb56a9b8c25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:20.969352 996 leader_election.cc:304] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:20.969798 3292 raft_consensus.cc:2804] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:20.969910 3292 raft_consensus.cc:697] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:20.970162 3292 consensus_queue.cc:237] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:20.971365 3248 consensus_queue.cc:1048] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:20.976334 1973 ts_tablet_manager.cc:1929] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:20.977509 1973 log.cc:1199] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/f8e48a3e5c1642f6b12adb0033f74404
I20260619 19:54:20.978098 1973 ts_tablet_manager.cc:1950] T f8e48a3e5c1642f6b12adb0033f74404 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:20.979373 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 792) took 2018 ms. Trace:
I20260619 19:54:20.980132 1973 rpcz_store.cc:276] 0619 19:54:18.960772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:18.976203 (+ 15431us) service_pool.cc:224] Handling call
0619 19:54:20.928064 (+1951861us) ts_tablet_manager.cc:1151] Deleting tablet f8e48a3e5c1642f6b12adb0033f74404
0619 19:54:20.933189 (+ 5125us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.955626 (+ 22437us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.976250 (+ 20624us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.979350 (+ 3100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1951633}
W20260619 19:54:20.980512 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e7b94596b0246628b963524983bb226 consensus state has no leader
I20260619 19:54:20.981307 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet f8e48a3e5c1642f6b12adb0033f74404 (table default.Table_194296d408ce42ee8dfb04120cc3af1c [id=55b6b9eae3ed41a487ea1b9468cd518f]) successfully deleted
I20260619 19:54:20.982283 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9c97c6559f804b4eb92351eb88ee1e38" } new_table_name: "default.Table_60f3438e5af64e6aa071cd20c0a810d4" modify_external_catalogs: true
I20260619 19:54:20.983728 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 794) took 1958 ms. Trace:
I20260619 19:54:20.985132 885 tablet_service.cc:1511] Processing CreateTablet for tablet b90a8481044b44ae91ce27949f54c338 (DEFAULT_TABLE table=default.Table_23ed9bfc10694076b2162ad7e9d92712 [id=93a21931eb54440ea821a1c732a342f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:20.985731 1973 rpcz_store.cc:276] 0619 19:54:19.025661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.087083 (+ 61422us) service_pool.cc:224] Handling call
0619 19:54:20.983411 (+1896328us) ts_tablet_manager.cc:1151] Deleting tablet cffd890a5f594a4b91cb2f5c3235fcad
0619 19:54:20.983428 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.983610 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1895946}
W20260619 19:54:20.986913 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet cffd890a5f594a4b91cb2f5c3235fcad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cffd890a5f594a4b91cb2f5c3235fcad already in progress: creating tablet
I20260619 19:54:20.987578 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 795) took 1896 ms. Trace:
I20260619 19:54:20.988003 887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bb0361a04c4b469a7bdf3eb6157707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.988073 1973 rpcz_store.cc:276] 0619 19:54:19.091010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.091844 (+ 834us) service_pool.cc:224] Handling call
0619 19:54:20.987419 (+1895575us) ts_tablet_manager.cc:1151] Deleting tablet 7afe86e5d9c341cbadc821203e603af6
0619 19:54:20.987434 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.987557 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1895375}
I20260619 19:54:20.988361 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90a8481044b44ae91ce27949f54c338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.991142 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ca61a86710004d7fae9d4b012ed71ba1 (DEFAULT_TABLE table=default.Table_6b0e7c1abd8f4f6680e74faf06b14ea0 [id=2016360b9f5d40fab490a83cdd526ad9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:20.991963 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7afe86e5d9c341cbadc821203e603af6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7afe86e5d9c341cbadc821203e603af6 already in progress: creating tablet
I20260619 19:54:20.992535 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 807) took 1365 ms. Trace:
I20260619 19:54:20.992942 1973 rpcz_store.cc:276] 0619 19:54:19.627362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.627419 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:20.992412 (+1364993us) ts_tablet_manager.cc:1151] Deleting tablet 2090db1e6d5646bbbef77ab6776fe3d2
0619 19:54:20.992424 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.992517 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364811}
W20260619 19:54:20.994084 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2090db1e6d5646bbbef77ab6776fe3d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2090db1e6d5646bbbef77ab6776fe3d2 already in progress: creating tablet
I20260619 19:54:20.994596 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 808) took 1366 ms. Trace:
I20260619 19:54:20.995082 1973 rpcz_store.cc:276] 0619 19:54:19.627726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.627771 (+ 45us) service_pool.cc:224] Handling call
0619 19:54:20.994446 (+1366675us) ts_tablet_manager.cc:1151] Deleting tablet 0a2911b5cfd2494287432e818d4ae19e
0619 19:54:20.994461 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.994574 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1366538}
I20260619 19:54:20.995461 755 tablet_service.cc:1511] Processing CreateTablet for tablet ca61a86710004d7fae9d4b012ed71ba1 (DEFAULT_TABLE table=default.Table_6b0e7c1abd8f4f6680e74faf06b14ea0 [id=2016360b9f5d40fab490a83cdd526ad9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:20.996003 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 0a2911b5cfd2494287432e818d4ae19e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a2911b5cfd2494287432e818d4ae19e already in progress: creating tablet
I20260619 19:54:20.996440 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca61a86710004d7fae9d4b012ed71ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:20.996470 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 812) took 1323 ms. Trace:
I20260619 19:54:20.997083 1973 rpcz_store.cc:276] 0619 19:54:19.673158 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.677146 (+ 3988us) service_pool.cc:224] Handling call
0619 19:54:20.996366 (+1319220us) ts_tablet_manager.cc:1151] Deleting tablet a444ebd84bb340b1b1c0d695d8157d8a
0619 19:54:20.996373 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.996455 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1318927}
W20260619 19:54:20.997746 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a444ebd84bb340b1b1c0d695d8157d8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a444ebd84bb340b1b1c0d695d8157d8a already in progress: creating tablet
I20260619 19:54:20.998180 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 811) took 1325 ms. Trace:
I20260619 19:54:20.998539 1973 rpcz_store.cc:276] 0619 19:54:19.673060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.702226 (+ 29166us) service_pool.cc:224] Handling call
0619 19:54:20.998075 (+1295849us) ts_tablet_manager.cc:1151] Deleting tablet ddfe76640e5641fdb02ef53fddd8df2a
0619 19:54:20.998084 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.998163 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1293167}
W20260619 19:54:20.999221 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ddfe76640e5641fdb02ef53fddd8df2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddfe76640e5641fdb02ef53fddd8df2a already in progress: creating tablet
I20260619 19:54:20.999799 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 810) took 1326 ms. Trace:
I20260619 19:54:21.000275 1973 rpcz_store.cc:276] 0619 19:54:19.672940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.715772 (+ 42832us) service_pool.cc:224] Handling call
0619 19:54:20.999657 (+1283885us) ts_tablet_manager.cc:1151] Deleting tablet c791c14822324686bb4f4f31a87b7183
0619 19:54:20.999671 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.999777 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1283208}
I20260619 19:54:21.000738 3302 raft_consensus.cc:493] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.000905 3302 raft_consensus.cc:515] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:21.001135 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet c791c14822324686bb4f4f31a87b7183 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c791c14822324686bb4f4f31a87b7183 already in progress: creating tablet
I20260619 19:54:21.001497 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 809) took 1373 ms. Trace:
I20260619 19:54:21.001612 3302 leader_election.cc:290] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.001566 1973 rpcz_store.cc:276] 0619 19:54:19.628009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.628062 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:21.001393 (+1373331us) ts_tablet_manager.cc:1151] Deleting tablet b1bb4e51cce643fab695507af03800af
0619 19:54:21.001403 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.001480 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1113451}
I20260619 19:54:21.002144 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.002297 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b1bb4e51cce643fab695507af03800af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1bb4e51cce643fab695507af03800af already in progress: creating tablet
W20260619 19:54:21.002771 996 leader_election.cc:343] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:21.004163 858 consensus_peers.cc:597] T 297f07f2d08d47dfa69f845dadb973b1 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 297f07f2d08d47dfa69f845dadb973b1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.004567 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 816) took 1106 ms. Trace:
I20260619 19:54:21.005004 1973 rpcz_store.cc:276] 0619 19:54:19.898197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.898257 (+ 60us) service_pool.cc:224] Handling call
0619 19:54:21.004456 (+1106199us) ts_tablet_manager.cc:1151] Deleting tablet 801f08f4daa842238460506ccd0c466f
0619 19:54:21.004470 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.004545 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1105989}
W20260619 19:54:21.005774 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 801f08f4daa842238460506ccd0c466f because the tablet was not found. No further retry: Not found: Tablet not found: 801f08f4daa842238460506ccd0c466f
I20260619 19:54:21.006189 1973 tablet_replica.cc:333] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.006536 1973 raft_consensus.cc:2243] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:21.007827 1973 pending_rounds.cc:70] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:21.009402 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:21.009629 1973 pending_rounds.cc:77] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657730381635584 op_type: NO_OP noop_request { }
I20260619 19:54:21.009940 1973 raft_consensus.cc:2889] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:21.009974 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5eb4005068684928b3b27ff73b108d1b (table default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566]). Expected version 1 got 0
I20260619 19:54:21.010257 1973 raft_consensus.cc:2272] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.010381 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 2 got 0
I20260619 19:54:21.010777 523 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:21.011513 1973 ts_tablet_manager.cc:1916] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.012156 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 8614b0ab1a3749a1a0aa441574f79ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.012722 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:21.012991 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_7613312118cf43c7bddda4983d308290 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 2 got 0
I20260619 19:54:21.013366 755 tablet_service.cc:1558] Processing DeleteTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff01c0de8a540d0a024a4924199ba54) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.013422 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5eb4005068684928b3b27ff73b108d1b (table default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566]). Expected version 1 got 0
I20260619 19:54:21.013685 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet fb26af8ab52d470f8bd1b7c42a57e8a3 (table default.Table_d22feccee94b4285b81dc207e65f5c50 [id=42dc873fe9774544ac2c64a38265e4aa]). Expected version 1 got 0
I20260619 19:54:21.014137 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]). Expected version 3 got 0
I20260619 19:54:21.014608 525 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet deba56eb121e4aa6b8ad7b13951723aa (table default.Table_eaefb5c915d34ab79e4f47c839fd0ade [id=2738114efd1f43d4a7f797f9b12f7398]). Expected version 2 got 0
I20260619 19:54:21.014853 525 catalog_manager.cc:5696] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129). New cstate: current_term: 1 leader_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
W20260619 19:54:21.015758 527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.129:34229 (request call id 226) took 905 ms (client timeout 1000 ms). Trace:
W20260619 19:54:21.015862 527 rpcz_store.cc:269] 0619 19:54:20.109855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:20.171259 (+ 61404us) service_pool.cc:224] Handling call
0619 19:54:21.015688 (+844429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:20.991047 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:20.991721 (+ 674us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:20.991727 (+ 6us) write_op.cc:435] Acquired schema lock
0619 19:54:20.991837 (+ 110us) tablet.cc:662] Decoding operations
0619 19:54:20.992656 (+ 819us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:20.992842 (+ 186us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:20.992849 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:20.993897 (+ 1048us) tablet.cc:701] Row locks acquired
0619 19:54:20.993902 (+ 5us) write_op.cc:260] PREPARE: finished
0619 19:54:20.994119 (+ 217us) write_op.cc:270] Start()
0619 19:54:20.994332 (+ 213us) write_op.cc:276] Timestamp: P: 1781898860994073 usec, L: 0
0619 19:54:20.994533 (+ 201us) op_driver.cc:348] REPLICATION: starting
0619 19:54:20.996503 (+ 1970us) log.cc:844] Serialized 533 byte log entry
0619 19:54:21.004755 (+ 8252us) op_driver.cc:464] REPLICATION: finished
0619 19:54:21.004861 (+ 106us) write_op.cc:301] APPLY: starting
0619 19:54:21.004882 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:21.004938 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:21.004969 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:21.005038 (+ 69us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:21.005083 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:21.005094 (+ 11us) write_op.cc:312] APPLY: finished
0619 19:54:21.005207 (+ 113us) log.cc:844] Serialized 23 byte log entry
0619 19:54:21.005277 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:21.005302 (+ 25us) write_op.cc:454] Released schema lock
0619 19:54:21.005312 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2330,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":41,"apply.run_cpu_time_us":523,"apply.run_wall_time_us":523,"num_ops":1,"prepare.queue_time_us":188869,"prepare.run_cpu_time_us":1215,"prepare.run_wall_time_us":11188,"raft.queue_time_us":107,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":906,"replication_time_us":10179}]]}
I20260619 19:54:21.017056 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dd9b3658130141a483de115227dfaf0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.017658 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd9b3658130141a483de115227dfaf0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.017956 1039 tablet_service.cc:1511] Processing CreateTablet for tablet b61f9b7b347d4bea80184ac1cd6a5b66 (DEFAULT_TABLE table=default.Table_8596f5d31bc14fe7bc5a232cacd51819 [id=01610fa98af74ba79ea6e002add616d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.024473 2026 ts_tablet_manager.cc:1950] T 4b22024a0c434f8e8d4a370dbfb9a4e2 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:21.026072 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 353) took 14363 ms. Trace:
I20260619 19:54:21.026373 2026 rpcz_store.cc:276] 0619 19:54:06.662266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.662312 (+ 46us) service_pool.cc:224] Handling call
0619 19:54:20.524432 (+13862120us) ts_tablet_manager.cc:1151] Deleting tablet 4b22024a0c434f8e8d4a370dbfb9a4e2
0619 19:54:20.524447 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:20.550994 (+ 26547us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:20.583101 (+ 32107us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.026023 (+442922us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13861943}
I20260619 19:54:21.027338 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.027603 917 raft_consensus.cc:2468] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:21.027777 755 tablet_service.cc:1511] Processing CreateTablet for tablet b61f9b7b347d4bea80184ac1cd6a5b66 (DEFAULT_TABLE table=default.Table_8596f5d31bc14fe7bc5a232cacd51819 [id=01610fa98af74ba79ea6e002add616d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.028177 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61f9b7b347d4bea80184ac1cd6a5b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.028076 1201 raft_consensus.cc:359] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.028263 1201 raft_consensus.cc:385] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.028324 1201 raft_consensus.cc:740] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.028540 1201 consensus_queue.cc:260] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.029160 1201 ts_tablet_manager.cc:1434] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.073s user 0.001s sys 0.001s
I20260619 19:54:21.029480 1201 tablet_bootstrap.cc:492] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:21.035173 1973 ts_tablet_manager.cc:1929] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.037261 1973 log.cc:1199] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d5ddb8412ad145dd85916bf5d756a9f0
I20260619 19:54:21.039268 1973 ts_tablet_manager.cc:1950] T d5ddb8412ad145dd85916bf5d756a9f0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.040729 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 818) took 1141 ms. Trace:
I20260619 19:54:21.041761 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c5d0b279844831a9151898c54a30d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.041142 1973 rpcz_store.cc:276] 0619 19:54:19.898763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.898821 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:21.006134 (+1107313us) ts_tablet_manager.cc:1151] Deleting tablet d5ddb8412ad145dd85916bf5d756a9f0
0619 19:54:21.006148 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.031557 (+ 25409us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.035101 (+ 3544us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.040612 (+ 5511us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1106606}
I20260619 19:54:21.042547 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d5ddb8412ad145dd85916bf5d756a9f0 (table default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]) successfully deleted
I20260619 19:54:21.043664 1973 tablet_replica.cc:333] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.044003 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0a658add5c45508b320516014a2c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.044608 1973 raft_consensus.cc:2243] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.044822 3302 raft_consensus.cc:493] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.044967 3302 raft_consensus.cc:515] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.045411 1973 raft_consensus.cc:2272] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.045626 3302 leader_election.cc:290] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.046182 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.046782 996 leader_election.cc:343] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.047961 1973 ts_tablet_manager.cc:1916] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.051286 996 leader_election.cc:304] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.051290 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1183649dbe10453396a71fc1e3f777ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:21.051765 3292 raft_consensus.cc:2804] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:21.051894 3292 raft_consensus.cc:493] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:21.051975 3292 raft_consensus.cc:3060] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:21.052079 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1183649dbe10453396a71fc1e3f777ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.054518 3292 raft_consensus.cc:515] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:21.055527 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:21.056071 996 leader_election.cc:343] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.056649 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b18a61d955e4929998b90c6c8fa844e with delete_type TABLET_DATA_DELETED (replaced by tablet ca02c454eec840eb9289950b6da7b131) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.069386 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 8cee0db670b14c5dab66784936575ac6 (DEFAULT_TABLE table=default.Table_1555379f7be54ebbadeddc4f04c4c669 [id=5f50a56c30634d67893a5ad644185ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.070379 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 0991105460f749e1854d512304ff56cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.070917 901 tablet_service.cc:1511] Processing CreateTablet for tablet 31fa7a29b2c74e3caf2b4720eb53aec4 (DEFAULT_TABLE table=default.Table_54f50363519947bd8439607d2803a350 [id=c957ea1260b846b8b21e645185838093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.072365 886 tablet_service.cc:1511] Processing CreateTablet for tablet ca61a86710004d7fae9d4b012ed71ba1 (DEFAULT_TABLE table=default.Table_6b0e7c1abd8f4f6680e74faf06b14ea0 [id=2016360b9f5d40fab490a83cdd526ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.072743 889 tablet_service.cc:1511] Processing CreateTablet for tablet b61f9b7b347d4bea80184ac1cd6a5b66 (DEFAULT_TABLE table=default.Table_8596f5d31bc14fe7bc5a232cacd51819 [id=01610fa98af74ba79ea6e002add616d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.073593 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 4b22024a0c434f8e8d4a370dbfb9a4e2 (table default.Table_d911a0e8835847cb9ccf9d5d192872fe [id=57b57ad63a674bf08da4cf6d7bcd1b4e]) successfully deleted
I20260619 19:54:21.073563 3123 consensus_queue.cc:1048] T 913f4e0c705a494e8f9514f34579ea69 P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:21.074594 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6f37e153b53c471da1f304ae1ada0b2d (DEFAULT_TABLE table=default.Table_7c2004721849415b9906895ce0b16400 [id=a39b84102f794cb78b1b84ea43a34e6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.074980 884 tablet_service.cc:1511] Processing CreateTablet for tablet 913054325d034ccfaed32234a19a5c13 (DEFAULT_TABLE table=default.Table_01335e4fae1a405488b2bb5fd6d71576 [id=a9a8a947a7e14725b35abb6abca3bead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.075580 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7613312118cf43c7bddda4983d308290" } new_table_name: "default.Table_b2bc9c255ad74e7e8a590980701ed419" modify_external_catalogs: true
I20260619 19:54:21.076231 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 34f19f5ac03446a89376695b8321e820 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.077633 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 8522f562665540ce99490ab90e02d801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.078933 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550e1e33fc384884aa60e1452a19e13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.079461 1973 ts_tablet_manager.cc:1929] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:21.080004 1973 log.cc:1199] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/56640f773efb4123b93f4ca3799ddde7
I20260619 19:54:21.080209 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca9b32b723442ca984900317b442a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.081362 1973 ts_tablet_manager.cc:1950] T 56640f773efb4123b93f4ca3799ddde7 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.082010 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c1ca289620849729353a9072c75b93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.082733 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 817) took 1184 ms. Trace:
I20260619 19:54:21.083081 1973 rpcz_store.cc:276] 0619 19:54:19.898674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.898895 (+ 221us) service_pool.cc:224] Handling call
0619 19:54:21.043303 (+1144408us) ts_tablet_manager.cc:1151] Deleting tablet 56640f773efb4123b93f4ca3799ddde7
0619 19:54:21.043320 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.062639 (+ 19319us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.079198 (+ 16559us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.082615 (+ 3417us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1144152}
I20260619 19:54:21.084566 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 56640f773efb4123b93f4ca3799ddde7 (table default.Table_dac857d85b7e4b748ff854769df04686 [id=628e260ecd874610b88e42ddd8bf62e1]) successfully deleted
I20260619 19:54:21.084741 3116 raft_consensus.cc:493] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.084786 1973 tablet_replica.cc:333] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.084867 3116 raft_consensus.cc:515] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.085436 3116 leader_election.cc:290] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:21.085664 1973 raft_consensus.cc:2243] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.086798 755 tablet_service.cc:1511] Processing CreateTablet for tablet 8cee0db670b14c5dab66784936575ac6 (DEFAULT_TABLE table=default.Table_1555379f7be54ebbadeddc4f04c4c669 [id=5f50a56c30634d67893a5ad644185ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.087234 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cee0db670b14c5dab66784936575ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.087834 2953 consensus_queue.cc:1048] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:21.091895 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74813bf79789451f90bcf7779aff9290" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.092536 858 leader_election.cc:343] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.096571 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e4b2802ecd504e0a8b743e432bfc3fab
I20260619 19:54:21.097268 532 catalog_manager.cc:6784] ReplaceTablet: tablet e4b2802ecd504e0a8b743e432bfc3fab deleted and replaced by tablet efdf87fbfee44173848c897d4da1809c
I20260619 19:54:21.086365 1973 raft_consensus.cc:2272] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.098776 1973 ts_tablet_manager.cc:1916] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.099517 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet e4b2802ecd504e0a8b743e432bfc3fab with delete_type TABLET_DATA_DELETED (replaced by tablet efdf87fbfee44173848c897d4da1809c) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:21.100224 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e4b2802ecd504e0a8b743e432bfc3fab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4b2802ecd504e0a8b743e432bfc3fab already in progress: creating tablet
I20260619 19:54:21.100824 755 tablet_service.cc:1558] Processing DeleteTablet for tablet e4b2802ecd504e0a8b743e432bfc3fab with delete_type TABLET_DATA_DELETED (replaced by tablet efdf87fbfee44173848c897d4da1809c) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.104457 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f18be194dbaa4a64b422513b3ce34908" } modify_external_catalogs: true
I20260619 19:54:21.104784 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f18be194dbaa4a64b422513b3ce34908" } modify_external_catalogs: true
I20260619 19:54:21.109517 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 770333082e014658a8c5262c06575e90 (DEFAULT_TABLE table=default.Table_d80f1e8037ef4877ba34575bdaf2d6fd [id=52f6592449d1499eb8c75241588d0874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.111313 1973 ts_tablet_manager.cc:1929] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:21.111814 1973 log.cc:1199] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/a54231986cca44258942dbc3373870b2
I20260619 19:54:21.112371 1973 ts_tablet_manager.cc:1950] T a54231986cca44258942dbc3373870b2 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.112975 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 819) took 1214 ms. Trace:
I20260619 19:54:21.116371 755 tablet_service.cc:1511] Processing CreateTablet for tablet 770333082e014658a8c5262c06575e90 (DEFAULT_TABLE table=default.Table_d80f1e8037ef4877ba34575bdaf2d6fd [id=52f6592449d1499eb8c75241588d0874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.116801 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770333082e014658a8c5262c06575e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.118464 885 tablet_service.cc:1511] Processing CreateTablet for tablet 1129a59f42d64637bab6e060b118c9ef (DEFAULT_TABLE table=default.Table_0ba255fd81f741d989e015a9cbe3310d [id=2fee2e6ec65e4177a2c227045a063c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.119616 3302 raft_consensus.cc:493] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.119760 3302 raft_consensus.cc:515] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.120496 3302 leader_election.cc:290] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.130436 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_de336ee9cc7e4ed98d1983f3a46ced3c" } modify_external_catalogs: true
I20260619 19:54:21.130174 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:21.130857 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 358) took 14438 ms. Trace:
I20260619 19:54:21.130986 2026 rpcz_store.cc:276] 0619 19:54:06.692481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.692534 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:21.026934 (+14334400us) ts_tablet_manager.cc:1151] Deleting tablet e10612b432c64bb4be527cf7b6e86cf8
0619 19:54:21.026974 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.130824 (+103850us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14334179}
W20260619 19:54:21.131768 996 leader_election.cc:343] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.131369 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_de336ee9cc7e4ed98d1983f3a46ced3c" } modify_external_catalogs: true
I20260619 19:54:21.138046 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6e000f37bb60481a977a86345fa23ff4 (DEFAULT_TABLE table=default.Table_18160f4089474041ada260354eb41a97 [id=f378811746c2445c9272a60df054f5dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.113183 1973 rpcz_store.cc:276] 0619 19:54:19.898855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.899090 (+ 235us) service_pool.cc:224] Handling call
0619 19:54:21.084527 (+1185437us) ts_tablet_manager.cc:1151] Deleting tablet a54231986cca44258942dbc3373870b2
0619 19:54:21.084638 (+ 111us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.105403 (+ 20765us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.111199 (+ 5796us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.112957 (+ 1758us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185233}
I20260619 19:54:21.140662 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet a54231986cca44258942dbc3373870b2 (table default.Table_45a3ba7b76404715ae3b943580b8077d [id=ab303a5fdcde458188071f4b45dccaaa]) successfully deleted
I20260619 19:54:21.141328 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 820) took 1241 ms. Trace:
I20260619 19:54:21.141834 1973 rpcz_store.cc:276] 0619 19:54:19.899388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.899426 (+ 38us) service_pool.cc:224] Handling call
0619 19:54:21.140921 (+1241495us) ts_tablet_manager.cc:1151] Deleting tablet b2902c7f67a1402987315ee426ddf1d2
0619 19:54:21.140932 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.141310 (+ 378us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241247}
W20260619 19:54:21.142954 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b2902c7f67a1402987315ee426ddf1d2 because the tablet was not found. No further retry: Not found: Tablet not found: b2902c7f67a1402987315ee426ddf1d2
I20260619 19:54:21.143625 3292 leader_election.cc:290] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.143711 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 815) took 1246 ms. Trace:
I20260619 19:54:21.144104 1973 rpcz_store.cc:276] 0619 19:54:19.897481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:19.897552 (+ 71us) service_pool.cc:224] Handling call
0619 19:54:21.143180 (+1245628us) ts_tablet_manager.cc:1151] Deleting tablet a7100b0bfa6d4e3baf4e7f90217f1fff
0619 19:54:21.143195 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.143692 (+ 497us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234870}
W20260619 19:54:21.145011 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8d8a5ed6a874739b2195f8caa74ae9b consensus state has no leader
I20260619 19:54:21.145390 3289 raft_consensus.cc:493] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.145530 3289 raft_consensus.cc:515] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.145789 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 825) took 1037 ms. Trace:
I20260619 19:54:21.146157 3289 leader_election.cc:290] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:21.147287 858 consensus_peers.cc:597] T f658e85be0c843f2b02e4567a80521c4 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f658e85be0c843f2b02e4567a80521c4. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:21.147392 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a7100b0bfa6d4e3baf4e7f90217f1fff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7100b0bfa6d4e3baf4e7f90217f1fff already in progress: creating tablet
I20260619 19:54:21.146173 1973 rpcz_store.cc:276] 0619 19:54:20.107813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:20.107870 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:21.145391 (+1037521us) ts_tablet_manager.cc:1151] Deleting tablet ce5569cf131d418db24aa0a36869ea69
0619 19:54:21.145400 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.145679 (+ 279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1022167}
I20260619 19:54:21.147532 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.147624 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e10612b432c64bb4be527cf7b6e86cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e10612b432c64bb4be527cf7b6e86cf8 already in progress: creating tablet
W20260619 19:54:21.148272 858 leader_election.cc:343] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.149272 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 826) took 1040 ms. Trace:
I20260619 19:54:21.149618 1973 rpcz_store.cc:276] 0619 19:54:20.108787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:20.108843 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:21.148872 (+1040029us) ts_tablet_manager.cc:1151] Deleting tablet cf2b360e04054330b4d943aa98f00f35
0619 19:54:21.148885 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.149234 (+ 349us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1025550}
W20260619 19:54:21.150259 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ce5569cf131d418db24aa0a36869ea69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce5569cf131d418db24aa0a36869ea69 already in progress: creating tablet
W20260619 19:54:21.150501 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet cf2b360e04054330b4d943aa98f00f35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2b360e04054330b4d943aa98f00f35 already in progress: creating tablet
W20260619 19:54:21.151791 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet df8513e281cb44d1986e7c54376e1bdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df8513e281cb44d1986e7c54376e1bdc already in progress: creating tablet
W20260619 19:54:21.152272 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet bc2291967f0945efb7486079a93a6aad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2291967f0945efb7486079a93a6aad already in progress: creating tablet
I20260619 19:54:21.152248 899 tablet_service.cc:1511] Processing CreateTablet for tablet 8cee0db670b14c5dab66784936575ac6 (DEFAULT_TABLE table=default.Table_1555379f7be54ebbadeddc4f04c4c669 [id=5f50a56c30634d67893a5ad644185ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.152767 1973 tablet_replica.cc:333] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
W20260619 19:54:21.152813 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet cad702900111463fa298c76098746bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cad702900111463fa298c76098746bfb already in progress: creating tablet
I20260619 19:54:21.153163 1973 raft_consensus.cc:2243] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.153414 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e4b2802ecd504e0a8b743e432bfc3fab with delete_type TABLET_DATA_DELETED (replaced by tablet efdf87fbfee44173848c897d4da1809c) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.153440 1973 raft_consensus.cc:2272] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.153757 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3de788fe38794980a3b72264e038f8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.154445 1973 ts_tablet_manager.cc:1916] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.158311 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8c3c636583ef494bbbf3e79fd60e9637"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.158900 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c3c636583ef494bbbf3e79fd60e9637 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.164394 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6e000f37bb60481a977a86345fa23ff4 (DEFAULT_TABLE table=default.Table_18160f4089474041ada260354eb41a97 [id=f378811746c2445c9272a60df054f5dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.164825 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e000f37bb60481a977a86345fa23ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.165356 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:21.165550 1054 raft_consensus.cc:2468] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:21.168008 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3c38ab28684ad1be2414a9200ef7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.168253 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.173456 3265 tablet.cc:1724] T fb26af8ab52d470f8bd1b7c42a57e8a3 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.175200 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ccbefd48bcb945828054aeac735e1750" } modify_external_catalogs: true
I20260619 19:54:21.175418 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ccbefd48bcb945828054aeac735e1750" } modify_external_catalogs: true
I20260619 19:54:21.189488 3347 tablet.cc:1724] T d77de42bb514452a8dc6a4a71289dc59 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:21.193470 1973 ts_tablet_manager.cc:1929] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:21.194017 888 tablet_service.cc:1511] Processing CreateTablet for tablet 770333082e014658a8c5262c06575e90 (DEFAULT_TABLE table=default.Table_d80f1e8037ef4877ba34575bdaf2d6fd [id=52f6592449d1499eb8c75241588d0874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.194069 1973 log.cc:1199] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/52d01d2d98b64226b619255500498ffe
I20260619 19:54:21.195573 1973 ts_tablet_manager.cc:1950] T 52d01d2d98b64226b619255500498ffe P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
W20260619 19:54:21.196383 858 consensus_peers.cc:597] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56640f773efb4123b93f4ca3799ddde7. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.196851 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 830) took 1020 ms. Trace:
I20260619 19:54:21.197239 1973 rpcz_store.cc:276] 0619 19:54:20.176448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:20.176562 (+ 114us) service_pool.cc:224] Handling call
0619 19:54:21.152667 (+976105us) ts_tablet_manager.cc:1151] Deleting tablet 52d01d2d98b64226b619255500498ffe
0619 19:54:21.152679 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.160028 (+ 7349us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.193216 (+ 33188us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.196832 (+ 3616us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":966771}
I20260619 19:54:21.197842 3289 raft_consensus.cc:493] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.197975 3289 raft_consensus.cc:515] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.198374 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 52d01d2d98b64226b619255500498ffe (table default.Table_b8daa904a52e492d9f9942b151daca0f [id=fd2aa005a84e43fcb05b3ddc511c1961]) successfully deleted
I20260619 19:54:21.198549 3289 leader_election.cc:290] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:21.199566 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526af16b6a6a4cac9c084900b22d9acf" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.199954 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 736aa49b4d984295a9aefb135b005e07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 736aa49b4d984295a9aefb135b005e07 already in progress: creating tablet
W20260619 19:54:21.200115 858 leader_election.cc:343] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:21.202085 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 50bc884e4c304309a326b21a3c059fd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50bc884e4c304309a326b21a3c059fd4 already in progress: creating tablet
W20260619 19:54:21.203548 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6df1e1c1b7784e2e8cbde58c6ae86f79 already in progress: creating tablet
I20260619 19:54:21.204013 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61f9b7b347d4bea80184ac1cd6a5b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.204310 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f37e153b53c471da1f304ae1ada0b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.204638 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e000f37bb60481a977a86345fa23ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.207242 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770333082e014658a8c5262c06575e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.211184 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cee0db670b14c5dab66784936575ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.211696 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca61a86710004d7fae9d4b012ed71ba1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:21.215222 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7d5375b8c78544de92c47cb56a9b8c25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d5375b8c78544de92c47cb56a9b8c25 already in progress: creating tablet
I20260619 19:54:21.215585 1973 tablet_replica.cc:333] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.215790 1973 raft_consensus.cc:2243] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:21.215835 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 34f19f5ac03446a89376695b8321e820 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34f19f5ac03446a89376695b8321e820 already in progress: creating tablet
I20260619 19:54:21.215955 1973 raft_consensus.cc:2272] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:21.216073 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 8614b0ab1a3749a1a0aa441574f79ab1 because the tablet was not found. No further retry: Not found: Tablet not found: 8614b0ab1a3749a1a0aa441574f79ab1
I20260619 19:54:21.216500 1973 ts_tablet_manager.cc:1916] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.218218 3347 tablet.cc:1724] T fb26af8ab52d470f8bd1b7c42a57e8a3 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.227119 1973 ts_tablet_manager.cc:1929] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:21.227279 1973 log.cc:1199] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/d2939b8aa0d44ad2a05a933db4ea64be
I20260619 19:54:21.227614 1973 ts_tablet_manager.cc:1950] T d2939b8aa0d44ad2a05a933db4ea64be P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.230736 1200 tablet_bootstrap.cc:654] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.236017 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet d2939b8aa0d44ad2a05a933db4ea64be (table default.Table_766549702f124d0286617da3d1fa585c [id=3e15f4bd79fd433590d102806c85fed0]) successfully deleted
W20260619 19:54:21.236394 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e4b2802ecd504e0a8b743e432bfc3fab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4b2802ecd504e0a8b743e432bfc3fab already in progress: creating tablet
I20260619 19:54:21.240327 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.240530 922 raft_consensus.cc:2468] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:21.240658 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.240754 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:21.240792 923 raft_consensus.cc:2468] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:21.240862 910 raft_consensus.cc:3060] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.242267 886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca61a86710004d7fae9d4b012ed71ba1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:21.243921 859 consensus_peers.cc:597] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52d01d2d98b64226b619255500498ffe. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.256906 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 343) took 14692 ms. Trace:
I20260619 19:54:21.257241 2026 rpcz_store.cc:276] 0619 19:54:06.564333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.567426 (+ 3093us) service_pool.cc:224] Handling call
0619 19:54:21.131359 (+14563933us) ts_tablet_manager.cc:1151] Deleting tablet 997cd0b5a8d24b56a2d5b95ab877d95f
0619 19:54:21.256751 (+125392us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.256883 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14398833}
I20260619 19:54:21.258087 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 360) took 14514 ms. Trace:
I20260619 19:54:21.258337 2026 rpcz_store.cc:276] 0619 19:54:06.743561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.743626 (+ 65us) service_pool.cc:224] Handling call
0619 19:54:21.257890 (+14514264us) ts_tablet_manager.cc:1151] Deleting tablet 789f44a51430454db30e41ad2dd2efb0
0619 19:54:21.257900 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.258071 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14514069}
I20260619 19:54:21.259117 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 366) took 14425 ms. Trace:
I20260619 19:54:21.259464 2026 rpcz_store.cc:276] 0619 19:54:06.833926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:06.834222 (+ 296us) service_pool.cc:224] Handling call
0619 19:54:21.258904 (+14424682us) ts_tablet_manager.cc:1151] Deleting tablet 3f1e6d16452b4e568745f884cd13ebac
0619 19:54:21.258912 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.259099 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14424451}
I20260619 19:54:21.260166 2026 tablet_replica.cc:333] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:21.260710 2026 raft_consensus.cc:2243] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:21.262418 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fa7a29b2c74e3caf2b4720eb53aec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.262665 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f37e153b53c471da1f304ae1ada0b2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:21.262781 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 513382us
I20260619 19:54:21.263244 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61f9b7b347d4bea80184ac1cd6a5b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.265277 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913054325d034ccfaed32234a19a5c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.271283 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770333082e014658a8c5262c06575e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.272830 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1129a59f42d64637bab6e060b118c9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.275017 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cee0db670b14c5dab66784936575ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.276114 910 raft_consensus.cc:2468] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:21.279592 858 consensus_peers.cc:597] T 52d01d2d98b64226b619255500498ffe P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52d01d2d98b64226b619255500498ffe. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:21.280368 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 997cd0b5a8d24b56a2d5b95ab877d95f because the tablet was not found. No further retry: Not found: Tablet not found: 997cd0b5a8d24b56a2d5b95ab877d95f
W20260619 19:54:21.280616 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 789f44a51430454db30e41ad2dd2efb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 789f44a51430454db30e41ad2dd2efb0 already in progress: creating tablet
W20260619 19:54:21.280812 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 3f1e6d16452b4e568745f884cd13ebac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f1e6d16452b4e568745f884cd13ebac already in progress: creating tablet
I20260619 19:54:21.284560 890 tablet_service.cc:1511] Processing CreateTablet for tablet 6e000f37bb60481a977a86345fa23ff4 (DEFAULT_TABLE table=default.Table_18160f4089474041ada260354eb41a97 [id=f378811746c2445c9272a60df054f5dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.287613 996 leader_election.cc:304] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.288329 996 leader_election.cc:304] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.288748 3225 raft_consensus.cc:2804] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:21.288837 3225 raft_consensus.cc:493] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:21.288920 3225 raft_consensus.cc:3060] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.292582 3225 raft_consensus.cc:515] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.293519 3225 leader_election.cc:290] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.293727 3225 raft_consensus.cc:2804] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:21.293804 3225 raft_consensus.cc:493] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:21.293882 3225 raft_consensus.cc:3060] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.296056 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:21.296548 1208 tablet_bootstrap.cc:492] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.296685 1208 ts_tablet_manager.cc:1403] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.511s user 0.048s sys 0.087s
W20260619 19:54:21.297044 996 leader_election.cc:343] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.297461 1208 raft_consensus.cc:359] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.297626 1208 raft_consensus.cc:385] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.297678 1208 raft_consensus.cc:740] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.297889 1208 consensus_queue.cc:260] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.299856 3225 raft_consensus.cc:515] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.300760 3225 leader_election.cc:290] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.301429 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:21.304260 1208 ts_tablet_manager.cc:1434] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260619 19:54:21.304561 1208 tablet_bootstrap.cc:492] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:21.305891 1201 tablet_bootstrap.cc:654] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.306144 1208 tablet_bootstrap.cc:654] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:21.302156 996 leader_election.cc:343] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.312698 996 leader_election.cc:304] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.313493 3302 raft_consensus.cc:2804] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:21.313639 3302 raft_consensus.cc:697] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:21.313934 3302 consensus_queue.cc:237] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:21.314579 859 leader_election.cc:343] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:21.314707 859 leader_election.cc:304] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.318841 912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:21.319051 912 raft_consensus.cc:3060] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:21.328473 720 consensus_peers.cc:597] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0991105460f749e1854d512304ff56cd. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.339007 3248 raft_consensus.cc:493] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.339239 3248 raft_consensus.cc:515] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.340051 3248 leader_election.cc:290] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.340799 1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:21.341125 1051 raft_consensus.cc:2393] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:21.341775 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e000f37bb60481a977a86345fa23ff4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:21.343544 915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.003s sys 0.006s
W20260619 19:54:21.343729 915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s user 0.004s sys 0.007s
I20260619 19:54:21.345342 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:21.345597 914 raft_consensus.cc:3060] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.347378 3293 raft_consensus.cc:493] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.347544 3293 raft_consensus.cc:515] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.348245 3293 leader_election.cc:290] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:21.352449 913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s user 0.006s sys 0.005s
W20260619 19:54:21.352651 913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s user 0.006s sys 0.005s
I20260619 19:54:21.354128 914 raft_consensus.cc:2468] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:21.261637 2026 raft_consensus.cc:2272] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.368160 1208 tablet_bootstrap.cc:492] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.368427 1208 ts_tablet_manager.cc:1403] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.010s
I20260619 19:54:21.369177 1208 raft_consensus.cc:359] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.369441 1208 raft_consensus.cc:385] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.369537 1208 raft_consensus.cc:740] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.369871 1208 consensus_queue.cc:260] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.370098 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73029f4bc97349da9d5d2fae4321cd5f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:21.370939 1208 ts_tablet_manager.cc:1434] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:21.375530 1208 tablet_bootstrap.cc:492] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:54:21.376152 996 leader_election.cc:343] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.377362 1208 tablet_bootstrap.cc:654] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.381304 1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526af16b6a6a4cac9c084900b22d9acf" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:21.396072 3248 raft_consensus.cc:493] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.396274 3248 raft_consensus.cc:515] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.397032 3248 leader_election.cc:290] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:21.398397 720 leader_election.cc:343] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1b18a61d955e4929998b90c6c8fa844e
I20260619 19:54:21.402074 1201 tablet_bootstrap.cc:492] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
W20260619 19:54:21.402233 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c6cc12c429f4857a67d77c697e6dc67 consensus state has no leader
I20260619 19:54:21.402328 1201 ts_tablet_manager.cc:1403] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.373s user 0.005s sys 0.005s
I20260619 19:54:21.408208 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8" } modify_external_catalogs: true
I20260619 19:54:21.408712 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6bb907cef2ce4c82af97d8cf3a11b5c8" } modify_external_catalogs: true
I20260619 19:54:21.410256 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f79091265bad4f8dbe6a97b1a36a81d2" } new_table_name: "default.Table_eec88df8f25c46658bbd65c3076678bb" modify_external_catalogs: true
I20260619 19:54:21.415235 523 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_589c54e306ea43ea998074767e53995f [id=84c367d2b1dd4a25813599ba3e8fd32f] alter complete (version 1)
W20260619 19:54:21.416384 523 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.131:52223 (request call id 273) took 823 ms (client timeout 1000 ms). Trace:
W20260619 19:54:21.416504 523 rpcz_store.cc:269] 0619 19:54:20.592622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:20.615926 (+ 23304us) service_pool.cc:224] Handling call
0619 19:54:20.640571 (+ 24645us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x616000042a54. stack: 00007fd74312e496 00007fd74312e250 00007fd7421593ad 000000000099c914 000000000099c8dd 00007fd75260f6bd 00007fd75260f7b3 00007fd74f1d7b21 00007fd756f3c95d 00007fd7570c9f08 00007fd74db28ca6 00007fd74db289d5 00007fd74a23888e 00007fd74a23776e 00007fd74a23d9a8 00007fd74a23e30f
0619 19:54:21.416291 (+775720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:21.261287 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:21.377860 (+116573us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:21.377868 (+ 8us) write_op.cc:435] Acquired schema lock
0619 19:54:21.377870 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:21.378001 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:21.378018 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:21.378025 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:21.378095 (+ 70us) tablet.cc:701] Row locks acquired
0619 19:54:21.378097 (+ 2us) write_op.cc:260] PREPARE: finished
0619 19:54:21.378146 (+ 49us) write_op.cc:270] Start()
0619 19:54:21.378198 (+ 52us) write_op.cc:276] Timestamp: P: 1781898861378112 usec, L: 0
0619 19:54:21.378202 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 19:54:21.378430 (+ 228us) log.cc:844] Serialized 356 byte log entry
0619 19:54:21.414358 (+ 35928us) op_driver.cc:464] REPLICATION: finished
0619 19:54:21.414513 (+ 155us) write_op.cc:301] APPLY: starting
0619 19:54:21.414532 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:21.414581 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:21.414610 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:21.414668 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:21.414720 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:21.414727 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:21.414812 (+ 85us) log.cc:844] Serialized 23 byte log entry
0619 19:54:21.414885 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:21.414906 (+ 21us) write_op.cc:454] Released schema lock
0619 19:54:21.414913 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:21.414998 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:21.415005 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":54283648,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":469,"apply.run_wall_time_us":468,"num_ops":1,"prepare.queue_time_us":230231,"prepare.run_cpu_time_us":1115,"prepare.run_wall_time_us":156383,"raft.queue_time_us":45,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":277,"replication_time_us":36121}]]}
I20260619 19:54:21.417443 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1799fca0666143c69fb6609f994859c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.418079 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1799fca0666143c69fb6609f994859c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.425705 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:21.425717 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:21.426086 1994 tablet_replica.cc:333] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:21.426379 1994 raft_consensus.cc:2243] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.426929 1994 raft_consensus.cc:2272] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.431782 1994 ts_tablet_manager.cc:1916] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.435201 3248 raft_consensus.cc:493] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.435387 3248 raft_consensus.cc:515] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.436081 3248 leader_election.cc:290] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:21.437422 720 leader_election.cc:343] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9b78d8a4d8dd42859be248b698257e2c
W20260619 19:54:21.437763 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 123634us
W20260619 19:54:21.439631 859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 125057us
W20260619 19:54:21.439898 859 consensus_peers.cc:597] T 56640f773efb4123b93f4ca3799ddde7 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56640f773efb4123b93f4ca3799ddde7. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:21.440109 859 leader_election.cc:343] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74813bf79789451f90bcf7779aff9290
I20260619 19:54:21.440217 859 leader_election.cc:304] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.440562 913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b18a61d955e4929998b90c6c8fa844e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.440646 3289 raft_consensus.cc:2749] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:21.440670 3047 raft_consensus.cc:493] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:21.440840 913 raft_consensus.cc:2468] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:21.440922 2953 raft_consensus.cc:2749] T 74813bf79789451f90bcf7779aff9290 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:21.440558 859 consensus_peers.cc:597] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4f7122fa5f94eeaa3b99cae107d8c9a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.442828 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deba56eb121e4aa6b8ad7b13951723aa" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.442948 859 leader_election.cc:304] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:21.443524 859 leader_election.cc:343] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.443624 859 leader_election.cc:304] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.444167 777 raft_consensus.cc:3060] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.444715 3273 raft_consensus.cc:2764] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260619 19:54:21.445016 3273 raft_consensus.cc:2749] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.446555 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b78d8a4d8dd42859be248b698257e2c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.446759 910 raft_consensus.cc:2468] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:21.440856 3047 raft_consensus.cc:515] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:21.448052 3047 leader_election.cc:290] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:21.449064 858 consensus_peers.cc:597] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.450419 719 leader_election.cc:304] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.450739 3248 raft_consensus.cc:2804] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:21.450847 3248 raft_consensus.cc:493] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:21.450832 719 leader_election.cc:304] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.450968 3248 raft_consensus.cc:3060] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:21.451963 858 leader_election.cc:343] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:54:21.453116 719 leader_election.cc:304] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.453370 3123 raft_consensus.cc:2804] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:21.453445 3123 raft_consensus.cc:493] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:21.453507 3123 raft_consensus.cc:3060] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.453840 1201 raft_consensus.cc:359] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.454016 1201 raft_consensus.cc:385] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.453970 3248 raft_consensus.cc:515] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.454078 1201 raft_consensus.cc:740] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.454255 1201 consensus_queue.cc:260] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.454756 1201 ts_tablet_manager.cc:1434] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.052s user 0.001s sys 0.001s
I20260619 19:54:21.455878 1201 tablet_bootstrap.cc:492] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:21.456835 3123 raft_consensus.cc:515] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.457494 3248 leader_election.cc:290] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:21.457755 720 leader_election.cc:343] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 1b18a61d955e4929998b90c6c8fa844e
I20260619 19:54:21.459226 3229 raft_consensus.cc:2749] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.460121 2026 ts_tablet_manager.cc:1916] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.463471 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73029f4bc97349da9d5d2fae4321cd5f" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.463951 1201 tablet_bootstrap.cc:654] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.464121 996 leader_election.cc:304] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.466245 3273 consensus_queue.cc:1048] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:21.466907 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b18a61d955e4929998b90c6c8fa844e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:21.467111 910 raft_consensus.cc:3060] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.468868 1994 ts_tablet_manager.cc:1929] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 19:54:21.468954 996 leader_election.cc:343] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.469120 996 leader_election.cc:304] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.468863 3225 raft_consensus.cc:2804] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:21.469324 3225 raft_consensus.cc:697] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:21.469415 1994 log.cc:1199] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/74d8cd01251f4cfa93ecddb391c1c91e
I20260619 19:54:21.469638 3225 consensus_queue.cc:237] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.470732 3292 raft_consensus.cc:2749] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.471525 3273 consensus_queue.cc:1048] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:21.474480 859 leader_election.cc:343] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: d0a9c96d9c034a4a8a4d05d8518ebcec
I20260619 19:54:21.474705 859 leader_election.cc:304] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.475308 3116 raft_consensus.cc:2749] T d0a9c96d9c034a4a8a4d05d8518ebcec P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 19:54:21.476100 859 consensus_peers.cc:597] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3091dd1a525a4f779c68b8b77afa5b26. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:21.476370 3116 consensus_queue.cc:1048] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:21.478363 2953 raft_consensus.cc:493] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.478547 2953 raft_consensus.cc:515] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.479341 2953 leader_election.cc:290] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:21.480523 2026 ts_tablet_manager.cc:1929] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.489172 1994 ts_tablet_manager.cc:1950] T 74d8cd01251f4cfa93ecddb391c1c91e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:21.491864 1994 tablet_replica.cc:333] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:21.492012 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 74d8cd01251f4cfa93ecddb391c1c91e (table default.Table_00c1932320834358a5d2177cce3bd429 [id=d82c7168e6534b9eb971431987b69afe]) successfully deleted
I20260619 19:54:21.495172 1994 raft_consensus.cc:2243] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.495637 1994 raft_consensus.cc:2272] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.496392 1994 ts_tablet_manager.cc:1916] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.512494 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_12e89619bc914902b7f38712ecd70ba3" } modify_external_catalogs: true
I20260619 19:54:21.512840 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_12e89619bc914902b7f38712ecd70ba3" } modify_external_catalogs: true
I20260619 19:54:21.514815 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3baccc5fc88243f68eeabba0db3267e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.516410 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3baccc5fc88243f68eeabba0db3267e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.517351 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_b2bc9c255ad74e7e8a590980701ed419 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 3 got 0
I20260619 19:54:21.518229 531 catalog_manager.cc:5696] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:21.519009 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:21.483034 2953 raft_consensus.cc:493] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.519832 2953 raft_consensus.cc:515] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.520350 1200 tablet_bootstrap.cc:492] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:21.520537 1200 ts_tablet_manager.cc:1403] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.623s user 0.008s sys 0.007s
I20260619 19:54:21.520748 2953 leader_election.cc:290] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:21.492890 859 leader_election.cc:343] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 55404d15d42244c6b42272143c44ff9c
I20260619 19:54:21.521492 1200 raft_consensus.cc:359] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.521831 1200 raft_consensus.cc:385] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.521945 1200 raft_consensus.cc:740] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.522257 1200 consensus_queue.cc:260] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.513789 1201 tablet_bootstrap.cc:492] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:21.523463 1201 ts_tablet_manager.cc:1403] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.068s user 0.008s sys 0.000s
I20260619 19:54:21.524735 1201 raft_consensus.cc:359] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.524911 1201 raft_consensus.cc:385] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.524971 1201 raft_consensus.cc:740] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.525228 1201 consensus_queue.cc:260] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:21.525100 859 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: e6dcf87d57044279a218cbb21c383352
I20260619 19:54:21.525969 1201 ts_tablet_manager.cc:1434] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:21.526386 1201 tablet_bootstrap.cc:492] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:21.528476 1201 tablet_bootstrap.cc:654] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:21.525982 859 consensus_peers.cc:597] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74d8cd01251f4cfa93ecddb391c1c91e. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.529536 2026 log.cc:1199] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/28e463032d0744cc88d011accbebfe1f
I20260619 19:54:21.529770 3313 tablet.cc:1724] T 5482cf46c91d426484938c387b785d61 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:21.529996 2026 ts_tablet_manager.cc:1950] T 28e463032d0744cc88d011accbebfe1f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
W20260619 19:54:21.534996 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.188:44433, user_credentials={real_user=slave}} blocked reactor thread for 69500.4us
I20260619 19:54:21.537196 3265 tablet.cc:1724] T 5482cf46c91d426484938c387b785d61 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:21.546180 3123 leader_election.cc:290] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.546638 752 tablet_service.cc:1558] Processing DeleteTablet for tablet d2939b8aa0d44ad2a05a933db4ea64be with delete_type TABLET_DATA_DELETED (replaced by tablet 9ff01c0de8a540d0a024a4924199ba54) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.546875 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b78d8a4d8dd42859be248b698257e2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:01 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.547103 1973 tablet_replica.cc:333] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.547335 1973 raft_consensus.cc:2243] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.547472 1973 raft_consensus.cc:2272] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.547952 1973 ts_tablet_manager.cc:1916] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.549106 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 0991105460f749e1854d512304ff56cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.549275 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d5ddb8412ad145dd85916bf5d756a9f0 with delete_type TABLET_DATA_DELETED (replaced by tablet f9d9e816e001403a820caca4916f8824) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.549404 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d01d2d98b64226b619255500498ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:20 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.549515 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.551079 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b78d8a4d8dd42859be248b698257e2c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:21.551159 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d2939b8aa0d44ad2a05a933db4ea64be because the tablet was not found. No further retry: Not found: Tablet not found: d2939b8aa0d44ad2a05a933db4ea64be
I20260619 19:54:21.551313 914 raft_consensus.cc:3060] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.552016 774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55404d15d42244c6b42272143c44ff9c" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:21.553490 3290 consensus_queue.cc:1048] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:21.554265 858 leader_election.cc:343] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.554370 858 leader_election.cc:304] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:21.554823 858 leader_election.cc:343] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: e6dcf87d57044279a218cbb21c383352
I20260619 19:54:21.554909 858 leader_election.cc:304] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:21.555276 858 consensus_peers.cc:597] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:21.555526 858 consensus_peers.cc:597] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2939b8aa0d44ad2a05a933db4ea64be. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.555644 3289 raft_consensus.cc:2749] T 55404d15d42244c6b42272143c44ff9c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.555799 3289 raft_consensus.cc:2749] T e6dcf87d57044279a218cbb21c383352 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:21.555836 3313 tablet.cc:1724] T fb26af8ab52d470f8bd1b7c42a57e8a3 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.557487 1208 tablet_bootstrap.cc:492] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.557675 1208 ts_tablet_manager.cc:1403] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.182s user 0.060s sys 0.049s
I20260619 19:54:21.558403 1208 raft_consensus.cc:359] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.558645 1208 raft_consensus.cc:385] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.558713 1208 raft_consensus.cc:740] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.558965 1208 consensus_queue.cc:260] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.582968 1200 ts_tablet_manager.cc:1434] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.062s user 0.001s sys 0.001s
I20260619 19:54:21.583400 1200 tablet_bootstrap.cc:492] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:21.585161 1200 tablet_bootstrap.cc:654] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:21.587522 859 consensus_peers.cc:597] T d2939b8aa0d44ad2a05a933db4ea64be P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2939b8aa0d44ad2a05a933db4ea64be. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.595481 3290 consensus_queue.cc:1048] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:21.561156 1973 ts_tablet_manager.cc:1929] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:21.569428 3339 tablet.cc:1724] T 5482cf46c91d426484938c387b785d61 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260619 19:54:21.597431 1973 log.cc:1199] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/9b78d8a4d8dd42859be248b698257e2c
I20260619 19:54:21.597776 1208 ts_tablet_manager.cc:1434] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.040s user 0.000s sys 0.002s
I20260619 19:54:21.597851 1973 ts_tablet_manager.cc:1950] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.598076 1208 tablet_bootstrap.cc:492] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:21.598342 1973 tablet_replica.cc:333] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.598498 1973 raft_consensus.cc:2243] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:21.598737 1973 pending_rounds.cc:70] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:21.598776 1973 pending_rounds.cc:77] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657732254261248 op_type: NO_OP noop_request { }
I20260619 19:54:21.598853 1973 raft_consensus.cc:2889] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:21.598920 1973 raft_consensus.cc:2272] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.599181 912 raft_consensus.cc:2468] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:21.599493 1973 ts_tablet_manager.cc:1916] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.599638 1208 tablet_bootstrap.cc:654] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.601643 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 368) took 14273 ms. Trace:
I20260619 19:54:21.601738 2026 rpcz_store.cc:276] 0619 19:54:07.328229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.328279 (+ 50us) service_pool.cc:224] Handling call
0619 19:54:21.260046 (+13931767us) ts_tablet_manager.cc:1151] Deleting tablet 28e463032d0744cc88d011accbebfe1f
0619 19:54:21.260094 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.465988 (+205894us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.480435 (+ 14447us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.601623 (+121188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104782,"tablet-delete.queue_time_us":13931559}
I20260619 19:54:21.601882 910 raft_consensus.cc:2468] T 1b18a61d955e4929998b90c6c8fa844e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:21.602185 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 384) took 13963 ms. Trace:
I20260619 19:54:21.602259 2026 rpcz_store.cc:276] 0619 19:54:07.638370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.638421 (+ 51us) service_pool.cc:224] Handling call
0619 19:54:21.602047 (+13963626us) ts_tablet_manager.cc:1151] Deleting tablet 10c73b679e394f31b9e5d51681e06976
0619 19:54:21.602055 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.602169 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13880096}
I20260619 19:54:21.602422 1201 tablet_bootstrap.cc:492] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:21.602550 2026 tablet_replica.cc:333] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:21.602751 2026 raft_consensus.cc:2243] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:21.602717 996 leader_election.cc:304] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.603000 2026 pending_rounds.cc:70] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:21.603042 2026 pending_rounds.cc:77] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657732661448704 op_type: NO_OP noop_request { }
I20260619 19:54:21.603165 2026 raft_consensus.cc:2889] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:21.603256 2026 raft_consensus.cc:2272] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.603772 2026 ts_tablet_manager.cc:1916] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.604115 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 28e463032d0744cc88d011accbebfe1f (table default.Table_35a806d3e4164ed4855c53a228466cc6 [id=a3761f09d8c34ec2b2a45a02f58ca47a]) successfully deleted
W20260619 19:54:21.582978 720 leader_election.cc:343] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9b78d8a4d8dd42859be248b698257e2c
I20260619 19:54:21.605870 914 raft_consensus.cc:2468] T 9b78d8a4d8dd42859be248b698257e2c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:21.606411 3302 raft_consensus.cc:2804] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:21.606534 3302 raft_consensus.cc:697] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:21.606757 3302 consensus_queue.cc:237] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:21.608656 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 10c73b679e394f31b9e5d51681e06976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c73b679e394f31b9e5d51681e06976 already in progress: creating tablet
I20260619 19:54:21.610071 2026 ts_tablet_manager.cc:1929] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.610273 2026 log.cc:1199] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/74d8cd01251f4cfa93ecddb391c1c91e
I20260619 19:54:21.610952 2026 ts_tablet_manager.cc:1950] T 74d8cd01251f4cfa93ecddb391c1c91e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:21.611279 780 raft_consensus.cc:3060] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.611348 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 385) took 13903 ms. Trace:
I20260619 19:54:21.613504 2026 rpcz_store.cc:276] 0619 19:54:07.708174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.732740 (+ 24566us) service_pool.cc:224] Handling call
0619 19:54:21.602504 (+13869764us) ts_tablet_manager.cc:1151] Deleting tablet 74d8cd01251f4cfa93ecddb391c1c91e
0619 19:54:21.602518 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.607225 (+ 4707us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.610017 (+ 2792us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.611332 (+ 1315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13869440}
I20260619 19:54:21.614086 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 74d8cd01251f4cfa93ecddb391c1c91e (table default.Table_00c1932320834358a5d2177cce3bd429 [id=d82c7168e6534b9eb971431987b69afe]) successfully deleted
I20260619 19:54:21.614701 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 387) took 13905 ms. Trace:
I20260619 19:54:21.614820 2026 rpcz_store.cc:276] 0619 19:54:07.709190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:07.709247 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:21.614552 (+13905305us) ts_tablet_manager.cc:1151] Deleting tablet a9bdcbcf35e14a7ca2c0241478d278cd
0619 19:54:21.614563 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.614680 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13780485}
W20260619 19:54:21.615371 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet a9bdcbcf35e14a7ca2c0241478d278cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9bdcbcf35e14a7ca2c0241478d278cd already in progress: creating tablet
I20260619 19:54:21.615801 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 405) took 13592 ms. Trace:
I20260619 19:54:21.615914 2026 rpcz_store.cc:276] 0619 19:54:08.023533 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.026763 (+ 3230us) service_pool.cc:224] Handling call
0619 19:54:21.615692 (+13588929us) ts_tablet_manager.cc:1151] Deleting tablet b546831050f84a91b8e4df5b96b1be14
0619 19:54:21.615702 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.615786 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13587750}
W20260619 19:54:21.616547 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b546831050f84a91b8e4df5b96b1be14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b546831050f84a91b8e4df5b96b1be14 already in progress: creating tablet
I20260619 19:54:21.616665 719 leader_election.cc:304] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.616761 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 9b78d8a4d8dd42859be248b698257e2c (table default.Table_6fd43f965fb445cfbc8018f1ed9adfaf [id=86b56cb65cf741ae8607f903894cc121]) successfully deleted
I20260619 19:54:21.617002 3123 raft_consensus.cc:2804] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:21.617148 3123 raft_consensus.cc:697] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:21.617116 719 leader_election.cc:304] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters: e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.617410 3123 consensus_queue.cc:237] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:21.617651 719 raft_consensus.cc:2686] T 9b78d8a4d8dd42859be248b698257e2c P b1f5f240547f42ec82f57e6c8af5ea89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260619 19:54:21.618820 1973 ts_tablet_manager.cc:1929] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.618955 1973 log.cc:1199] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/0991105460f749e1854d512304ff56cd
I20260619 19:54:21.619491 1973 ts_tablet_manager.cc:1950] T 0991105460f749e1854d512304ff56cd P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.620460 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 0991105460f749e1854d512304ff56cd (table default.Table_a666e5f020f94fbbbb4aeb87d9f180fe [id=0880c684a7f344c2bb195bdc7d880080]) successfully deleted
W20260619 19:54:21.621876 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet d5ddb8412ad145dd85916bf5d756a9f0 because the tablet was not found. No further retry: Not found: Tablet not found: d5ddb8412ad145dd85916bf5d756a9f0
W20260619 19:54:21.624068 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 52d01d2d98b64226b619255500498ffe because the tablet was not found. No further retry: Not found: Tablet not found: 52d01d2d98b64226b619255500498ffe
I20260619 19:54:21.624406 1973 tablet_replica.cc:333] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.624701 1973 raft_consensus.cc:2243] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.624912 1973 raft_consensus.cc:2272] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.602543 1201 ts_tablet_manager.cc:1403] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.000s
I20260619 19:54:21.637732 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 406) took 13509 ms. Trace:
I20260619 19:54:21.638288 2026 rpcz_store.cc:276] 0619 19:54:08.128295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.148432 (+ 20137us) service_pool.cc:224] Handling call
0619 19:54:21.637564 (+13489132us) ts_tablet_manager.cc:1151] Deleting tablet b12efc4264ae48e29fbcd446ea161307
0619 19:54:21.637577 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.637711 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13443306}
I20260619 19:54:21.640468 1973 ts_tablet_manager.cc:1916] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:21.641870 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet b12efc4264ae48e29fbcd446ea161307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b12efc4264ae48e29fbcd446ea161307 already in progress: creating tablet
I20260619 19:54:21.642323 2026 tablet_replica.cc:333] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:21.642572 3356 raft_consensus.cc:493] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.642758 3356 raft_consensus.cc:515] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.643446 3356 leader_election.cc:290] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.644215 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 495bafb07abe45da9f62138453dd6636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:21.644586 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:21.644690 2026 raft_consensus.cc:2243] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.644819 1058 raft_consensus.cc:2393] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:21.644879 2026 raft_consensus.cc:2272] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.634917 1201 raft_consensus.cc:359] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.644300 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e01dc8f8cd43b59fe2bbbfa0a4db4c" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.645634 1201 raft_consensus.cc:385] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.646010 719 leader_election.cc:304] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.646270 3229 raft_consensus.cc:3060] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.646823 1200 tablet_bootstrap.cc:492] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:21.646950 1200 ts_tablet_manager.cc:1403] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.064s user 0.007s sys 0.000s
I20260619 19:54:21.647809 1200 raft_consensus.cc:359] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.647964 1200 raft_consensus.cc:385] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.648015 1200 raft_consensus.cc:740] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.648221 1200 consensus_queue.cc:260] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.648645 3273 consensus_queue.cc:1048] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:21.649012 1200 ts_tablet_manager.cc:1434] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:21.649086 3229 raft_consensus.cc:2749] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.649312 1200 tablet_bootstrap.cc:492] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:21.651367 1200 tablet_bootstrap.cc:654] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.652733 1201 raft_consensus.cc:740] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.656582 3339 tablet.cc:1724] T e244971a6b0b424db6d16d233b32a96e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.657434 1201 consensus_queue.cc:260] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.657913 1994 ts_tablet_manager.cc:1929] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:21.658420 1201 ts_tablet_manager.cc:1434] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260619 19:54:21.658479 1994 log.cc:1199] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/3ae6164970ec4977a8c0c9fd24ab7275
I20260619 19:54:21.659200 1201 tablet_bootstrap.cc:492] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:21.661039 1201 tablet_bootstrap.cc:654] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.663097 1208 tablet_bootstrap.cc:492] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.663254 1994 ts_tablet_manager.cc:1950] T 3ae6164970ec4977a8c0c9fd24ab7275 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:21.663378 1208 ts_tablet_manager.cc:1403] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.010s
I20260619 19:54:21.664196 1208 raft_consensus.cc:359] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.664397 1208 raft_consensus.cc:385] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.664480 1208 raft_consensus.cc:740] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.664783 1208 consensus_queue.cc:260] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.665413 1208 ts_tablet_manager.cc:1434] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:21.665755 1208 tablet_bootstrap.cc:492] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:54:21.669721 858 consensus_peers.cc:597] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.671000 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 3ae6164970ec4977a8c0c9fd24ab7275 (table default.Table_58686549f5974cedb2fc3a15c08d9207 [id=19f4b9169a634b9d8fc0212981f18682]) successfully deleted
I20260619 19:54:21.671221 1994 tablet_replica.cc:333] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:21.671427 2026 ts_tablet_manager.cc:1916] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.671433 1994 raft_consensus.cc:2243] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:21.671667 1994 pending_rounds.cc:70] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:21.671732 1994 pending_rounds.cc:77] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657736583348224 op_type: NO_OP noop_request { }
I20260619 19:54:21.671833 1994 raft_consensus.cc:2889] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:21.671928 1994 raft_consensus.cc:2272] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.673487 1973 ts_tablet_manager.cc:1929] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.673646 1973 log.cc:1199] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/b4f7122fa5f94eeaa3b99cae107d8c9a
I20260619 19:54:21.674038 1973 ts_tablet_manager.cc:1950] T b4f7122fa5f94eeaa3b99cae107d8c9a P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.674698 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet b4f7122fa5f94eeaa3b99cae107d8c9a (table default.Table_599b6bc9158b48d4848732a5c03bc7d1 [id=a8cf65f08efa458883756790fbdd055d]) successfully deleted
I20260619 19:54:21.687678 1208 tablet_bootstrap.cc:654] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.687904 1994 ts_tablet_manager.cc:1916] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.691804 2026 ts_tablet_manager.cc:1929] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.699476 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6617e8f0d86f45a19258d7453c8101fb
I20260619 19:54:21.700495 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 6617e8f0d86f45a19258d7453c8101fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.700932 2026 log.cc:1199] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d651c8fb8ff244a5a09dd9ea593ecb14
W20260619 19:54:21.701107 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6617e8f0d86f45a19258d7453c8101fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6617e8f0d86f45a19258d7453c8101fb already in progress: creating tablet
I20260619 19:54:21.701628 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 55684b109a03488a88efd45a067159a0
I20260619 19:54:21.702245 1208 tablet_bootstrap.cc:492] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.702409 1208 ts_tablet_manager.cc:1403] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260619 19:54:21.706578 1994 ts_tablet_manager.cc:1929] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.706705 1994 log.cc:1199] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/495bafb07abe45da9f62138453dd6636
I20260619 19:54:21.707056 1994 ts_tablet_manager.cc:1950] T 495bafb07abe45da9f62138453dd6636 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:21.708892 2026 ts_tablet_manager.cc:1950] T d651c8fb8ff244a5a09dd9ea593ecb14 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:21.710114 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 495bafb07abe45da9f62138453dd6636 (table default.Table_96b2c29bad4c4371b337dc4318ef79ff [id=ca34531aaa3d4fb3a1e303bdeb31a103]) successfully deleted
I20260619 19:54:21.708195 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 6617e8f0d86f45a19258d7453c8101fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.711104 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 55684b109a03488a88efd45a067159a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:21.693071 1201 tablet_bootstrap.cc:492] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:21.711373 1994 tablet_replica.cc:333] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:21.711588 1201 ts_tablet_manager.cc:1403] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.002s
I20260619 19:54:21.711607 1994 raft_consensus.cc:2243] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.711828 1994 raft_consensus.cc:2272] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.712540 1201 raft_consensus.cc:359] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.712782 1994 ts_tablet_manager.cc:1916] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.712867 1201 raft_consensus.cc:385] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.713011 1201 raft_consensus.cc:740] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.713372 1201 consensus_queue.cc:260] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.714094 1201 ts_tablet_manager.cc:1434] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:21.716250 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 6617e8f0d86f45a19258d7453c8101fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:21.717954 1201 tablet_bootstrap.cc:492] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:21.720101 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 55684b109a03488a88efd45a067159a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.720676 1208 raft_consensus.cc:359] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.720901 1208 raft_consensus.cc:385] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.720973 1208 raft_consensus.cc:740] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.721189 1208 consensus_queue.cc:260] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.721587 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 55684b109a03488a88efd45a067159a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.724261 1201 tablet_bootstrap.cc:654] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.725170 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 410) took 13429 ms. Trace:
I20260619 19:54:21.725310 2026 rpcz_store.cc:276] 0619 19:54:08.295781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.300035 (+ 4254us) service_pool.cc:224] Handling call
0619 19:54:21.642271 (+13342236us) ts_tablet_manager.cc:1151] Deleting tablet d651c8fb8ff244a5a09dd9ea593ecb14
0619 19:54:21.642281 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.674978 (+ 32697us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.691712 (+ 16734us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.724871 (+ 33159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13342057}
I20260619 19:54:21.726223 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d651c8fb8ff244a5a09dd9ea593ecb14 (table default.Table_24d96d4b01f94727832aaf2c7fc13576 [id=b6c966d7d56a46cfb4fa632aad28d7b6]) successfully deleted
I20260619 19:54:21.727416 2026 tablet_replica.cc:333] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:21.727711 2026 raft_consensus.cc:2243] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.727942 2026 raft_consensus.cc:2272] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.728706 2026 ts_tablet_manager.cc:1916] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.732729 1208 ts_tablet_manager.cc:1434] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.029s user 0.002s sys 0.001s
I20260619 19:54:21.733625 1973 tablet_replica.cc:333] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:21.737701 1994 ts_tablet_manager.cc:1929] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:21.738385 1994 log.cc:1199] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/55684b109a03488a88efd45a067159a0
I20260619 19:54:21.738992 1994 ts_tablet_manager.cc:1950] T 55684b109a03488a88efd45a067159a0 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:21.740746 1208 tablet_bootstrap.cc:492] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:21.740725 3123 raft_consensus.cc:493] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.741408 3123 raft_consensus.cc:515] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.742231 3123 leader_election.cc:290] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:21.742928 1208 tablet_bootstrap.cc:654] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.743217 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 55684b109a03488a88efd45a067159a0 (table default.Table_de336ee9cc7e4ed98d1983f3a46ced3c [id=043c20ae78a943e0bbf1c9a6753261b1]) successfully deleted
W20260619 19:54:21.743551 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6617e8f0d86f45a19258d7453c8101fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6617e8f0d86f45a19258d7453c8101fb already in progress: creating tablet
I20260619 19:54:21.741425 1973 raft_consensus.cc:2243] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:21.744081 914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495bafb07abe45da9f62138453dd6636" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:21.744241 1973 raft_consensus.cc:2272] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.744340 914 raft_consensus.cc:2393] T 495bafb07abe45da9f62138453dd6636 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:21.744921 1973 ts_tablet_manager.cc:1916] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:21.747989 720 leader_election.cc:343] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 495bafb07abe45da9f62138453dd6636
I20260619 19:54:21.751019 3116 raft_consensus.cc:493] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.751441 3116 raft_consensus.cc:515] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.753098 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae6164970ec4977a8c0c9fd24ab7275" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.753718 858 leader_election.cc:343] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.754083 3116 leader_election.cc:290] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:21.754323 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6532bdfd3c844ff2a25bee6ff1e0c25e consensus state has no leader
W20260619 19:54:21.767264 859 leader_election.cc:343] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 3ae6164970ec4977a8c0c9fd24ab7275
I20260619 19:54:21.767462 859 leader_election.cc:304] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.768369 3290 raft_consensus.cc:2749] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.773196 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 58f347b206c34ffd80ff730f238f43aa
I20260619 19:54:21.774274 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet efba47405c35417a85690c8c95367ff1
I20260619 19:54:21.775662 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 58f347b206c34ffd80ff730f238f43aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.775928 750 tablet_service.cc:1558] Processing DeleteTablet for tablet efba47405c35417a85690c8c95367ff1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.777426 894 tablet_service.cc:1558] Processing DeleteTablet for tablet efba47405c35417a85690c8c95367ff1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.777961 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 58f347b206c34ffd80ff730f238f43aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:21.782424 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 58f347b206c34ffd80ff730f238f43aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.783592 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_43005387944c49c8ab351b1f890fe8a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.784510 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43005387944c49c8ab351b1f890fe8a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.786641 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet efba47405c35417a85690c8c95367ff1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:21.786931 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 58f347b206c34ffd80ff730f238f43aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58f347b206c34ffd80ff730f238f43aa already in progress: creating tablet
W20260619 19:54:21.787834 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet efba47405c35417a85690c8c95367ff1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efba47405c35417a85690c8c95367ff1 already in progress: creating tablet
I20260619 19:54:21.789645 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_accf378b438e453b85c3fbc643f51b49" } new_table_name: "default.Table_06261f039b0d47af822b1bdfe0868596" modify_external_catalogs: true
I20260619 19:54:21.792585 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_1d2c0580999842a2bde0549107f0f6ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.793298 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d2c0580999842a2bde0549107f0f6ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.796766 2953 raft_consensus.cc:493] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:21.796939 2953 raft_consensus.cc:515] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.797504 2953 leader_election.cc:290] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
W20260619 19:54:21.798455 858 leader_election.cc:343] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: bf175c80483346788a148b7277b9ca9d
W20260619 19:54:21.800436 859 leader_election.cc:343] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: bf175c80483346788a148b7277b9ca9d
I20260619 19:54:21.800582 859 leader_election.cc:304] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.801169 3290 raft_consensus.cc:2749] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:21.802721 1973 ts_tablet_manager.cc:1929] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260619 19:54:21.808058 1973 log.cc:1199] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/55684b109a03488a88efd45a067159a0
I20260619 19:54:21.808882 1973 ts_tablet_manager.cc:1950] T 55684b109a03488a88efd45a067159a0 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:21.810750 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 55684b109a03488a88efd45a067159a0 (table default.Table_de336ee9cc7e4ed98d1983f3a46ced3c [id=043c20ae78a943e0bbf1c9a6753261b1]) successfully deleted
W20260619 19:54:21.812420 859 consensus_peers.cc:597] T 71d212a279754f2497ad4fc2a3c8b5c3 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71d212a279754f2497ad4fc2a3c8b5c3. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:21.819757 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6c3c38ab28684ad1be2414a9200ef7fd
I20260619 19:54:21.821005 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c3c38ab28684ad1be2414a9200ef7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:21.821260 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c3c38ab28684ad1be2414a9200ef7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:21.822144 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6c3c38ab28684ad1be2414a9200ef7fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c3c38ab28684ad1be2414a9200ef7fd already in progress: creating tablet
I20260619 19:54:21.822897 3313 tablet.cc:1724] T 5eb4005068684928b3b27ff73b108d1b P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.824947 3339 tablet.cc:1724] T 5eb4005068684928b3b27ff73b108d1b P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.825085 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c3c38ab28684ad1be2414a9200ef7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:21 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:21.831724 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c2bcaece76334759bdc9728add70e6ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.832365 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2bcaece76334759bdc9728add70e6ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.832962 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_56bba0889a534f4a990ab04ed0466ff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.833403 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56bba0889a534f4a990ab04ed0466ff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.833866 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_10c903295c1d41ecb90fc2a5d717264b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:21.834304 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10c903295c1d41ecb90fc2a5d717264b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.835558 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0bdd74281c9e4f359f9e8ee4ffa72755" } new_table_name: "default.Table_44d172e9573d4c978212057766b7fe92" modify_external_catalogs: true
I20260619 19:54:21.837816 532 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e244971a6b0b424db6d16d233b32a96e (table default.Table_589c54e306ea43ea998074767e53995f [id=84c367d2b1dd4a25813599ba3e8fd32f]). Expected version 1 got 0
I20260619 19:54:21.840068 1208 tablet_bootstrap.cc:492] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.840277 1208 ts_tablet_manager.cc:1403] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.014s
I20260619 19:54:21.841037 1208 raft_consensus.cc:359] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.841260 1208 raft_consensus.cc:385] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.841344 1208 raft_consensus.cc:740] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.841572 1208 consensus_queue.cc:260] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.842041 3265 tablet.cc:1724] T 5eb4005068684928b3b27ff73b108d1b P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:21.842283 1208 ts_tablet_manager.cc:1434] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:21.842582 1208 tablet_bootstrap.cc:492] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
W20260619 19:54:21.843750 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 58f347b206c34ffd80ff730f238f43aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58f347b206c34ffd80ff730f238f43aa already in progress: creating tablet
W20260619 19:54:21.844079 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet efba47405c35417a85690c8c95367ff1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efba47405c35417a85690c8c95367ff1 already in progress: creating tablet
W20260619 19:54:21.844308 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 6c3c38ab28684ad1be2414a9200ef7fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c3c38ab28684ad1be2414a9200ef7fd already in progress: creating tablet
I20260619 19:54:21.857379 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 1ded605c2edc4c2fb138d07dea4a14b4 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:21.857908 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 72afb5bbe996484ba77766a463ea15c8 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:21.859212 3116 raft_consensus.cc:493] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:21.859460 3116 raft_consensus.cc:515] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:21.860916 858 leader_election.cc:343] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: dc5235127fb54d3dba90c9f9f8c134b4
W20260619 19:54:21.862154 859 leader_election.cc:343] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: dc5235127fb54d3dba90c9f9f8c134b4
I20260619 19:54:21.862263 859 leader_election.cc:304] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.862581 3290 raft_consensus.cc:2749] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:21.862887 3116 leader_election.cc:290] T dc5235127fb54d3dba90c9f9f8c134b4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:21.863360 2026 ts_tablet_manager.cc:1929] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:21.863529 2026 log.cc:1199] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/b57381b0a02141459dc582196d0c0095
I20260619 19:54:21.864055 2026 ts_tablet_manager.cc:1950] T b57381b0a02141459dc582196d0c0095 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:21.867578 1208 tablet_bootstrap.cc:654] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:21.870587 996 consensus_peers.cc:597] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:21.870590 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 417) took 13454 ms. Trace:
I20260619 19:54:21.870718 2026 rpcz_store.cc:276] 0619 19:54:08.415643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.417412 (+ 1769us) service_pool.cc:224] Handling call
0619 19:54:21.727307 (+13309895us) ts_tablet_manager.cc:1151] Deleting tablet b57381b0a02141459dc582196d0c0095
0619 19:54:21.727325 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.791116 (+ 63791us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.863292 (+ 72176us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.870548 (+ 7256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13309681}
I20260619 19:54:21.871417 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet b57381b0a02141459dc582196d0c0095 (table default.Table_7e1870963343443fac9b7d18ea95ac26 [id=9bd4594ba4414fadb6b059ae71a6dfd0]) successfully deleted
I20260619 19:54:21.872582 720 leader_election.cc:304] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.879693 1208 tablet_bootstrap.cc:492] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.883287 1208 ts_tablet_manager.cc:1403] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.001s
I20260619 19:54:21.883322 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 423) took 13230 ms. Trace:
W20260619 19:54:21.883603 897 consensus_meta.cc:287] T e2bd4e6a61da443192a1e8b0acf34eb8 P 95181cc281b946c8b81aa825232d9498: Time spent flushing consensus metadata: real 1.035s user 0.025s sys 0.003s
I20260619 19:54:21.883402 2026 rpcz_store.cc:276] 0619 19:54:08.652749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.652829 (+ 80us) service_pool.cc:224] Handling call
0619 19:54:21.873533 (+13220704us) ts_tablet_manager.cc:1151] Deleting tablet 3be362aa28504b729801de35d869beac
0619 19:54:21.883172 (+ 9639us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.883294 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13220212}
W20260619 19:54:21.884414 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 3be362aa28504b729801de35d869beac because the tablet was not found. No further retry: Not found: Tablet not found: 3be362aa28504b729801de35d869beac
I20260619 19:54:21.885006 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 424) took 13223 ms. Trace:
I20260619 19:54:21.885174 2026 rpcz_store.cc:276] 0619 19:54:08.661764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.670492 (+ 8728us) service_pool.cc:224] Handling call
0619 19:54:21.884854 (+13214362us) ts_tablet_manager.cc:1151] Deleting tablet 180c3fd33d854a06a7cfd2f9671557a7
0619 19:54:21.884868 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:21.884983 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13213992}
I20260619 19:54:21.887231 3123 raft_consensus.cc:3060] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.888799 3339 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260619 19:54:21.889814 3123 raft_consensus.cc:2749] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:21.890316 1208 raft_consensus.cc:359] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.890733 1208 raft_consensus.cc:385] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.890812 1208 raft_consensus.cc:740] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
W20260619 19:54:21.890626 720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.131:34819, user_credentials={real_user=slave}} blocked reactor thread for 142663us
I20260619 19:54:21.891372 1200 tablet_bootstrap.cc:492] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:21.891508 1200 ts_tablet_manager.cc:1403] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.242s user 0.013s sys 0.023s
I20260619 19:54:21.892314 1200 raft_consensus.cc:359] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.892480 1200 raft_consensus.cc:385] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.892529 1200 raft_consensus.cc:740] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.892757 1200 consensus_queue.cc:260] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.893380 1200 ts_tablet_manager.cc:1434] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260619 19:54:21.893712 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c699cbfd0f04202885a301e19af8136 consensus state has no leader
I20260619 19:54:21.894107 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c775a92121304b789e5e4a1a08a165aa" } new_table_name: "default.Table_ac5f0760d28c4ee7939c9fca1b369839" modify_external_catalogs: true
I20260619 19:54:21.895720 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_98009ff8de10458ab7ba699d2d89bea5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:21.896236 1200 tablet_bootstrap.cc:492] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:21.896247 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98009ff8de10458ab7ba699d2d89bea5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:21.901296 1200 tablet_bootstrap.cc:654] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.907411 1208 consensus_queue.cc:260] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.913832 1208 ts_tablet_manager.cc:1434] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.030s user 0.001s sys 0.000s
W20260619 19:54:21.914394 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 180c3fd33d854a06a7cfd2f9671557a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 180c3fd33d854a06a7cfd2f9671557a7 already in progress: creating tablet
I20260619 19:54:21.916105 3265 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260619 19:54:21.917116 1208 tablet_bootstrap.cc:492] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:21.921711 1208 tablet_bootstrap.cc:654] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.883911 897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35892 (request call id 825) took 1130 ms. Trace:
I20260619 19:54:21.892778 3313 tablet.cc:1724] T b6a468ca001340e98addf91dd3829efa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260619 19:54:21.908771 1201 tablet_bootstrap.cc:492] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:21.926774 1201 ts_tablet_manager.cc:1403] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.209s user 0.000s sys 0.020s
I20260619 19:54:21.927651 1201 raft_consensus.cc:359] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.927824 1201 raft_consensus.cc:385] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.927875 1201 raft_consensus.cc:740] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.928092 1201 consensus_queue.cc:260] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.928879 1201 ts_tablet_manager.cc:1434] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:21.929222 1201 tablet_bootstrap.cc:492] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:21.931257 1201 tablet_bootstrap.cc:654] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.932775 897 rpcz_store.cc:276] 0619 19:54:20.753412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:20.755185 (+ 1773us) service_pool.cc:224] Handling call
0619 19:54:20.807801 (+ 52616us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0619 19:54:20.807830 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0619 19:54:20.848251 (+ 40421us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:21.883770 (+1035519us) tablet_replica.cc:206] Creating consensus instance
0619 19:54:21.883900 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260619 19:54:21.939343 1200 tablet_bootstrap.cc:492] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:21.939499 1200 ts_tablet_manager.cc:1403] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.001s
I20260619 19:54:21.940271 1200 raft_consensus.cc:359] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.940433 1200 raft_consensus.cc:385] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.940483 1200 raft_consensus.cc:740] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.940673 1200 consensus_queue.cc:260] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.941143 3116 raft_consensus.cc:493] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:21.941197 1200 ts_tablet_manager.cc:1434] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:21.941502 1200 tablet_bootstrap.cc:492] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:21.941515 3116 raft_consensus.cc:515] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.943554 3116 leader_election.cc:290] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:21.943706 3116 raft_consensus.cc:493] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e78a44e2c8824fe7bce462e9d33f660c)
I20260619 19:54:21.943832 3116 raft_consensus.cc:515] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.944402 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4688dc20317479e9c80f6f41b3ea35e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:21.945771 858 leader_election.cc:343] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:21.946087 858 leader_election.cc:343] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: f8e48a3e5c1642f6b12adb0033f74404
I20260619 19:54:21.946517 3116 leader_election.cc:290] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:21.946749 1200 tablet_bootstrap.cc:654] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.946970 2026 tablet_replica.cc:333] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:21.947532 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4688dc20317479e9c80f6f41b3ea35e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:21.947997 1061 raft_consensus.cc:2468] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:21.948645 523 master_service.cc:960] ReplaceTablet: received request to replace tablet bdaa6ef43cab4cb384b92bd43c472901 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:21.949869 859 leader_election.cc:304] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:21.951608 859 leader_election.cc:343] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: f8e48a3e5c1642f6b12adb0033f74404
I20260619 19:54:21.951758 859 leader_election.cc:304] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:21.952042 2953 raft_consensus.cc:2804] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:21.952159 2953 raft_consensus.cc:493] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:21.952256 2953 raft_consensus.cc:3060] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.954140 1208 tablet_bootstrap.cc:492] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:21.954277 1208 ts_tablet_manager.cc:1403] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.002s
I20260619 19:54:21.955549 3276 raft_consensus.cc:2749] T f8e48a3e5c1642f6b12adb0033f74404 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:21.955073 2953 raft_consensus.cc:515] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.956359 1208 raft_consensus.cc:359] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.956509 1208 raft_consensus.cc:385] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:21.956565 2953 leader_election.cc:290] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:21.956581 1208 raft_consensus.cc:740] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:21.956811 1208 consensus_queue.cc:260] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.957163 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4688dc20317479e9c80f6f41b3ea35e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:21.957433 1208 ts_tablet_manager.cc:1434] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260619 19:54:21.957823 858 leader_election.cc:343] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:21.958949 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4688dc20317479e9c80f6f41b3ea35e" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:21.959272 1061 raft_consensus.cc:3060] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:21.960021 1208 tablet_bootstrap.cc:492] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:21.962150 1061 raft_consensus.cc:2468] T e4688dc20317479e9c80f6f41b3ea35e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:21.962615 859 leader_election.cc:304] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:21.962927 1208 tablet_bootstrap.cc:654] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:21.963225 2953 raft_consensus.cc:2804] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:21.963716 2953 raft_consensus.cc:697] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:21.964023 2953 consensus_queue.cc:237] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:21.970746 2026 raft_consensus.cc:2243] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:21.971004 2026 raft_consensus.cc:2272] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:21.971954 2026 ts_tablet_manager.cc:1916] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:21.981374 1208 tablet_bootstrap.cc:492] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
W20260619 19:54:21.983831 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81ee21d93cf744ff8dcad714ddb369a0 consensus state has no leader
I20260619 19:54:21.984210 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 7593abd3688249bbaa61e7b5869d9119 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:21.994568 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 50ed9bbd86a74801b2e9a4dad7bebc8c (DEFAULT_TABLE table=default.Table_a0720c15c0bb41ae86490f1009c0f32c [id=6e399dad3a144821b9d2ff04d53a51c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.995183 897 tablet_service.cc:1511] Processing CreateTablet for tablet 50ed9bbd86a74801b2e9a4dad7bebc8c (DEFAULT_TABLE table=default.Table_a0720c15c0bb41ae86490f1009c0f32c [id=6e399dad3a144821b9d2ff04d53a51c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:21.995659 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ed9bbd86a74801b2e9a4dad7bebc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.998009 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ed9bbd86a74801b2e9a4dad7bebc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.001462 885 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf4ec6b5ce44923b1e6b6f8b631e191 (DEFAULT_TABLE table=default.Table_7ff7d147fd6241d4881e6f30c1d38db5 [id=e9126b16aa3145d688caa7c01f525fdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.001892 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf4ec6b5ce44923b1e6b6f8b631e191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.003644 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf4ec6b5ce44923b1e6b6f8b631e191 (DEFAULT_TABLE table=default.Table_7ff7d147fd6241d4881e6f30c1d38db5 [id=e9126b16aa3145d688caa7c01f525fdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.004024 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf4ec6b5ce44923b1e6b6f8b631e191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.008574 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5eb4005068684928b3b27ff73b108d1b (table default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566]). Expected version 1 got 0
I20260619 19:54:22.009166 530 catalog_manager.cc:5696] T 10e01dc8f8cd43b59fe2bbbfa0a4db4c P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:22.009887 530 catalog_manager.cc:5696] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:22.010439 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet deba56eb121e4aa6b8ad7b13951723aa (table default.Table_eaefb5c915d34ab79e4f47c839fd0ade [id=2738114efd1f43d4a7f797f9b12f7398]). Expected version 2 got 0
I20260619 19:54:22.010986 530 catalog_manager.cc:5696] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:22.011962 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet fb26af8ab52d470f8bd1b7c42a57e8a3 (table default.Table_d22feccee94b4285b81dc207e65f5c50 [id=42dc873fe9774544ac2c64a38265e4aa]). Expected version 1 got 0
I20260619 19:54:22.028448 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca055ed83a400cb0cf1cb0ae9052d3 (DEFAULT_TABLE table=default.Table_12f3f767257c4504872f40fad9b28d1c [id=6b5cc665d7394f6da92cb2e13e62fa26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.029062 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca055ed83a400cb0cf1cb0ae9052d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.034507 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2e786ac0755744f89a5d418c6bbd505a (DEFAULT_TABLE table=default.Table_bf2690d8812e4532a142f1bae859938d [id=6a89602b9442413291d5d134c3f028d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.034978 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e786ac0755744f89a5d418c6bbd505a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.037196 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 9faffd96d2e34ed49545b34c47a33405 (DEFAULT_TABLE table=default.Table_9f36b5de86014245b17ba026519b4848 [id=7b89e9d00a724da6a4beb45b434b60b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.037674 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9faffd96d2e34ed49545b34c47a33405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.049196 885 tablet_service.cc:1511] Processing CreateTablet for tablet 2e786ac0755744f89a5d418c6bbd505a (DEFAULT_TABLE table=default.Table_bf2690d8812e4532a142f1bae859938d [id=6a89602b9442413291d5d134c3f028d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.049839 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e786ac0755744f89a5d418c6bbd505a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.057005 897 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca055ed83a400cb0cf1cb0ae9052d3 (DEFAULT_TABLE table=default.Table_12f3f767257c4504872f40fad9b28d1c [id=6b5cc665d7394f6da92cb2e13e62fa26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.057659 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca055ed83a400cb0cf1cb0ae9052d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.061998 530 catalog_manager.cc:5696] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:22.062552 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:22.062858 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5482cf46c91d426484938c387b785d61 (table default.Table_b2bc9c255ad74e7e8a590980701ed419 [id=fcf00dfcc0374847883336aee0a57d34]). Expected version 3 got 0
I20260619 19:54:22.063254 530 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:22.063578 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013] alter complete (version 3)
W20260619 19:54:22.067181 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b35985fed5949889ef6cd321ea38e7b consensus state has no leader
I20260619 19:54:22.083211 527 master_service.cc:960] ReplaceTablet: received request to replace tablet a2c5a1bc7b4243f19d08a27249e23a52 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:22.086009 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9faffd96d2e34ed49545b34c47a33405 (DEFAULT_TABLE table=default.Table_9f36b5de86014245b17ba026519b4848 [id=7b89e9d00a724da6a4beb45b434b60b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.086618 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9faffd96d2e34ed49545b34c47a33405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.099459 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d3a26aaf01ce4d99b77dcbad781234df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.100265 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3a26aaf01ce4d99b77dcbad781234df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.101058 1041 tablet_service.cc:1511] Processing CreateTablet for tablet a1895ede4fbc45fbbd17fc069cd8432b (DEFAULT_TABLE table=default.Table_b1f3a948deae4b969e1f0683be17b3ae [id=af8e118cd4cc4580aaa041f2cbf6656e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.101536 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1895ede4fbc45fbbd17fc069cd8432b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.103277 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e9360a87f5a4f8b990df38ad739a3c5" } modify_external_catalogs: true
I20260619 19:54:22.103456 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8e9360a87f5a4f8b990df38ad739a3c5" } modify_external_catalogs: true
I20260619 19:54:22.106491 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_bf2b7abe28794d908335b963f81ec478" } new_table_name: "default.Table_6720f780fcad48f9b0bc9390675fe25e" modify_external_catalogs: true
W20260619 19:54:22.109548 858 consensus_peers.cc:597] T b4f7122fa5f94eeaa3b99cae107d8c9a P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4f7122fa5f94eeaa3b99cae107d8c9a. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:22.101883 894 tablet_service.cc:1511] Processing CreateTablet for tablet a1895ede4fbc45fbbd17fc069cd8432b (DEFAULT_TABLE table=default.Table_b1f3a948deae4b969e1f0683be17b3ae [id=af8e118cd4cc4580aaa041f2cbf6656e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.110252 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1895ede4fbc45fbbd17fc069cd8432b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.113219 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 72afb5bbe996484ba77766a463ea15c8
I20260619 19:54:22.113735 526 catalog_manager.cc:6784] ReplaceTablet: tablet 72afb5bbe996484ba77766a463ea15c8 deleted and replaced by tablet 78aa3459aa9441bcae40a2412793c9a3
I20260619 19:54:22.115263 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 72afb5bbe996484ba77766a463ea15c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 78aa3459aa9441bcae40a2412793c9a3) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.118637 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 72afb5bbe996484ba77766a463ea15c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 78aa3459aa9441bcae40a2412793c9a3) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.119604 1201 tablet_bootstrap.cc:492] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.119835 1201 ts_tablet_manager.cc:1403] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.191s user 0.016s sys 0.025s
I20260619 19:54:22.120604 1201 raft_consensus.cc:359] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.120790 1201 raft_consensus.cc:385] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.120859 1201 raft_consensus.cc:740] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
W20260619 19:54:22.121025 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 72afb5bbe996484ba77766a463ea15c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72afb5bbe996484ba77766a463ea15c8 already in progress: creating tablet
I20260619 19:54:22.121079 1201 consensus_queue.cc:260] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.121780 1201 ts_tablet_manager.cc:1434] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:22.122090 1201 tablet_bootstrap.cc:492] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:22.125253 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 64cb1c0066ee4dd2b29692a980cb06bf (DEFAULT_TABLE table=default.Table_b8bd618a54364eb5878d8f234c13de38 [id=9962970d21144a4d86d3708009981b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.125459 894 tablet_service.cc:1511] Processing CreateTablet for tablet 64cb1c0066ee4dd2b29692a980cb06bf (DEFAULT_TABLE table=default.Table_b8bd618a54364eb5878d8f234c13de38 [id=9962970d21144a4d86d3708009981b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.125743 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cb1c0066ee4dd2b29692a980cb06bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.125824 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cb1c0066ee4dd2b29692a980cb06bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.128804 531 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_d22feccee94b4285b81dc207e65f5c50 [id=42dc873fe9774544ac2c64a38265e4aa] alter complete (version 1)
I20260619 19:54:22.130858 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.130934 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_64b88d70f39445c6bac0b310308d8fcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.131090 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d with delete_type TABLET_DATA_DELETED (replaced by tablet bb514fda80e64ac9abc147d9a6adce76) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.131292 1994 tablet_replica.cc:333] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:22.131467 1994 raft_consensus.cc:2243] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:22.131461 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a2c5a1bc7b4243f19d08a27249e23a52
I20260619 19:54:22.131682 1994 pending_rounds.cc:70] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:22.131743 1994 pending_rounds.cc:77] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657735944708096 op_type: NO_OP noop_request { }
I20260619 19:54:22.131827 1994 raft_consensus.cc:2889] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:22.131897 1994 raft_consensus.cc:2272] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.132088 527 catalog_manager.cc:6784] ReplaceTablet: tablet a2c5a1bc7b4243f19d08a27249e23a52 deleted and replaced by tablet 745c2ac28ff24969b778b5abd3f406af
I20260619 19:54:22.130858 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6763e5bd260242b7a4c12eaf6a57507f) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.132649 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet f39a95a0ac714de388ed04a8a14e4f6d
I20260619 19:54:22.133504 1994 ts_tablet_manager.cc:1916] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.135797 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet f39a95a0ac714de388ed04a8a14e4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.136307 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6543aece5236445180dd69790bffe6ad" } modify_external_catalogs: true
I20260619 19:54:22.136472 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6543aece5236445180dd69790bffe6ad" } modify_external_catalogs: true
I20260619 19:54:22.136852 895 tablet_service.cc:1558] Processing DeleteTablet for tablet a2c5a1bc7b4243f19d08a27249e23a52 with delete_type TABLET_DATA_DELETED (replaced by tablet 745c2ac28ff24969b778b5abd3f406af) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.136898 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet a2c5a1bc7b4243f19d08a27249e23a52 with delete_type TABLET_DATA_DELETED (replaced by tablet 745c2ac28ff24969b778b5abd3f406af) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.137084 888 tablet_service.cc:1558] Processing DeleteTablet for tablet f39a95a0ac714de388ed04a8a14e4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:22.139644 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64b88d70f39445c6bac0b310308d8fcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.142676 1994 ts_tablet_manager.cc:1929] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:22.142858 1994 log.cc:1199] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/056f7982f51f45a78d2b9b0a0b50576e
I20260619 19:54:22.143323 1994 ts_tablet_manager.cc:1950] T 056f7982f51f45a78d2b9b0a0b50576e P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:22.144501 1994 tablet_replica.cc:333] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:22.144479 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 056f7982f51f45a78d2b9b0a0b50576e (table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]) successfully deleted
I20260619 19:54:22.144830 1994 raft_consensus.cc:2243] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:22.145120 1994 pending_rounds.cc:70] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:22.145244 1994 pending_rounds.cc:77] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657737143947264 op_type: NO_OP noop_request { }
I20260619 19:54:22.145390 1994 raft_consensus.cc:2889] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:22.145505 1994 raft_consensus.cc:2272] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.145829 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d27b4fd6fd07484dac45acac41ef8dea" } modify_external_catalogs: true
I20260619 19:54:22.146068 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d27b4fd6fd07484dac45acac41ef8dea" } modify_external_catalogs: true
I20260619 19:54:22.146380 3116 raft_consensus.cc:493] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.146535 3116 raft_consensus.cc:515] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.147401 3116 leader_election.cc:290] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.148186 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbbdc92de4e40daa3b5c3dd98c4ee88" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:22.148353 1061 raft_consensus.cc:2468] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:22.148799 859 leader_election.cc:304] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:22.149089 1201 tablet_bootstrap.cc:654] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.150202 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_44e25fbf88e94d2bb49aac58c471ec46" } modify_external_catalogs: true
I20260619 19:54:22.150440 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_44e25fbf88e94d2bb49aac58c471ec46" } modify_external_catalogs: true
I20260619 19:54:22.152055 3116 raft_consensus.cc:2804] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.152006 888 tablet_service.cc:1511] Processing CreateTablet for tablet 16c76f02f08245fab608f34498b56f6a (DEFAULT_TABLE table=default.Table_87bdea79784342679a1c2fb1d32fd1c7 [id=3096511cc129479c83fbe07b8fec3f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.152148 3116 raft_consensus.cc:493] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.152232 3116 raft_consensus.cc:3060] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.152457 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c76f02f08245fab608f34498b56f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.154923 3116 raft_consensus.cc:515] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.156352 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_bce503f02a3a4c269e0776c21978ae75" } new_table_name: "default.Table_311d779252514f428548401e67fc57b6" modify_external_catalogs: true
I20260619 19:54:22.159828 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa25320a7264a38bd19bc5a2cfcf5a8 (DEFAULT_TABLE table=default.Table_3142a60be0ce424e82d2af0d4e63c80e [id=a064aaf327064d80863502eb8015c6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.160327 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa25320a7264a38bd19bc5a2cfcf5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.161839 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa25320a7264a38bd19bc5a2cfcf5a8 (DEFAULT_TABLE table=default.Table_3142a60be0ce424e82d2af0d4e63c80e [id=a064aaf327064d80863502eb8015c6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.162221 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa25320a7264a38bd19bc5a2cfcf5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.166599 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:22.167057 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 16c76f02f08245fab608f34498b56f6a (DEFAULT_TABLE table=default.Table_87bdea79784342679a1c2fb1d32fd1c7 [id=3096511cc129479c83fbe07b8fec3f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.167480 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c76f02f08245fab608f34498b56f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.169421 895 tablet_service.cc:1511] Processing CreateTablet for tablet e0e703d1c5144ba58f05e7f6922e3891 (DEFAULT_TABLE table=default.Table_0ef6a0ce90c54a00b62b75830829d925 [id=30b1384dad0e4978ae2e1b1baf2ebda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.169819 885 tablet_service.cc:1511] Processing CreateTablet for tablet a40c0a624c4d45608cd17d7e8dc9b274 (DEFAULT_TABLE table=default.Table_2300ea60526241559237eec272c8c895 [id=414753e19ac848dfb832b89fd6ea706f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.169963 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e703d1c5144ba58f05e7f6922e3891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.170187 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40c0a624c4d45608cd17d7e8dc9b274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.174567 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e0e703d1c5144ba58f05e7f6922e3891 (DEFAULT_TABLE table=default.Table_0ef6a0ce90c54a00b62b75830829d925 [id=30b1384dad0e4978ae2e1b1baf2ebda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.174933 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e703d1c5144ba58f05e7f6922e3891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.176159 2026 ts_tablet_manager.cc:1929] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:22.176282 2026 log.cc:1199] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/3ae6164970ec4977a8c0c9fd24ab7275
I20260619 19:54:22.176573 2026 ts_tablet_manager.cc:1950] T 3ae6164970ec4977a8c0c9fd24ab7275 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.179701 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a40c0a624c4d45608cd17d7e8dc9b274 (DEFAULT_TABLE table=default.Table_2300ea60526241559237eec272c8c895 [id=414753e19ac848dfb832b89fd6ea706f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.179801 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 425) took 13507 ms. Trace:
I20260619 19:54:22.179879 2026 rpcz_store.cc:276] 0619 19:54:08.671947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.671996 (+ 49us) service_pool.cc:224] Handling call
0619 19:54:21.946919 (+13274923us) ts_tablet_manager.cc:1151] Deleting tablet 3ae6164970ec4977a8c0c9fd24ab7275
0619 19:54:21.946931 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.139502 (+192571us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.176080 (+ 36578us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.179778 (+ 3698us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13274748}
I20260619 19:54:22.180083 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40c0a624c4d45608cd17d7e8dc9b274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.180442 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 3ae6164970ec4977a8c0c9fd24ab7275 (table default.Table_58686549f5974cedb2fc3a15c08d9207 [id=19f4b9169a634b9d8fc0212981f18682]) successfully deleted
I20260619 19:54:22.180832 2026 tablet_replica.cc:333] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.181025 2026 raft_consensus.cc:2243] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.181180 2026 raft_consensus.cc:2272] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.181463 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:22.181671 2026 ts_tablet_manager.cc:1916] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.182253 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (table default.Table_2e742d603b764daa86e93b4018379875 [id=33e3d383660b422582a47dcb68ae6be7]). Expected version 1 got 0
I20260619 19:54:22.182565 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:22.182796 528 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet deba56eb121e4aa6b8ad7b13951723aa (table default.Table_eaefb5c915d34ab79e4f47c839fd0ade [id=2738114efd1f43d4a7f797f9b12f7398]). Expected version 2 got 0
I20260619 19:54:22.183840 1201 tablet_bootstrap.cc:492] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.184026 1201 ts_tablet_manager.cc:1403] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20260619 19:54:22.184819 1201 raft_consensus.cc:359] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.185051 1201 raft_consensus.cc:385] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.185164 1201 raft_consensus.cc:740] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.185438 1201 consensus_queue.cc:260] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.186143 1201 ts_tablet_manager.cc:1434] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:22.186466 1201 tablet_bootstrap.cc:492] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:22.186785 3302 consensus_queue.cc:1048] T 6532bdfd3c844ff2a25bee6ff1e0c25e P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:22.187004 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d with delete_type TABLET_DATA_DELETED (replaced by tablet bb514fda80e64ac9abc147d9a6adce76) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.188380 1201 tablet_bootstrap.cc:654] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.191007 1037 tablet_service.cc:1511] Processing CreateTablet for tablet e6bd572030c84dafa0747fabfa61c947 (DEFAULT_TABLE table=default.Table_4b0c0d9ef5a54d95930c855193a5669e [id=96a834246943495b8b4b0d7ad5011fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.191118 888 tablet_service.cc:1511] Processing CreateTablet for tablet e6bd572030c84dafa0747fabfa61c947 (DEFAULT_TABLE table=default.Table_4b0c0d9ef5a54d95930c855193a5669e [id=96a834246943495b8b4b0d7ad5011fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.191459 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd572030c84dafa0747fabfa61c947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.191733 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd572030c84dafa0747fabfa61c947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.199239 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbbdc92de4e40daa3b5c3dd98c4ee88" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:22.199426 1061 raft_consensus.cc:3060] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.199594 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 28e463032d0744cc88d011accbebfe1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:07 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.201839 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6a13e6e937644610bc1fdc20c4ca45dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.202220 1061 raft_consensus.cc:2468] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:22.202566 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a13e6e937644610bc1fdc20c4ca45dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.203496 859 leader_election.cc:304] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:22.204830 3290 raft_consensus.cc:2804] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:22.204955 3290 raft_consensus.cc:697] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:22.205183 3290 consensus_queue.cc:237] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.208747 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet bdaa6ef43cab4cb384b92bd43c472901
I20260619 19:54:22.209373 523 catalog_manager.cc:6784] ReplaceTablet: tablet bdaa6ef43cab4cb384b92bd43c472901 deleted and replaced by tablet 6dc77500e1774e3dafb9d7fe4d20f9f8
I20260619 19:54:22.209553 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet bdaa6ef43cab4cb384b92bd43c472901 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dc77500e1774e3dafb9d7fe4d20f9f8) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.210919 1037 tablet_service.cc:1511] Processing CreateTablet for tablet a5a5bd2765c24092a791f8f29c477f66 (DEFAULT_TABLE table=default.Table_006ae61ee68148499fe17d7317cbb2f9 [id=c210415343d64a1db93a298b798c9249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.211477 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a5bd2765c24092a791f8f29c477f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.215385 3116 leader_election.cc:290] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.217165 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_90f44db33056470a9a5f6623abe6f491" } modify_external_catalogs: true
I20260619 19:54:22.217470 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_90f44db33056470a9a5f6623abe6f491" } modify_external_catalogs: true
I20260619 19:54:22.226042 890 tablet_service.cc:1511] Processing CreateTablet for tablet 953d7b48670e4b54b9489ff679f248ec (DEFAULT_TABLE table=default.Table_ee5db39ab80c471994b4634a3071ec26 [id=4889225f55ce427581c15d30f98c4367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.226547 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d7b48670e4b54b9489ff679f248ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.227603 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 7593abd3688249bbaa61e7b5869d9119
I20260619 19:54:22.228247 529 catalog_manager.cc:6784] ReplaceTablet: tablet 7593abd3688249bbaa61e7b5869d9119 deleted and replaced by tablet 4f6f5c5dd6e948faacd96f75ef59e00e
I20260619 19:54:22.228703 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_4753eef8eb3a46d7b44782fdb93fda9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.229432 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4753eef8eb3a46d7b44782fdb93fda9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.231719 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 7593abd3688249bbaa61e7b5869d9119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f6f5c5dd6e948faacd96f75ef59e00e) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.233708 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 7593abd3688249bbaa61e7b5869d9119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f6f5c5dd6e948faacd96f75ef59e00e) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.234278 895 tablet_service.cc:1511] Processing CreateTablet for tablet a5a5bd2765c24092a791f8f29c477f66 (DEFAULT_TABLE table=default.Table_006ae61ee68148499fe17d7317cbb2f9 [id=c210415343d64a1db93a298b798c9249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.234800 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a5bd2765c24092a791f8f29c477f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.239066 3313 tablet.cc:1724] T deba56eb121e4aa6b8ad7b13951723aa P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:22.242817 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 953d7b48670e4b54b9489ff679f248ec (DEFAULT_TABLE table=default.Table_ee5db39ab80c471994b4634a3071ec26 [id=4889225f55ce427581c15d30f98c4367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.243257 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d7b48670e4b54b9489ff679f248ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:22.245316 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24c05500f1904adf966de2ea644a21d0 consensus state has no leader
I20260619 19:54:22.245805 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3157ee54d08c4af5bb47202a85f9e9e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.246371 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3157ee54d08c4af5bb47202a85f9e9e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.247740 897 tablet_service.cc:1558] Processing DeleteTablet for tablet bdaa6ef43cab4cb384b92bd43c472901 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dc77500e1774e3dafb9d7fe4d20f9f8) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.253377 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_6b0e7c1abd8f4f6680e74faf06b14ea0" } new_table_name: "default.Table_b695fc8e36c5493a8ccde55bd0698408" modify_external_catalogs: true
I20260619 19:54:22.255537 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.261236 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 58635330cf29425bbafea95e64bdfbb9
I20260619 19:54:22.259109 897 tablet_service.cc:1511] Processing CreateTablet for tablet efdf87fbfee44173848c897d4da1809c (DEFAULT_TABLE table=default.Table_c64303b220974c23978cdf674133e2d7 [id=0fcd3cdc60cd4c33bc173c67273891f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.262144 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdf87fbfee44173848c897d4da1809c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.262297 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 58635330cf29425bbafea95e64bdfbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.262648 885 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9a90e0e93d4a4c99e41a12ea074706 (DEFAULT_TABLE table=default.Table_88df92ce495f4e90ae2deeec4485d7ab [id=3311b69249294f81a7865e52bb7e34d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.262997 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9a90e0e93d4a4c99e41a12ea074706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.263473 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9a90e0e93d4a4c99e41a12ea074706 (DEFAULT_TABLE table=default.Table_88df92ce495f4e90ae2deeec4485d7ab [id=3311b69249294f81a7865e52bb7e34d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.263913 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9a90e0e93d4a4c99e41a12ea074706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.263787 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f243ecb13f294d2e8afd196e7cbefb2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.264333 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f243ecb13f294d2e8afd196e7cbefb2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.267555 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 58635330cf29425bbafea95e64bdfbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.268002 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 17167acdefb54c249663303e8ced2c0f (DEFAULT_TABLE table=default.Table_bba4acb0fbc1418f8d54d8849fab23e2 [id=057e6d9f0286430eabe3c299fba0eb60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.268384 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17167acdefb54c249663303e8ced2c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.269769 2026 ts_tablet_manager.cc:1929] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:22.269886 2026 log.cc:1199] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d895be304fcf445e9a4d2d8242becdd5
I20260619 19:54:22.270186 2026 ts_tablet_manager.cc:1950] T d895be304fcf445e9a4d2d8242becdd5 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.273533 1041 tablet_service.cc:1511] Processing CreateTablet for tablet efdf87fbfee44173848c897d4da1809c (DEFAULT_TABLE table=default.Table_c64303b220974c23978cdf674133e2d7 [id=0fcd3cdc60cd4c33bc173c67273891f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.273869 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ee64505bfcdf49b5820754cbbf822165
I20260619 19:54:22.274567 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdf87fbfee44173848c897d4da1809c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.274837 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_6e095d021cab4f88a830883e0542f165"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.275645 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e095d021cab4f88a830883e0542f165 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:22.283015 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d6fa17f0fb0426d87c26840e9760f80 consensus state has no leader
I20260619 19:54:22.283419 890 tablet_service.cc:1558] Processing DeleteTablet for tablet ee64505bfcdf49b5820754cbbf822165 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.283685 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet ee64505bfcdf49b5820754cbbf822165 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.283610 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2529830b430142c7b8ec4b4044aeefe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.284237 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2529830b430142c7b8ec4b4044aeefe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.286978 890 tablet_service.cc:1511] Processing CreateTablet for tablet 741a031cf1cd4b6d8bc5e4bf57dbc97e (DEFAULT_TABLE table=default.Table_e393cb60e992410aba1eb02e3ddcf790 [id=ac93940cb8844761985c3ff07875c8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.287488 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741a031cf1cd4b6d8bc5e4bf57dbc97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.259110 888 tablet_service.cc:1511] Processing CreateTablet for tablet 17167acdefb54c249663303e8ced2c0f (DEFAULT_TABLE table=default.Table_bba4acb0fbc1418f8d54d8849fab23e2 [id=057e6d9f0286430eabe3c299fba0eb60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.292464 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 741a031cf1cd4b6d8bc5e4bf57dbc97e (DEFAULT_TABLE table=default.Table_e393cb60e992410aba1eb02e3ddcf790 [id=ac93940cb8844761985c3ff07875c8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.292935 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741a031cf1cd4b6d8bc5e4bf57dbc97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:21.995183 750 tablet_service.cc:1511] Processing CreateTablet for tablet 50ed9bbd86a74801b2e9a4dad7bebc8c (DEFAULT_TABLE table=default.Table_a0720c15c0bb41ae86490f1009c0f32c [id=6e399dad3a144821b9d2ff04d53a51c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.294659 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ed9bbd86a74801b2e9a4dad7bebc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.003636 759 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf4ec6b5ce44923b1e6b6f8b631e191 (DEFAULT_TABLE table=default.Table_7ff7d147fd6241d4881e6f30c1d38db5 [id=e9126b16aa3145d688caa7c01f525fdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.295387 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf4ec6b5ce44923b1e6b6f8b631e191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.296679 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17167acdefb54c249663303e8ced2c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.021667 748 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca055ed83a400cb0cf1cb0ae9052d3 (DEFAULT_TABLE table=default.Table_12f3f767257c4504872f40fad9b28d1c [id=6b5cc665d7394f6da92cb2e13e62fa26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.032594 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2e786ac0755744f89a5d418c6bbd505a (DEFAULT_TABLE table=default.Table_bf2690d8812e4532a142f1bae859938d [id=6a89602b9442413291d5d134c3f028d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.033329 3123 raft_consensus.cc:493] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.036396 752 tablet_service.cc:1511] Processing CreateTablet for tablet 9faffd96d2e34ed49545b34c47a33405 (DEFAULT_TABLE table=default.Table_9f36b5de86014245b17ba026519b4848 [id=7b89e9d00a724da6a4beb45b434b60b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.299580 3123 raft_consensus.cc:515] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.300403 3123 leader_election.cc:290] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.041133 3248 raft_consensus.cc:493] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.300581 3248 raft_consensus.cc:515] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.300843 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ecd267aa34469cad9db0745178013b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:22.301036 910 raft_consensus.cc:2468] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 0.
I20260619 19:54:22.301241 3248 leader_election.cc:290] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.100072 754 tablet_service.cc:1511] Processing CreateTablet for tablet a1895ede4fbc45fbbd17fc069cd8432b (DEFAULT_TABLE table=default.Table_b1f3a948deae4b969e1f0683be17b3ae [id=af8e118cd4cc4580aaa041f2cbf6656e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.115518 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 72afb5bbe996484ba77766a463ea15c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 78aa3459aa9441bcae40a2412793c9a3) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.301604 719 leader_election.cc:304] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:22.301707 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 7593abd3688249bbaa61e7b5869d9119 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f6f5c5dd6e948faacd96f75ef59e00e) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.302125 749 tablet_service.cc:1511] Processing CreateTablet for tablet 17167acdefb54c249663303e8ced2c0f (DEFAULT_TABLE table=default.Table_bba4acb0fbc1418f8d54d8849fab23e2 [id=057e6d9f0286430eabe3c299fba0eb60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.127065 756 tablet_service.cc:1511] Processing CreateTablet for tablet 64cb1c0066ee4dd2b29692a980cb06bf (DEFAULT_TABLE table=default.Table_b8bd618a54364eb5878d8f234c13de38 [id=9962970d21144a4d86d3708009981b2c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:22.302429 720 leader_election.cc:343] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 32ecd267aa34469cad9db0745178013b
I20260619 19:54:22.135953 764 tablet_service.cc:1558] Processing DeleteTablet for tablet a2c5a1bc7b4243f19d08a27249e23a52 with delete_type TABLET_DATA_DELETED (replaced by tablet 745c2ac28ff24969b778b5abd3f406af) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.302831 764 tablet_service.cc:1511] Processing CreateTablet for tablet efdf87fbfee44173848c897d4da1809c (DEFAULT_TABLE table=default.Table_c64303b220974c23978cdf674133e2d7 [id=0fcd3cdc60cd4c33bc173c67273891f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:22.303437 720 leader_election.cc:343] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 3ae6164970ec4977a8c0c9fd24ab7275
W20260619 19:54:22.303660 719 leader_election.cc:343] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 3ae6164970ec4977a8c0c9fd24ab7275
I20260619 19:54:22.303737 719 leader_election.cc:304] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:22.136008 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f39a95a0ac714de388ed04a8a14e4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.307556 758 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9a90e0e93d4a4c99e41a12ea074706 (DEFAULT_TABLE table=default.Table_88df92ce495f4e90ae2deeec4485d7ab [id=3311b69249294f81a7865e52bb7e34d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.136161 765 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f7122fa5f94eeaa3b99cae107d8c9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.308005 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 58635330cf29425bbafea95e64bdfbb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.308408 765 tablet_service.cc:1511] Processing CreateTablet for tablet 741a031cf1cd4b6d8bc5e4bf57dbc97e (DEFAULT_TABLE table=default.Table_e393cb60e992410aba1eb02e3ddcf790 [id=ac93940cb8844761985c3ff07875c8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.136224 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b18a61d955e4929998b90c6c8fa844e with delete_type TABLET_DATA_DELETED (replaced by tablet ca02c454eec840eb9289950b6da7b131) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.147852 760 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa25320a7264a38bd19bc5a2cfcf5a8 (DEFAULT_TABLE table=default.Table_3142a60be0ce424e82d2af0d4e63c80e [id=a064aaf327064d80863502eb8015c6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.308671 751 tablet_service.cc:1558] Processing DeleteTablet for tablet ee64505bfcdf49b5820754cbbf822165 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.150005 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbbdc92de4e40daa3b5c3dd98c4ee88" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:22.154901 757 tablet_service.cc:1511] Processing CreateTablet for tablet 16c76f02f08245fab608f34498b56f6a (DEFAULT_TABLE table=default.Table_87bdea79784342679a1c2fb1d32fd1c7 [id=3096511cc129479c83fbe07b8fec3f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.164564 753 tablet_service.cc:1511] Processing CreateTablet for tablet a40c0a624c4d45608cd17d7e8dc9b274 (DEFAULT_TABLE table=default.Table_2300ea60526241559237eec272c8c895 [id=414753e19ac848dfb832b89fd6ea706f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.171433 746 tablet_service.cc:1511] Processing CreateTablet for tablet e0e703d1c5144ba58f05e7f6922e3891 (DEFAULT_TABLE table=default.Table_0ef6a0ce90c54a00b62b75830829d925 [id=30b1384dad0e4978ae2e1b1baf2ebda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.171782 761 tablet_service.cc:1511] Processing CreateTablet for tablet e6bd572030c84dafa0747fabfa61c947 (DEFAULT_TABLE table=default.Table_4b0c0d9ef5a54d95930c855193a5669e [id=96a834246943495b8b4b0d7ad5011fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.191008 762 tablet_service.cc:1511] Processing CreateTablet for tablet a5a5bd2765c24092a791f8f29c477f66 (DEFAULT_TABLE table=default.Table_006ae61ee68148499fe17d7317cbb2f9 [id=c210415343d64a1db93a298b798c9249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.213220 763 tablet_service.cc:1558] Processing DeleteTablet for tablet bdaa6ef43cab4cb384b92bd43c472901 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dc77500e1774e3dafb9d7fe4d20f9f8) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.219955 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbbdc92de4e40daa3b5c3dd98c4ee88" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.224615 747 tablet_service.cc:1511] Processing CreateTablet for tablet 953d7b48670e4b54b9489ff679f248ec (DEFAULT_TABLE table=default.Table_ee5db39ab80c471994b4634a3071ec26 [id=4889225f55ce427581c15d30f98c4367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.240649 3339 tablet.cc:1724] T deba56eb121e4aa6b8ad7b13951723aa P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:22.311807 763 tablet_service.cc:1511] Processing CreateTablet for tablet c0ffb9cdcc054f12acdc65bf82626f6b (DEFAULT_TABLE table=default.Table_89cd88f2d88d4d80922912884ea10e91 [id=1e849b99b4ad45ec8527119b940f7be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.313791 3248 raft_consensus.cc:2804] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.313907 3248 raft_consensus.cc:493] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.313987 3248 raft_consensus.cc:3060] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.316607 3248 raft_consensus.cc:515] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.317358 3248 leader_election.cc:290] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.317507 3248 raft_consensus.cc:2749] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:22.318594 1973 tablet_replica.cc:333] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:22.318652 895 tablet_service.cc:1511] Processing CreateTablet for tablet c0ffb9cdcc054f12acdc65bf82626f6b (DEFAULT_TABLE table=default.Table_89cd88f2d88d4d80922912884ea10e91 [id=1e849b99b4ad45ec8527119b940f7be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.318787 1973 raft_consensus.cc:2243] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:22.319003 1973 pending_rounds.cc:70] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Trying to abort 1 pending ops.
I20260619 19:54:22.319097 1973 pending_rounds.cc:77] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657737187962880 op_type: NO_OP noop_request { }
I20260619 19:54:22.319227 1973 raft_consensus.cc:2889] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:22.319317 1973 raft_consensus.cc:2272] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.319931 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ffb9cdcc054f12acdc65bf82626f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.321481 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32ecd267aa34469cad9db0745178013b" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
W20260619 19:54:22.321565 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 72afb5bbe996484ba77766a463ea15c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72afb5bbe996484ba77766a463ea15c8 already in progress: creating tablet
I20260619 19:54:22.321695 910 raft_consensus.cc:3060] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:22.321848 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 7593abd3688249bbaa61e7b5869d9119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7593abd3688249bbaa61e7b5869d9119 already in progress: creating tablet
W20260619 19:54:22.322100 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet a2c5a1bc7b4243f19d08a27249e23a52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2c5a1bc7b4243f19d08a27249e23a52 already in progress: creating tablet
W20260619 19:54:22.322289 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet f39a95a0ac714de388ed04a8a14e4f6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f39a95a0ac714de388ed04a8a14e4f6d already in progress: creating tablet
W20260619 19:54:22.322468 518 catalog_manager.cc:4994] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet b4f7122fa5f94eeaa3b99cae107d8c9a because the tablet was not found. No further retry: Not found: Tablet not found: b4f7122fa5f94eeaa3b99cae107d8c9a
W20260619 19:54:22.322630 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 58635330cf29425bbafea95e64bdfbb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58635330cf29425bbafea95e64bdfbb9 already in progress: creating tablet
I20260619 19:54:22.323282 1973 ts_tablet_manager.cc:1916] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:22.324054 858 leader_election.cc:343] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:22.324432 858 leader_election.cc:343] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.324487 910 raft_consensus.cc:2468] T 32ecd267aa34469cad9db0745178013b P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1f5f240547f42ec82f57e6c8af5ea89 in term 1.
I20260619 19:54:22.324958 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953d7b48670e4b54b9489ff679f248ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.325173 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a5bd2765c24092a791f8f29c477f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.325380 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e786ac0755744f89a5d418c6bbd505a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.325675 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9faffd96d2e34ed49545b34c47a33405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.325990 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1895ede4fbc45fbbd17fc069cd8432b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.326156 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdf87fbfee44173848c897d4da1809c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.326794 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40c0a624c4d45608cd17d7e8dc9b274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.327339 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cb1c0066ee4dd2b29692a980cb06bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.327636 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca055ed83a400cb0cf1cb0ae9052d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.333811 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 426) took 13622 ms. Trace:
I20260619 19:54:22.333937 2026 rpcz_store.cc:276] 0619 19:54:08.711120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:08.711601 (+ 481us) service_pool.cc:224] Handling call
0619 19:54:22.180787 (+13469186us) ts_tablet_manager.cc:1151] Deleting tablet d895be304fcf445e9a4d2d8242becdd5
0619 19:54:22.180794 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.254274 (+ 73480us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.269716 (+ 15442us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.333776 (+ 64060us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13468947}
I20260619 19:54:22.334527 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d895be304fcf445e9a4d2d8242becdd5 (table default.Table_9fa831d3fbc74033a57818cdf0c65c72 [id=f097182abb8d4815befec43f3b218b90]) successfully deleted
I20260619 19:54:22.340724 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741a031cf1cd4b6d8bc5e4bf57dbc97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.343267 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17167acdefb54c249663303e8ced2c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.343586 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16c76f02f08245fab608f34498b56f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.347312 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bd572030c84dafa0747fabfa61c947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.347577 746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e703d1c5144ba58f05e7f6922e3891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.348800 890 tablet_service.cc:1511] Processing CreateTablet for tablet c89481b6c4a3463bac89cf602f4ef863 (DEFAULT_TABLE table=default.Table_76beaec437ad4eadab6de9dadd1c20cc [id=7fb00678465b4e54a768b384c0223002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.349193 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89481b6c4a3463bac89cf602f4ef863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.351656 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa25320a7264a38bd19bc5a2cfcf5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.355293 2026 tablet_replica.cc:333] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.355430 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9a90e0e93d4a4c99e41a12ea074706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.355530 2026 raft_consensus.cc:2243] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.355666 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ffb9cdcc054f12acdc65bf82626f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.355715 2026 raft_consensus.cc:2272] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.356243 719 leader_election.cc:304] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:22.356492 3123 raft_consensus.cc:2804] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:22.356585 3123 raft_consensus.cc:697] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Becoming Leader. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Running, Role: LEADER
I20260619 19:54:22.356789 3123 consensus_queue.cc:237] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.360952 2026 ts_tablet_manager.cc:1916] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:22.363359 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca61a86710004d7fae9d4b012ed71ba1 consensus state has no leader
I20260619 19:54:22.363890 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 140de873b1094bf4ac9fa29507722300
I20260619 19:54:22.364420 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ca38ddcae2624dd78470cd6754a48a56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.364593 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f2841116a1194e7b970b38e4beabd0c9" } new_table_name: "default.Table_0df37343d9af44a68dc8772d1092a6f3" modify_external_catalogs: true
I20260619 19:54:22.364827 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 140de873b1094bf4ac9fa29507722300 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:22.365039 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca38ddcae2624dd78470cd6754a48a56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.366222 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_64418f1228984a90b955d7914dc37eaf" } new_table_name: "default.Table_118b6ae74dae452e9a9312ee67790835" modify_external_catalogs: true
I20260619 19:54:22.366299 527 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 226b636ca31f40138488d4fc2c85358a
I20260619 19:54:22.367604 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1af8c578eef1461093d09e3c7c8724d1" } modify_external_catalogs: true
I20260619 19:54:22.368271 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1af8c578eef1461093d09e3c7c8724d1" } modify_external_catalogs: true
I20260619 19:54:22.370589 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_d82892edc1b64e63be683298591749d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.371153 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d82892edc1b64e63be683298591749d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.372887 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_daa000613964454db46ad8b5388cb7f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.372512 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4c083c79425343a08cbcf7064ef16b75 (DEFAULT_TABLE table=default.Table_7c2ee589217a4ed3a15f54172620b40f [id=36618fb0cbe14e4c8be462370250abf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.378908 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c083c79425343a08cbcf7064ef16b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.386020 746 tablet_service.cc:1558] Processing DeleteTablet for tablet 140de873b1094bf4ac9fa29507722300 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.386559 760 tablet_service.cc:1511] Processing CreateTablet for tablet 14e56d4deaa7466aad055f99f9958ab0 (DEFAULT_TABLE table=default.Table_639a2214cb334e2ea654335eece0cae1 [id=a6dad8de75884c538f556beb52f14150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.387029 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e56d4deaa7466aad055f99f9958ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.387382 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 226b636ca31f40138488d4fc2c85358a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.388599 757 tablet_service.cc:1511] Processing CreateTablet for tablet c89481b6c4a3463bac89cf602f4ef863 (DEFAULT_TABLE table=default.Table_76beaec437ad4eadab6de9dadd1c20cc [id=7fb00678465b4e54a768b384c0223002]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:22.389374 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daa000613964454db46ad8b5388cb7f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.390450 756 tablet_service.cc:1511] Processing CreateTablet for tablet 4c083c79425343a08cbcf7064ef16b75 (DEFAULT_TABLE table=default.Table_7c2ee589217a4ed3a15f54172620b40f [id=36618fb0cbe14e4c8be462370250abf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.390833 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89481b6c4a3463bac89cf602f4ef863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.392294 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c083c79425343a08cbcf7064ef16b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.392580 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet deba56eb121e4aa6b8ad7b13951723aa (table default.Table_eaefb5c915d34ab79e4f47c839fd0ade [id=2738114efd1f43d4a7f797f9b12f7398]). Expected version 2 got 0
I20260619 19:54:22.394309 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:22.395126 528 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_eec88df8f25c46658bbd65c3076678bb [id=394d8c70bca54b0eb32990278e06cd91] alter complete (version 5)
I20260619 19:54:22.396746 890 tablet_service.cc:1511] Processing CreateTablet for tablet 14e56d4deaa7466aad055f99f9958ab0 (DEFAULT_TABLE table=default.Table_639a2214cb334e2ea654335eece0cae1 [id=a6dad8de75884c538f556beb52f14150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.398769 765 tablet_service.cc:1511] Processing CreateTablet for tablet 80f573122e1a4c2ba6425847ca86d94e (DEFAULT_TABLE table=default.Table_e39afedbe59f4303b26bc6217453a187 [id=f376e537cf2c439e9b4db92fd4d6eae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.399233 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f573122e1a4c2ba6425847ca86d94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.400394 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e56d4deaa7466aad055f99f9958ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.407234 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 226b636ca31f40138488d4fc2c85358a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.411779 895 tablet_service.cc:1511] Processing CreateTablet for tablet 80f573122e1a4c2ba6425847ca86d94e (DEFAULT_TABLE table=default.Table_e39afedbe59f4303b26bc6217453a187 [id=f376e537cf2c439e9b4db92fd4d6eae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.413478 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f573122e1a4c2ba6425847ca86d94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.426890 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8430e94c48974dc385ef26699263bf28 (DEFAULT_TABLE table=default.Table_0aeed027a93f49b6952c63c85c9a8238 [id=9fbdd54d8fcd40bb9e4502090cc8e120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.428233 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8430e94c48974dc385ef26699263bf28 (DEFAULT_TABLE table=default.Table_0aeed027a93f49b6952c63c85c9a8238 [id=9fbdd54d8fcd40bb9e4502090cc8e120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.432516 756 tablet_service.cc:1511] Processing CreateTablet for tablet a87d724719094fa6a594790adbf6d2c5 (DEFAULT_TABLE table=default.Table_171c4100b2f6490c8885fc92c64a08ea [id=4641f3aa23474501b4363ea746eacd9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.433683 1994 ts_tablet_manager.cc:1916] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.437659 1208 ts_tablet_manager.cc:1403] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.478s user 0.004s sys 0.002s
I20260619 19:54:22.438485 1208 raft_consensus.cc:359] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.438809 1208 raft_consensus.cc:385] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.438887 1208 raft_consensus.cc:740] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.439111 1208 consensus_queue.cc:260] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.441804 3116 raft_consensus.cc:493] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.442153 3116 raft_consensus.cc:515] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.443117 3116 leader_election.cc:290] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.443904 1200 tablet_bootstrap.cc:492] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:22.444401 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73029f4bc97349da9d5d2fae4321cd5f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:22.444631 785 raft_consensus.cc:2468] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:22.445190 858 leader_election.cc:304] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89; no voters:
I20260619 19:54:22.445621 3116 raft_consensus.cc:2804] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.445720 3116 raft_consensus.cc:493] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.445814 3116 raft_consensus.cc:3060] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.445614 1200 ts_tablet_manager.cc:1403] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.504s user 0.089s sys 0.156s
I20260619 19:54:22.450078 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f243ecb13f294d2e8afd196e7cbefb2c" } new_table_name: "default.Table_d5eccea1d0de456b83b311d7f6d1bb67" modify_external_catalogs: true
I20260619 19:54:22.456429 1200 raft_consensus.cc:359] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.459120 1200 raft_consensus.cc:385] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.459903 1200 raft_consensus.cc:740] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.461948 3404 raft_consensus.cc:493] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.463649 3404 raft_consensus.cc:515] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.464962 3404 leader_election.cc:290] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.468911 1208 ts_tablet_manager.cc:1434] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260619 19:54:22.469237 1208 tablet_bootstrap.cc:492] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:22.474431 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d724719094fa6a594790adbf6d2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.478370 1973 ts_tablet_manager.cc:1929] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:22.478518 1973 log.cc:1199] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/1b18a61d955e4929998b90c6c8fa844e
I20260619 19:54:22.478866 1973 ts_tablet_manager.cc:1950] T 1b18a61d955e4929998b90c6c8fa844e P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:22.481602 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8430e94c48974dc385ef26699263bf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.467092 1201 tablet_bootstrap.cc:492] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.482048 1201 ts_tablet_manager.cc:1403] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.296s user 0.016s sys 0.000s
I20260619 19:54:22.482823 1201 raft_consensus.cc:359] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.482998 1201 raft_consensus.cc:385] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.483044 1201 raft_consensus.cc:740] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.483242 1201 consensus_queue.cc:260] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.483721 1201 ts_tablet_manager.cc:1434] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:22.484010 1201 tablet_bootstrap.cc:492] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:22.485530 1201 tablet_bootstrap.cc:654] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.488670 894 tablet_service.cc:1511] Processing CreateTablet for tablet a87d724719094fa6a594790adbf6d2c5 (DEFAULT_TABLE table=default.Table_171c4100b2f6490c8885fc92c64a08ea [id=4641f3aa23474501b4363ea746eacd9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.495266 1208 tablet_bootstrap.cc:654] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.481637 1200 consensus_queue.cc:260] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.500748 1200 ts_tablet_manager.cc:1434] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.054s user 0.002s sys 0.002s
I20260619 19:54:22.501083 1200 tablet_bootstrap.cc:492] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:22.505504 1200 tablet_bootstrap.cc:654] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.512737 888 tablet_service.cc:1511] Processing CreateTablet for tablet 734fd4fdd47249b8910c3d1aa3cba33b (DEFAULT_TABLE table=default.Table_49c0a24d1ebf46639a117f9eb1d2ffeb [id=d5336137bdc94a14a666cea088d28997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.525671 528 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_e9ca39e105a54a2298b050c3cdedfdb4 [id=50dcec72e2094942804e8252af3f7566] alter complete (version 1)
I20260619 19:54:22.527907 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734fd4fdd47249b8910c3d1aa3cba33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.531281 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8430e94c48974dc385ef26699263bf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.531881 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d724719094fa6a594790adbf6d2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.537410 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_dea5c54bb7474dbfb49a1ebd57ec9baa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.538110 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dea5c54bb7474dbfb49a1ebd57ec9baa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.536168 528 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_b2bc9c255ad74e7e8a590980701ed419 [id=fcf00dfcc0374847883336aee0a57d34] alter complete (version 3)
I20260619 19:54:22.539628 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d758bed342d14223ac00095546093692" } modify_external_catalogs: true
I20260619 19:54:22.544147 749 tablet_service.cc:1511] Processing CreateTablet for tablet 734fd4fdd47249b8910c3d1aa3cba33b (DEFAULT_TABLE table=default.Table_49c0a24d1ebf46639a117f9eb1d2ffeb [id=d5336137bdc94a14a666cea088d28997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.545363 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 55404d15d42244c6b42272143c44ff9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:16 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.545770 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae6164970ec4977a8c0c9fd24ab7275 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:08 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.546223 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 495bafb07abe45da9f62138453dd6636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.546583 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ecd267aa34469cad9db0745178013b with delete_type TABLET_DATA_DELETED (replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.553406 3116 raft_consensus.cc:515] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.555197 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73029f4bc97349da9d5d2fae4321cd5f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:22.555418 1061 raft_consensus.cc:2468] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:22.561194 2026 ts_tablet_manager.cc:1929] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:22.561483 2026 log.cc:1199] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/983faf8557814093bc427291711f3fce
I20260619 19:54:22.562271 2026 ts_tablet_manager.cc:1950] T 983faf8557814093bc427291711f3fce P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.568709 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73029f4bc97349da9d5d2fae4321cd5f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:22.568953 1058 raft_consensus.cc:3060] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.571962 1058 raft_consensus.cc:2468] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:22.573781 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 427) took 13540 ms. Trace:
I20260619 19:54:22.574091 2026 rpcz_store.cc:276] 0619 19:54:09.033549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.033632 (+ 83us) service_pool.cc:224] Handling call
0619 19:54:22.355239 (+13321607us) ts_tablet_manager.cc:1151] Deleting tablet 983faf8557814093bc427291711f3fce
0619 19:54:22.355250 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.407906 (+ 52656us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.561098 (+153192us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.573749 (+ 12651us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13321366}
I20260619 19:54:22.575037 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 983faf8557814093bc427291711f3fce (table default.Table_508ca7090aa54693b073adb86fe4f9ad [id=daffb1c409b74c799628ced1c9be2520]) successfully deleted
I20260619 19:54:22.575798 2026 tablet_replica.cc:333] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.576591 2026 raft_consensus.cc:2243] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.580660 3290 raft_consensus.cc:493] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:22.581051 3290 raft_consensus.cc:515] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:22.583792 3290 leader_election.cc:290] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:22.589455 1994 ts_tablet_manager.cc:1929] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:22.591738 1201 tablet_bootstrap.cc:492] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.591997 1201 ts_tablet_manager.cc:1403] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.108s user 0.003s sys 0.000s
I20260619 19:54:22.593196 1201 raft_consensus.cc:359] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.593369 780 raft_consensus.cc:3060] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.593631 1201 raft_consensus.cc:385] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.593776 1201 raft_consensus.cc:740] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.596369 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 1b18a61d955e4929998b90c6c8fa844e (table default.Table_4a534d852e184f36a8e7ea2922979897 [id=5d2c41238c64437a970164bc23f8368e]) successfully deleted
I20260619 19:54:22.603758 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6b786bd844781af7fdc5849e90009" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:22.609043 1208 tablet_bootstrap.cc:492] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:22.609314 1208 ts_tablet_manager.cc:1403] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.140s user 0.000s sys 0.004s
I20260619 19:54:22.610169 1208 raft_consensus.cc:359] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.610422 1208 raft_consensus.cc:385] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.610538 1208 raft_consensus.cc:740] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.610850 1208 consensus_queue.cc:260] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.612814 1208 ts_tablet_manager.cc:1434] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 19:54:22.615255 1994 log.cc:1199] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/8ce7f825e5f84d5985427e83ee6a989d
I20260619 19:54:22.615407 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c89481b6c4a3463bac89cf602f4ef863 (DEFAULT_TABLE table=default.Table_76beaec437ad4eadab6de9dadd1c20cc [id=7fb00678465b4e54a768b384c0223002]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.613703 1035 tablet_service.cc:1511] Processing CreateTablet for tablet c0ffb9cdcc054f12acdc65bf82626f6b (DEFAULT_TABLE table=default.Table_89cd88f2d88d4d80922912884ea10e91 [id=1e849b99b4ad45ec8527119b940f7be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.617791 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 140de873b1094bf4ac9fa29507722300 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.620033 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 4c083c79425343a08cbcf7064ef16b75 (DEFAULT_TABLE table=default.Table_7c2ee589217a4ed3a15f54172620b40f [id=36618fb0cbe14e4c8be462370250abf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.621266 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 226b636ca31f40138488d4fc2c85358a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.623792 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 14e56d4deaa7466aad055f99f9958ab0 (DEFAULT_TABLE table=default.Table_639a2214cb334e2ea654335eece0cae1 [id=a6dad8de75884c538f556beb52f14150]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:22.595196 858 leader_election.cc:343] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:22.594026 1201 consensus_queue.cc:260] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.619455 859 leader_election.cc:304] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:22.624775 1201 ts_tablet_manager.cc:1434] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.033s user 0.001s sys 0.000s
I20260619 19:54:22.625082 1201 tablet_bootstrap.cc:492] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:22.599054 2026 pending_rounds.cc:70] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Trying to abort 1 pending ops.
I20260619 19:54:22.626693 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 80f573122e1a4c2ba6425847ca86d94e (DEFAULT_TABLE table=default.Table_e39afedbe59f4303b26bc6217453a187 [id=f376e537cf2c439e9b4db92fd4d6eae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.626840 1201 tablet_bootstrap.cc:654] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.625479 3290 raft_consensus.cc:2804] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:22.628078 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 8430e94c48974dc385ef26699263bf28 (DEFAULT_TABLE table=default.Table_0aeed027a93f49b6952c63c85c9a8238 [id=9fbdd54d8fcd40bb9e4502090cc8e120]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.628904 3290 raft_consensus.cc:697] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:22.629957 1032 tablet_service.cc:1511] Processing CreateTablet for tablet a87d724719094fa6a594790adbf6d2c5 (DEFAULT_TABLE table=default.Table_171c4100b2f6490c8885fc92c64a08ea [id=4641f3aa23474501b4363ea746eacd9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.631044 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 734fd4fdd47249b8910c3d1aa3cba33b (DEFAULT_TABLE table=default.Table_49c0a24d1ebf46639a117f9eb1d2ffeb [id=d5336137bdc94a14a666cea088d28997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:22.631403 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd6b786bd844781af7fdc5849e90009 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.632298 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:22.632436 859 leader_election.cc:343] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:22.632551 859 leader_election.cc:304] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
W20260619 19:54:22.633427 720 leader_election.cc:343] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 32ecd267aa34469cad9db0745178013b
I20260619 19:54:22.635262 2953 raft_consensus.cc:2749] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:22.625470 2026 pending_rounds.cc:77] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657730381635584 op_type: NO_OP noop_request { }
I20260619 19:54:22.631397 3290 consensus_queue.cc:237] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.636314 2026 raft_consensus.cc:2889] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:22.637233 2026 raft_consensus.cc:2272] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.640584 2026 ts_tablet_manager.cc:1916] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.641003 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8430e94c48974dc385ef26699263bf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.615769 1994 ts_tablet_manager.cc:1950] T 8ce7f825e5f84d5985427e83ee6a989d P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:22.642500 1994 tablet_replica.cc:333] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:22.642727 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 8ce7f825e5f84d5985427e83ee6a989d (table default.Table_13defec349014a83b249f7db46924c0e [id=4a0bee70b1e843b086d0ccc5b4cf13ab]) successfully deleted
I20260619 19:54:22.642946 1994 raft_consensus.cc:2243] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.643198 1994 raft_consensus.cc:2272] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.643635 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89481b6c4a3463bac89cf602f4ef863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.643800 1994 ts_tablet_manager.cc:1916] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.643836 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f573122e1a4c2ba6425847ca86d94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.647397 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87d724719094fa6a594790adbf6d2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.648017 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ffb9cdcc054f12acdc65bf82626f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.651484 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734fd4fdd47249b8910c3d1aa3cba33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.655993 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_eec88df8f25c46658bbd65c3076678bb" } modify_external_catalogs: true
I20260619 19:54:22.656332 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_eec88df8f25c46658bbd65c3076678bb" } modify_external_catalogs: true
I20260619 19:54:22.658105 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 2c512a30b4fa48fb89bc1ea968ad6536
I20260619 19:54:22.659982 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5754e690c96a48968ff02e778777a567" } new_table_name: "default.Table_1d5cd97f584641f0b93214d922e1e1e8" modify_external_catalogs: true
I20260619 19:54:22.660388 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_02cea83081424efcbda7f7700b976e6a" } new_table_name: "default.Table_4684b17b3c6e4e399c8b7044dd245189" modify_external_catalogs: true
I20260619 19:54:22.661073 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c512a30b4fa48fb89bc1ea968ad6536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.662514 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_16dcaa6bce9744e1a978dc75e97efdf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.663296 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16dcaa6bce9744e1a978dc75e97efdf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.663676 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c512a30b4fa48fb89bc1ea968ad6536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.664386 3273 raft_consensus.cc:493] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.664537 3273 raft_consensus.cc:515] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.665202 3273 leader_election.cc:290] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.667850 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fe4b37c74b4fb496f2842407c65eb1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:22.668430 858 leader_election.cc:343] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.668708 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 734fd4fdd47249b8910c3d1aa3cba33b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:22.678674 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e93e1bac4fc84ac7a2ceac8629c6c228 has no consensus state
W20260619 19:54:22.678892 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c34d1212487348ceae8c58e5c09740cc consensus state has no leader
I20260619 19:54:22.678532 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d758bed342d14223ac00095546093692" } modify_external_catalogs: true
I20260619 19:54:22.680068 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_90338ea3099b45ecb387eadcbeef093b" } modify_external_catalogs: true
I20260619 19:54:22.680408 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_90338ea3099b45ecb387eadcbeef093b" } modify_external_catalogs: true
W20260619 19:54:22.682253 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de13d06685dd4a188de6ccd8fa786824 consensus state has no leader
I20260619 19:54:22.683188 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_deb77daf83c147f0b5863523294bf70f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.683511 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c083c79425343a08cbcf7064ef16b75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:22.683972 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deb77daf83c147f0b5863523294bf70f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.686102 3116 leader_election.cc:290] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.687578 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e56d4deaa7466aad055f99f9958ab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:22.691052 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fe4b37c74b4fb496f2842407c65eb1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:22.691288 1053 raft_consensus.cc:2468] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:22.692888 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c512a30b4fa48fb89bc1ea968ad6536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.693809 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73029f4bc97349da9d5d2fae4321cd5f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.693987 773 raft_consensus.cc:3060] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.696606 773 raft_consensus.cc:2468] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:22.692744 859 leader_election.cc:304] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.697628 3273 raft_consensus.cc:2804] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.697722 3273 raft_consensus.cc:493] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.697795 3273 raft_consensus.cc:3060] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.700722 3273 raft_consensus.cc:515] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.701078 1201 tablet_bootstrap.cc:492] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.701197 1201 ts_tablet_manager.cc:1403] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.000s
I20260619 19:54:22.701344 3273 leader_election.cc:290] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.702569 1201 raft_consensus.cc:359] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.702844 1201 raft_consensus.cc:385] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.703121 1201 raft_consensus.cc:740] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.703259 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fe4b37c74b4fb496f2842407c65eb1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.703547 1201 consensus_queue.cc:260] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:22.609833 996 leader_election.cc:343] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:22.704118 996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 94391.2us
I20260619 19:54:22.703639 3290 raft_consensus.cc:493] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.704705 3290 raft_consensus.cc:515] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.704556 1201 ts_tablet_manager.cc:1434] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 19:54:22.708389 3290 leader_election.cc:290] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.708685 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6b786bd844781af7fdc5849e90009" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:22.708920 1201 tablet_bootstrap.cc:492] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:22.709244 858 leader_election.cc:343] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.710536 1201 tablet_bootstrap.cc:654] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:22.712608 858 leader_election.cc:343] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.713905 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6b786bd844781af7fdc5849e90009" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:22.714080 919 raft_consensus.cc:2468] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:22.714900 2026 ts_tablet_manager.cc:1929] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:22.716395 2026 log.cc:1199] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/d5ddb8412ad145dd85916bf5d756a9f0
I20260619 19:54:22.717154 2026 ts_tablet_manager.cc:1950] T d5ddb8412ad145dd85916bf5d756a9f0 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.719053 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 430) took 13619 ms. Trace:
I20260619 19:54:22.719775 2026 rpcz_store.cc:276] 0619 19:54:09.099786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.099872 (+ 86us) service_pool.cc:224] Handling call
0619 19:54:22.575656 (+13475784us) ts_tablet_manager.cc:1151] Deleting tablet d5ddb8412ad145dd85916bf5d756a9f0
0619 19:54:22.575709 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.699579 (+123870us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.714846 (+ 15267us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.719035 (+ 4189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21246,"tablet-delete.queue_time_us":13475529}
I20260619 19:54:22.720897 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet d5ddb8412ad145dd85916bf5d756a9f0 (table default.Table_527cf0476cba48df95b0d706d997da42 [id=61bdcb686a2f4ddd94229e2ba1d737ab]) successfully deleted
I20260619 19:54:22.722239 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 431) took 13607 ms. Trace:
I20260619 19:54:22.722585 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fe4b37c74b4fb496f2842407c65eb1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:22.722704 2026 rpcz_store.cc:276] 0619 19:54:09.115296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.115349 (+ 53us) service_pool.cc:224] Handling call
0619 19:54:22.722080 (+13606731us) ts_tablet_manager.cc:1151] Deleting tablet 904e20649a5f4c49a93bb084c1d3bb9a
0619 19:54:22.722092 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.722221 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13606552}
I20260619 19:54:22.722777 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6b786bd844781af7fdc5849e90009" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:22.723250 1059 raft_consensus.cc:2468] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:22.723450 1058 raft_consensus.cc:3060] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:22.723788 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 904e20649a5f4c49a93bb084c1d3bb9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 904e20649a5f4c49a93bb084c1d3bb9a already in progress: creating tablet
I20260619 19:54:22.724275 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 434) took 13490 ms. Trace:
I20260619 19:54:22.725879 2026 rpcz_store.cc:276] 0619 19:54:09.234015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.234418 (+ 403us) service_pool.cc:224] Handling call
0619 19:54:22.724160 (+13489742us) ts_tablet_manager.cc:1151] Deleting tablet ac2d419a6e5d466e97df971b31640519
0619 19:54:22.724170 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.724258 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13489535}
I20260619 19:54:22.726238 1058 raft_consensus.cc:2468] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
W20260619 19:54:22.726634 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ac2d419a6e5d466e97df971b31640519 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac2d419a6e5d466e97df971b31640519 already in progress: creating tablet
I20260619 19:54:22.727408 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 435) took 13492 ms. Trace:
I20260619 19:54:22.728071 2026 rpcz_store.cc:276] 0619 19:54:09.234817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.235285 (+ 468us) service_pool.cc:224] Handling call
0619 19:54:22.727203 (+13491918us) ts_tablet_manager.cc:1151] Deleting tablet 67faf5d554074ab3bdf79075f649f4e0
0619 19:54:22.727310 (+ 107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.727393 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13491757}
W20260619 19:54:22.728801 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 67faf5d554074ab3bdf79075f649f4e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67faf5d554074ab3bdf79075f649f4e0 already in progress: creating tablet
I20260619 19:54:22.729297 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 436) took 13493 ms. Trace:
I20260619 19:54:22.729748 2026 rpcz_store.cc:276] 0619 19:54:09.235658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.235699 (+ 41us) service_pool.cc:224] Handling call
0619 19:54:22.729191 (+13493492us) ts_tablet_manager.cc:1151] Deleting tablet 0f3a48eabb574be3bc6883cf555b657f
0619 19:54:22.729200 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.729282 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13493357}
I20260619 19:54:22.730134 3417 tablet.cc:1724] T deba56eb121e4aa6b8ad7b13951723aa P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:22.730410 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 0f3a48eabb574be3bc6883cf555b657f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f3a48eabb574be3bc6883cf555b657f already in progress: creating tablet
I20260619 19:54:22.730969 2026 tablet_replica.cc:333] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.731380 2026 raft_consensus.cc:2243] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.731830 2026 raft_consensus.cc:2272] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.732614 2026 ts_tablet_manager.cc:1916] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.735635 1208 tablet_bootstrap.cc:492] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:22.740062 3406 raft_consensus.cc:493] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.740283 3406 raft_consensus.cc:515] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.741098 3406 leader_election.cc:290] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.744307 1973 tablet_replica.cc:333] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:22.744774 859 leader_election.cc:304] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.745285 859 leader_election.cc:304] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:22.745857 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet ee64505bfcdf49b5820754cbbf822165 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee64505bfcdf49b5820754cbbf822165 already in progress: creating tablet
W20260619 19:54:22.746104 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet bdaa6ef43cab4cb384b92bd43c472901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdaa6ef43cab4cb384b92bd43c472901 already in progress: creating tablet
W20260619 19:54:22.746308 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 140de873b1094bf4ac9fa29507722300 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 140de873b1094bf4ac9fa29507722300 already in progress: creating tablet
W20260619 19:54:22.746512 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 226b636ca31f40138488d4fc2c85358a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 226b636ca31f40138488d4fc2c85358a already in progress: creating tablet
I20260619 19:54:22.746711 3290 raft_consensus.cc:2804] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.746778 3290 raft_consensus.cc:493] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.746868 3290 raft_consensus.cc:3060] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.746275 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526af16b6a6a4cac9c084900b22d9acf" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:22.747313 1973 raft_consensus.cc:2243] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.747464 1973 raft_consensus.cc:2272] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.749745 3290 raft_consensus.cc:515] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.751024 2953 raft_consensus.cc:2804] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:22.751096 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6b786bd844781af7fdc5849e90009" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.747974 1973 ts_tablet_manager.cc:1916] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:22.751714 858 leader_election.cc:343] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.751884 2953 raft_consensus.cc:697] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
W20260619 19:54:22.752135 996 leader_election.cc:343] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.752128 2953 consensus_queue.cc:237] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.753626 1201 tablet_bootstrap.cc:492] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.753756 1201 ts_tablet_manager.cc:1403] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20260619 19:54:22.753829 3290 leader_election.cc:290] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.754493 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6b786bd844781af7fdc5849e90009" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:22.754530 1201 raft_consensus.cc:359] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.754730 1060 raft_consensus.cc:3060] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.754757 1201 raft_consensus.cc:385] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.754815 1201 raft_consensus.cc:740] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.755076 1201 consensus_queue.cc:260] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:22.755414 858 consensus_peers.cc:597] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:22.755738 1201 ts_tablet_manager.cc:1434] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:22.756024 1201 tablet_bootstrap.cc:492] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:22.756882 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 1fe5f6be6bf445509ab6a3bac320d525 (table default.Table_77aec596dec443a196ee52a9057d1a22 [id=5cdede2bf74d4d10b65658fb09db5abd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1fe5f6be6bf445509ab6a3bac320d525 consensus state has no leader
I20260619 19:54:22.758006 1201 tablet_bootstrap.cc:654] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.758690 1060 raft_consensus.cc:2468] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:22.768061 1208 tablet_bootstrap.cc:654] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.772923 1208 tablet_bootstrap.cc:492] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:22.773103 1208 ts_tablet_manager.cc:1403] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.003s
I20260619 19:54:22.777345 1208 raft_consensus.cc:359] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:22.777688 1208 raft_consensus.cc:385] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.777834 1208 raft_consensus.cc:740] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.778249 1208 consensus_queue.cc:260] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:22.778350 2026 ts_tablet_manager.cc:1929] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:22.779309 1208 ts_tablet_manager.cc:1434] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:22.779493 2026 log.cc:1199] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/fb6bc52ee1fa4ac8967f937e59b4550c
I20260619 19:54:22.779959 1208 tablet_bootstrap.cc:492] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:22.783213 1208 tablet_bootstrap.cc:654] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:22.784663 525 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88baec5f763547fd9e1b7dd49d96db17 consensus state has no leader
I20260619 19:54:22.785991 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0258778fee574c1a9ed68d07e46694f4" } modify_external_catalogs: true
I20260619 19:54:22.786219 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0258778fee574c1a9ed68d07e46694f4" } modify_external_catalogs: true
W20260619 19:54:22.788970 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28443b4f7da849b7b8d4c9c9b25d2034 consensus state has no leader
I20260619 19:54:22.789469 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7d54d0f6a2fe4de0b53dd22ace0baed0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.790882 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_36bdd320ec4a4179a4610abc0d2924b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.762485 1200 tablet_bootstrap.cc:492] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:22.791890 1200 ts_tablet_manager.cc:1403] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.291s user 0.017s sys 0.028s
W20260619 19:54:22.792178 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36bdd320ec4a4179a4610abc0d2924b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.792724 1200 raft_consensus.cc:359] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.792908 1200 raft_consensus.cc:385] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.792997 1200 raft_consensus.cc:740] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.793190 1200 consensus_queue.cc:260] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.793681 1200 ts_tablet_manager.cc:1434] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:22.793941 1200 tablet_bootstrap.cc:492] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:22.795120 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_778707e4af024d919d54ac17e12e77cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.795975 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_778707e4af024d919d54ac17e12e77cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.796022 859 leader_election.cc:304] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.796442 3290 raft_consensus.cc:2804] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:22.796552 3290 raft_consensus.cc:697] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:22.797389 529 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e12ad1228ed5406e8ac6c82f7ac621d7
I20260619 19:54:22.797539 1200 tablet_bootstrap.cc:654] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.799783 749 tablet_service.cc:1558] Processing DeleteTablet for tablet e12ad1228ed5406e8ac6c82f7ac621d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:22.764241 996 leader_election.cc:304] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.801533 3404 raft_consensus.cc:2764] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260619 19:54:22.807372 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d54d0f6a2fe4de0b53dd22ace0baed0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:22.809118 516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260619 19:54:22.810170 3248 raft_consensus.cc:493] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95181cc281b946c8b81aa825232d9498)
I20260619 19:54:22.810365 3248 raft_consensus.cc:515] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.811261 3248 leader_election.cc:290] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.811769 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:22.815232 2026 ts_tablet_manager.cc:1950] T fb6bc52ee1fa4ac8967f937e59b4550c P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.815874 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce68de8f421f4011ba9eafe4413d2294" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:22.816143 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 442) took 13380 ms. Trace:
I20260619 19:54:22.816255 2026 rpcz_store.cc:276] 0619 19:54:09.435602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.439333 (+ 3731us) service_pool.cc:224] Handling call
0619 19:54:22.730921 (+13291588us) ts_tablet_manager.cc:1151] Deleting tablet fb6bc52ee1fa4ac8967f937e59b4550c
0619 19:54:22.730932 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.736286 (+ 5354us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.778280 (+ 41994us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.816119 (+ 37839us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13291322}
I20260619 19:54:22.816552 720 leader_election.cc:304] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:22.816649 2026 tablet_replica.cc:333] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.816876 2026 raft_consensus.cc:2243] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.816936 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526af16b6a6a4cac9c084900b22d9acf" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:22.817086 2026 raft_consensus.cc:2272] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.817142 3248 raft_consensus.cc:2749] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 19:54:22.817148 919 raft_consensus.cc:2468] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:22.817689 2026 ts_tablet_manager.cc:1916] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.817896 996 leader_election.cc:304] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.818429 3406 raft_consensus.cc:2804] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.818609 3406 raft_consensus.cc:493] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.818713 3406 raft_consensus.cc:3060] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.819895 894 tablet_service.cc:1558] Processing DeleteTablet for tablet e12ad1228ed5406e8ac6c82f7ac621d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:22.815019 3290 consensus_queue.cc:237] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.820587 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet fb6bc52ee1fa4ac8967f937e59b4550c (table default.Table_246afc7a4df84db6831cb1c61e31ca7d [id=9a77efaee2cd4b07aa78d2910aeeab77]) successfully deleted
I20260619 19:54:22.777458 1994 ts_tablet_manager.cc:1929] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:22.825395 1994 log.cc:1199] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/73029f4bc97349da9d5d2fae4321cd5f
W20260619 19:54:22.790681 1034 consensus_meta.cc:287] T 0c9a90e0e93d4a4c99e41a12ea074706 P e78a44e2c8824fe7bce462e9d33f660c: Time spent flushing consensus metadata: real 0.524s user 0.021s sys 0.004s
I20260619 19:54:22.835399 2026 ts_tablet_manager.cc:1929] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:22.837342 2026 log.cc:1199] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/dff07e4afabc4e21a74ed0aa68c9026f
I20260619 19:54:22.837450 1208 tablet_bootstrap.cc:492] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:22.837658 1208 ts_tablet_manager.cc:1403] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260619 19:54:22.838943 1208 raft_consensus.cc:359] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.839268 1208 raft_consensus.cc:385] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.839380 1208 raft_consensus.cc:740] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.839707 1208 consensus_queue.cc:260] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.840327 1208 ts_tablet_manager.cc:1434] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:22.840652 2026 ts_tablet_manager.cc:1950] T dff07e4afabc4e21a74ed0aa68c9026f P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.841332 1208 tablet_bootstrap.cc:492] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:22.841504 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 443) took 13229 ms. Trace:
I20260619 19:54:22.841578 2026 rpcz_store.cc:276] 0619 19:54:09.611940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.612213 (+ 273us) service_pool.cc:224] Handling call
0619 19:54:22.816596 (+13204383us) ts_tablet_manager.cc:1151] Deleting tablet dff07e4afabc4e21a74ed0aa68c9026f
0619 19:54:22.816607 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.829028 (+ 12421us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.835334 (+ 6306us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.841483 (+ 6149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13204126}
I20260619 19:54:22.846714 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet dff07e4afabc4e21a74ed0aa68c9026f (table default.Table_621d668c6fc94dd3a19c02f225892fe2 [id=8b4b156f2c2e446eb824a1ac192a1247]) successfully deleted
I20260619 19:54:22.847290 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 444) took 13230 ms. Trace:
I20260619 19:54:22.848079 2026 rpcz_store.cc:276] 0619 19:54:09.617645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.617761 (+ 116us) service_pool.cc:224] Handling call
0619 19:54:22.847123 (+13229362us) ts_tablet_manager.cc:1151] Deleting tablet d2156cf3d7664ffc9b4b3f47fa750226
0619 19:54:22.847166 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.847270 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13229157}
W20260619 19:54:22.849123 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet d2156cf3d7664ffc9b4b3f47fa750226 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2156cf3d7664ffc9b4b3f47fa750226 already in progress: creating tablet
I20260619 19:54:22.850509 1201 tablet_bootstrap.cc:492] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.850762 1201 ts_tablet_manager.cc:1403] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.005s
I20260619 19:54:22.851327 2026 tablet_replica.cc:333] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.852001 2026 raft_consensus.cc:2243] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:22.852564 1994 ts_tablet_manager.cc:1950] T 73029f4bc97349da9d5d2fae4321cd5f P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:22.852880 2026 raft_consensus.cc:2272] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.854059 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 73029f4bc97349da9d5d2fae4321cd5f (table default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]) successfully deleted
W20260619 19:54:22.854897 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet f39a95a0ac714de388ed04a8a14e4f6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f39a95a0ac714de388ed04a8a14e4f6d already in progress: creating tablet
I20260619 19:54:22.853828 1201 raft_consensus.cc:359] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.855908 1201 raft_consensus.cc:385] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.856014 1201 raft_consensus.cc:740] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.856840 2026 ts_tablet_manager.cc:1916] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.858304 1208 tablet_bootstrap.cc:654] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.860176 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e12ad1228ed5406e8ac6c82f7ac621d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:22.860913 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ec1311d5f64141778f8ed22e96d0f360"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.861642 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec1311d5f64141778f8ed22e96d0f360 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.857975 1201 consensus_queue.cc:260] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.862497 1201 ts_tablet_manager.cc:1434] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260619 19:54:22.865018 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_40ad5f74c95f4e9cb88aeab9826fe454"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:22.865550 1201 tablet_bootstrap.cc:492] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:22.865617 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ad5f74c95f4e9cb88aeab9826fe454 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.867440 1201 tablet_bootstrap.cc:654] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.867643 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2b9e5fdc0bc14037a50752fb1870768e" } modify_external_catalogs: true
I20260619 19:54:22.867861 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2b9e5fdc0bc14037a50752fb1870768e" } modify_external_catalogs: true
I20260619 19:54:22.868643 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_c4ba9f8c4587464fac2e97ecad5d4dff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.869210 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4ba9f8c4587464fac2e97ecad5d4dff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.872582 1200 tablet_bootstrap.cc:492] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:22.872743 1200 ts_tablet_manager.cc:1403] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.013s
I20260619 19:54:22.873106 3406 raft_consensus.cc:515] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.873741 3406 leader_election.cc:290] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.873991 1200 raft_consensus.cc:359] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.874147 1200 raft_consensus.cc:385] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.874202 1200 raft_consensus.cc:740] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.874492 1200 consensus_queue.cc:260] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.874697 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526af16b6a6a4cac9c084900b22d9acf" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.874992 1200 ts_tablet_manager.cc:1434] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:22.875294 1200 tablet_bootstrap.cc:492] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:22.875627 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526af16b6a6a4cac9c084900b22d9acf" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:22.875805 919 raft_consensus.cc:3060] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:22.877126 996 leader_election.cc:343] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.877722 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_b27ad212aa214c329caac903c09686b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:22.878443 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b27ad212aa214c329caac903c09686b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:22.878795 919 raft_consensus.cc:2468] T 526af16b6a6a4cac9c084900b22d9acf P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:22.881500 1200 tablet_bootstrap.cc:654] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.883852 996 leader_election.cc:304] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.884155 3406 raft_consensus.cc:2804] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:22.884382 3406 raft_consensus.cc:697] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:22.884631 3406 consensus_queue.cc:237] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:22.887043 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a2c5a1bc7b4243f19d08a27249e23a52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2c5a1bc7b4243f19d08a27249e23a52 already in progress: creating tablet
W20260619 19:54:22.887626 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet bdaa6ef43cab4cb384b92bd43c472901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdaa6ef43cab4cb384b92bd43c472901 already in progress: creating tablet
I20260619 19:54:22.888527 1994 tablet_replica.cc:333] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:22.890113 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 7593abd3688249bbaa61e7b5869d9119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7593abd3688249bbaa61e7b5869d9119 already in progress: creating tablet
W20260619 19:54:22.890393 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 58635330cf29425bbafea95e64bdfbb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58635330cf29425bbafea95e64bdfbb9 already in progress: creating tablet
W20260619 19:54:22.890661 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet ee64505bfcdf49b5820754cbbf822165 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee64505bfcdf49b5820754cbbf822165 already in progress: creating tablet
W20260619 19:54:22.890861 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 140de873b1094bf4ac9fa29507722300 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 140de873b1094bf4ac9fa29507722300 already in progress: creating tablet
W20260619 19:54:22.891300 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 226b636ca31f40138488d4fc2c85358a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 226b636ca31f40138488d4fc2c85358a already in progress: creating tablet
I20260619 19:54:22.893316 2026 ts_tablet_manager.cc:1929] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:22.894477 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_0d01627300e842e2b4a9b29e3e8aebaf" } new_table_name: "default.Table_3998044de83c4139a297435f0801d008" modify_external_catalogs: true
I20260619 19:54:22.895807 1994 raft_consensus.cc:2243] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.896656 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_2cfcddad05dd4568a710cb6fd4a38935" } new_table_name: "default.Table_7904bdde97064dbaa07d384e7b75fefa" modify_external_catalogs: true
I20260619 19:54:22.898597 2026 log.cc:1199] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/3091dd1a525a4f779c68b8b77afa5b26
I20260619 19:54:22.899010 2026 ts_tablet_manager.cc:1950] T 3091dd1a525a4f779c68b8b77afa5b26 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:22.899819 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 445) took 13011 ms. Trace:
I20260619 19:54:22.899909 2026 rpcz_store.cc:276] 0619 19:54:09.888443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:09.888501 (+ 58us) service_pool.cc:224] Handling call
0619 19:54:22.851276 (+12962775us) ts_tablet_manager.cc:1151] Deleting tablet 3091dd1a525a4f779c68b8b77afa5b26
0619 19:54:22.851286 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.878916 (+ 27630us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.893255 (+ 14339us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.899799 (+ 6544us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12962574}
I20260619 19:54:22.900399 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 3091dd1a525a4f779c68b8b77afa5b26 (table default.Table_1da1f33c963f4f9dbddc94cb16006622 [id=ff393d500bb34f318889666cc5650292]) successfully deleted
I20260619 19:54:22.900799 1994 raft_consensus.cc:2272] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.902019 1994 ts_tablet_manager.cc:1916] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.905028 2953 consensus_queue.cc:1048] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:22.905992 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 446) took 12901 ms. Trace:
I20260619 19:54:22.907310 2026 rpcz_store.cc:276] 0619 19:54:10.004865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.005318 (+ 453us) service_pool.cc:224] Handling call
0619 19:54:22.905886 (+12900568us) ts_tablet_manager.cc:1151] Deleting tablet 1bc12bcf50074b46860899a82dc0b46e
0619 19:54:22.905897 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.905973 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12900319}
I20260619 19:54:22.911546 526 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d0f21486f95f46bc925b3c31432fab7f" } new_table_name: "default.Table_df10a39c04b44193baae4f3967049327" modify_external_catalogs: true
W20260619 19:54:22.912441 518 catalog_manager.cc:4994] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 1bc12bcf50074b46860899a82dc0b46e because the tablet was not found. No further retry: Not found: Tablet not found: 1bc12bcf50074b46860899a82dc0b46e
I20260619 19:54:22.912779 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 455) took 12732 ms. Trace:
I20260619 19:54:22.912865 2026 rpcz_store.cc:276] 0619 19:54:10.179997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.180074 (+ 77us) service_pool.cc:224] Handling call
0619 19:54:22.912625 (+12732551us) ts_tablet_manager.cc:1151] Deleting tablet 7d1b35a09aad46039677eb3d800b0051
0619 19:54:22.912637 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.912760 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12732348}
W20260619 19:54:22.913794 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2cfc4144ae324893b1fc813e30986a24 consensus state has no leader
W20260619 19:54:22.914255 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 7d1b35a09aad46039677eb3d800b0051 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d1b35a09aad46039677eb3d800b0051 already in progress: creating tablet
W20260619 19:54:22.914520 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bcc4a4d70a14f95952af1405296aee7 consensus state has no leader
I20260619 19:54:22.916407 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 458) took 12702 ms. Trace:
I20260619 19:54:22.916554 2026 rpcz_store.cc:276] 0619 19:54:10.213579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.213650 (+ 71us) service_pool.cc:224] Handling call
0619 19:54:22.914188 (+12700538us) ts_tablet_manager.cc:1151] Deleting tablet ac80d8fb9d874148bc8b0c508448804c
0619 19:54:22.916259 (+ 2071us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.916388 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12700379}
W20260619 19:54:22.917166 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ac80d8fb9d874148bc8b0c508448804c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac80d8fb9d874148bc8b0c508448804c already in progress: creating tablet
I20260619 19:54:22.918380 2026 tablet_replica.cc:333] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:22.920029 2026 raft_consensus.cc:2243] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:22.921869 2026 raft_consensus.cc:2272] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:22.922566 2026 ts_tablet_manager.cc:1916] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:22.902559 1200 tablet_bootstrap.cc:492] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:22.924140 1200 ts_tablet_manager.cc:1403] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
W20260619 19:54:22.925037 526 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff91d9b348fe4990a0f9e260cb8745c0 consensus state has no leader
I20260619 19:54:22.924952 1200 raft_consensus.cc:359] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.925410 1200 raft_consensus.cc:385] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.925516 1200 raft_consensus.cc:740] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.925818 1200 consensus_queue.cc:260] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.926530 1200 ts_tablet_manager.cc:1434] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:22.926885 1200 tablet_bootstrap.cc:492] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:22.928519 1200 tablet_bootstrap.cc:654] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.931520 526 master_service.cc:960] ReplaceTablet: received request to replace tablet 73029f4bc97349da9d5d2fae4321cd5f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:22.937323 1201 tablet_bootstrap.cc:492] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:22.937620 1201 ts_tablet_manager.cc:1403] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.004s
I20260619 19:54:22.938467 1201 raft_consensus.cc:359] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.942296 3404 raft_consensus.cc:493] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.942469 3404 raft_consensus.cc:515] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.943066 3404 leader_election.cc:290] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:22.941145 2953 raft_consensus.cc:493] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:22.943259 2953 raft_consensus.cc:515] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.943746 1208 tablet_bootstrap.cc:492] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:22.943883 1208 ts_tablet_manager.cc:1403] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.001s
I20260619 19:54:22.943907 2953 leader_election.cc:290] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.944172 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:22.944283 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:22.944334 919 raft_consensus.cc:2468] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:22.944392 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:22.944455 1060 raft_consensus.cc:2468] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:22.944479 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:22.944862 858 leader_election.cc:343] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:22.945098 996 leader_election.cc:343] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.945183 859 leader_election.cc:304] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.945689 2953 raft_consensus.cc:2804] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.945762 2953 raft_consensus.cc:493] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.945767 996 leader_election.cc:304] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.945820 2953 raft_consensus.cc:3060] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.945847 1208 raft_consensus.cc:359] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.945993 1208 raft_consensus.cc:385] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.946064 1208 raft_consensus.cc:740] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.946094 3406 raft_consensus.cc:2804] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:22.946171 3406 raft_consensus.cc:493] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:22.946224 3406 raft_consensus.cc:3060] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:22.946290 1208 consensus_queue.cc:260] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.948369 2953 raft_consensus.cc:515] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.949398 3406 raft_consensus.cc:515] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.949826 2953 leader_election.cc:290] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:22.949930 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:22.950166 1060 raft_consensus.cc:2393] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95181cc281b946c8b81aa825232d9498 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:22.950160 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.950415 3406 leader_election.cc:290] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:22.950611 858 leader_election.cc:343] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.945209 1201 raft_consensus.cc:385] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.950799 1201 raft_consensus.cc:740] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.950799 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:22.951268 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:22.951095 1201 consensus_queue.cc:260] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.951512 919 raft_consensus.cc:2393] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e78a44e2c8824fe7bce462e9d33f660c in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:22.951272 859 leader_election.cc:304] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:22.951956 1208 ts_tablet_manager.cc:1434] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260619 19:54:22.952268 3276 raft_consensus.cc:2749] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260619 19:54:22.952770 996 leader_election.cc:343] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:22.952907 1201 ts_tablet_manager.cc:1434] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260619 19:54:22.953590 1201 tablet_bootstrap.cc:492] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:22.953644 996 leader_election.cc:304] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:22.954748 3406 raft_consensus.cc:2749] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 19:54:22.955525 1201 tablet_bootstrap.cc:654] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.956597 1208 tablet_bootstrap.cc:492] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:22.961335 1208 tablet_bootstrap.cc:654] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.963984 1200 tablet_bootstrap.cc:492] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:22.964144 1200 ts_tablet_manager.cc:1403] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260619 19:54:22.964982 1200 raft_consensus.cc:359] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.965838 1200 raft_consensus.cc:385] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.965907 1200 raft_consensus.cc:740] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.966140 1200 consensus_queue.cc:260] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.966872 1200 ts_tablet_manager.cc:1434] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:22.967262 1200 tablet_bootstrap.cc:492] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:22.970330 1200 tablet_bootstrap.cc:654] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:22.974684 2026 ts_tablet_manager.cc:1929] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:22.982460 1994 ts_tablet_manager.cc:1929] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:22.982650 1994 log.cc:1199] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/4cd6b786bd844781af7fdc5849e90009
I20260619 19:54:22.983013 1994 ts_tablet_manager.cc:1950] T 4cd6b786bd844781af7fdc5849e90009 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:22.987278 1208 tablet_bootstrap.cc:492] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:22.987512 1208 ts_tablet_manager.cc:1403] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20260619 19:54:22.988435 1208 raft_consensus.cc:359] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:22.989079 1208 raft_consensus.cc:385] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:22.989349 1208 raft_consensus.cc:740] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:22.989912 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_59c7af4cbfdf4ef5a7bae5b388ec0a2d" } new_table_name: "default.Table_73012bddac2342c890794eda4a69443c" modify_external_catalogs: true
I20260619 19:54:22.992622 529 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_af8f4c6facda472389bbb8f287eb8c70" } new_table_name: "default.Table_c45864e60c3c440687e7a576199bd321" modify_external_catalogs: true
I20260619 19:54:23.000869 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 4cd6b786bd844781af7fdc5849e90009 (table default.Table_107d4f6ff8314ea1b5ea10925d7f52bd [id=a6fbc7b7f8be4094827cb7084eadaf9f]) successfully deleted
W20260619 19:54:23.003520 519 catalog_manager.cc:4994] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 056f7982f51f45a78d2b9b0a0b50576e because the tablet was not found. No further retry: Not found: Tablet not found: 056f7982f51f45a78d2b9b0a0b50576e
I20260619 19:54:22.989912 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_04090ce3031a4deda0868de2baa4eb37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.004330 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 2c512a30b4fa48fb89bc1ea968ad6536 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c512a30b4fa48fb89bc1ea968ad6536 already in progress: creating tablet
W20260619 19:54:23.004505 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04090ce3031a4deda0868de2baa4eb37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:23.005012 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e12ad1228ed5406e8ac6c82f7ac621d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e12ad1228ed5406e8ac6c82f7ac621d7 already in progress: creating tablet
I20260619 19:54:23.007447 1208 consensus_queue.cc:260] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.009238 1208 ts_tablet_manager.cc:1434] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
W20260619 19:54:23.011741 529 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47eb6580ead349188460a0fb8ada1262 consensus state has no leader
I20260619 19:54:23.012323 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_02290bf8017c40a59f163ad3ea446590"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.013007 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02290bf8017c40a59f163ad3ea446590 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.016263 527 catalog_manager.cc:5696] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:23.017124 1035 tablet_service.cc:1511] Processing CreateTablet for tablet d33aa1557757437d98bfcec7b2ae3574 (DEFAULT_TABLE table=default.Table_6e095d021cab4f88a830883e0542f165 [id=ab4df978bd1a435dba143d71c6f6741e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.017190 749 tablet_service.cc:1511] Processing CreateTablet for tablet d33aa1557757437d98bfcec7b2ae3574 (DEFAULT_TABLE table=default.Table_6e095d021cab4f88a830883e0542f165 [id=ab4df978bd1a435dba143d71c6f6741e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.017556 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33aa1557757437d98bfcec7b2ae3574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.017567 759 tablet_service.cc:1511] Processing CreateTablet for tablet e93e1bac4fc84ac7a2ceac8629c6c228 (DEFAULT_TABLE table=default.Table_d5eccea1d0de456b83b311d7f6d1bb67 [id=b233572d3a624085b7c4652dd7fe42d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.018857 1034 tablet_service.cc:1511] Processing CreateTablet for tablet e93e1bac4fc84ac7a2ceac8629c6c228 (DEFAULT_TABLE table=default.Table_d5eccea1d0de456b83b311d7f6d1bb67 [id=b233572d3a624085b7c4652dd7fe42d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.019237 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93e1bac4fc84ac7a2ceac8629c6c228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.019358 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 12e5d4b7833240a586feb639018bd1dc (DEFAULT_TABLE table=default.Table_4753eef8eb3a46d7b44782fdb93fda9a [id=c46f2dc4412c4c36870045eb21aaf3e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.019658 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e5d4b7833240a586feb639018bd1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.023877 757 tablet_service.cc:1511] Processing CreateTablet for tablet 12e5d4b7833240a586feb639018bd1dc (DEFAULT_TABLE table=default.Table_4753eef8eb3a46d7b44782fdb93fda9a [id=c46f2dc4412c4c36870045eb21aaf3e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.024252 756 tablet_service.cc:1511] Processing CreateTablet for tablet 1830bc58a597465c9a16d3c4acd0e4cc (DEFAULT_TABLE table=default.Table_64b88d70f39445c6bac0b310308d8fcf [id=2c7bc7bc3c234a8b9681d7f6d70b2d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.024546 765 tablet_service.cc:1511] Processing CreateTablet for tablet c38f2572d06f420ea50239f469e597ec (DEFAULT_TABLE table=default.Table_d3a26aaf01ce4d99b77dcbad781234df [id=f644c08ced6148d7867fad193f73af17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.025249 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1830bc58a597465c9a16d3c4acd0e4cc (DEFAULT_TABLE table=default.Table_64b88d70f39445c6bac0b310308d8fcf [id=2c7bc7bc3c234a8b9681d7f6d70b2d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.025605 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1830bc58a597465c9a16d3c4acd0e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.028962 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38f2572d06f420ea50239f469e597ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.031596 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1830bc58a597465c9a16d3c4acd0e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.034704 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (table default.Table_2e742d603b764daa86e93b4018379875 [id=33e3d383660b422582a47dcb68ae6be7]). Expected version 1 got 0
I20260619 19:54:23.035343 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:23.035451 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93e1bac4fc84ac7a2ceac8629c6c228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.035663 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 84dbba24094d4630be45b7febe8cb29e (table default.Table_64a6b0e0f5cc48a6a9b076cdeb3a74ac [id=40a213ef1b0f46da8419637e4d118218]). Expected version 2 got 0
I20260619 19:54:23.036373 527 catalog_manager.cc:5696] T e4688dc20317479e9c80f6f41b3ea35e P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:23.036749 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:23.037703 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_441a980b1f344c8fa0793dba5e99d57e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.038800 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_441a980b1f344c8fa0793dba5e99d57e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.039245 530 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_eaefb5c915d34ab79e4f47c839fd0ade [id=2738114efd1f43d4a7f797f9b12f7398] alter complete (version 2)
I20260619 19:54:23.040361 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d5eccea1d0de456b83b311d7f6d1bb67" } modify_external_catalogs: true
I20260619 19:54:23.040535 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d5eccea1d0de456b83b311d7f6d1bb67" } modify_external_catalogs: true
I20260619 19:54:23.041803 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet b6a468ca001340e98addf91dd3829efa
I20260619 19:54:23.042472 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet d77de42bb514452a8dc6a4a71289dc59
I20260619 19:54:23.045135 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 73029f4bc97349da9d5d2fae4321cd5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6763e5bd260242b7a4c12eaf6a57507f) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.045857 753 tablet_service.cc:1511] Processing CreateTablet for tablet 11307ad5007243589df5737bb192d978 (DEFAULT_TABLE table=default.Table_c2bcaece76334759bdc9728add70e6ac [id=c4a6f9f4b1a94becb892716ffe1a6c74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.046276 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11307ad5007243589df5737bb192d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.047394 764 tablet_service.cc:1511] Processing CreateTablet for tablet d936feda87f9495d8e6c181ba00276ba (DEFAULT_TABLE table=default.Table_56bba0889a534f4a990ab04ed0466ff2 [id=7dc875648bff4edcba95ce4f3e9ee90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.048612 755 tablet_service.cc:1558] Processing DeleteTablet for tablet b6a468ca001340e98addf91dd3829efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.048959 752 tablet_service.cc:1511] Processing CreateTablet for tablet 865ad7a596a442f4adbe841970000f19 (DEFAULT_TABLE table=default.Table_3baccc5fc88243f68eeabba0db3267e1 [id=e3d99960a334420f9e7bd846ef5fa230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.045855 758 tablet_service.cc:1511] Processing CreateTablet for tablet 3cfca98e1f9a4699b793215adfee0bf0 (DEFAULT_TABLE table=default.Table_1799fca0666143c69fb6609f994859c7 [id=5ee200b29d214ce493eef2ab223c2084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.049688 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d936feda87f9495d8e6c181ba00276ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.050135 760 tablet_service.cc:1558] Processing DeleteTablet for tablet d77de42bb514452a8dc6a4a71289dc59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.053706 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 3bf769db8f5d45bf9c409876322350b3
I20260619 19:54:23.054639 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet a6433bc9150946d5b0bb7900cc30ed42
I20260619 19:54:23.055693 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ad7a596a442f4adbe841970000f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.059432 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e5d4b7833240a586feb639018bd1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.063476 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cfca98e1f9a4699b793215adfee0bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.067375 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33aa1557757437d98bfcec7b2ae3574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.071503 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_55e13a20644949dfadb14fd4db5bf822"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.072080 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55e13a20644949dfadb14fd4db5bf822 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.074014 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e93e1bac4fc84ac7a2ceac8629c6c228
I20260619 19:54:23.076635 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bf769db8f5d45bf9c409876322350b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.076849 755 tablet_service.cc:1558] Processing DeleteTablet for tablet a6433bc9150946d5b0bb7900cc30ed42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.077054 762 tablet_service.cc:1558] Processing DeleteTablet for tablet e93e1bac4fc84ac7a2ceac8629c6c228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.077278 760 tablet_service.cc:1511] Processing CreateTablet for tablet ab2ec779d0f54014a7499ab7f367ab9f (DEFAULT_TABLE table=default.Table_1183649dbe10453396a71fc1e3f777ca [id=827b748965624a10a105e43b976d3183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.077661 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab2ec779d0f54014a7499ab7f367ab9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.077769 762 tablet_service.cc:1511] Processing CreateTablet for tablet db4f8c148d7d45969ec77b02e885bcbe (DEFAULT_TABLE table=default.Table_dd9b3658130141a483de115227dfaf0d [id=770a75110e9c4dedb92fffffe93c2271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.078080 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4f8c148d7d45969ec77b02e885bcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.082715 755 tablet_service.cc:1511] Processing CreateTablet for tablet e0b17d9746bc4676934cd6684d379ab2 (DEFAULT_TABLE table=default.Table_1d2c0580999842a2bde0549107f0f6ee [id=dc3e955032bb44d5a3570ff5e169380e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.083072 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b17d9746bc4676934cd6684d379ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.088028 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 11307ad5007243589df5737bb192d978 (DEFAULT_TABLE table=default.Table_c2bcaece76334759bdc9728add70e6ac [id=c4a6f9f4b1a94becb892716ffe1a6c74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.088276 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bf769db8f5d45bf9c409876322350b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.088433 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11307ad5007243589df5737bb192d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.088460 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet e93e1bac4fc84ac7a2ceac8629c6c228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.088755 1041 tablet_service.cc:1511] Processing CreateTablet for tablet ab2ec779d0f54014a7499ab7f367ab9f (DEFAULT_TABLE table=default.Table_1183649dbe10453396a71fc1e3f777ca [id=827b748965624a10a105e43b976d3183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.088773 1025 tablet_service.cc:1511] Processing CreateTablet for tablet e0b17d9746bc4676934cd6684d379ab2 (DEFAULT_TABLE table=default.Table_1d2c0580999842a2bde0549107f0f6ee [id=dc3e955032bb44d5a3570ff5e169380e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.089103 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab2ec779d0f54014a7499ab7f367ab9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.089272 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b17d9746bc4676934cd6684d379ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.089578 1027 tablet_service.cc:1511] Processing CreateTablet for tablet db4f8c148d7d45969ec77b02e885bcbe (DEFAULT_TABLE table=default.Table_dd9b3658130141a483de115227dfaf0d [id=770a75110e9c4dedb92fffffe93c2271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.089864 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4f8c148d7d45969ec77b02e885bcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.091235 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d77de42bb514452a8dc6a4a71289dc59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.091564 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 865ad7a596a442f4adbe841970000f19 (DEFAULT_TABLE table=default.Table_3baccc5fc88243f68eeabba0db3267e1 [id=e3d99960a334420f9e7bd846ef5fa230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.091903 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ad7a596a442f4adbe841970000f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.093034 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c38f2572d06f420ea50239f469e597ec (DEFAULT_TABLE table=default.Table_d3a26aaf01ce4d99b77dcbad781234df [id=f644c08ced6148d7867fad193f73af17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.093340 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38f2572d06f420ea50239f469e597ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.095398 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 3cfca98e1f9a4699b793215adfee0bf0 (DEFAULT_TABLE table=default.Table_1799fca0666143c69fb6609f994859c7 [id=5ee200b29d214ce493eef2ab223c2084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.095728 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cfca98e1f9a4699b793215adfee0bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.099267 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet a6433bc9150946d5b0bb7900cc30ed42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.101065 1035 tablet_service.cc:1511] Processing CreateTablet for tablet d936feda87f9495d8e6c181ba00276ba (DEFAULT_TABLE table=default.Table_56bba0889a534f4a990ab04ed0466ff2 [id=7dc875648bff4edcba95ce4f3e9ee90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.101570 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d936feda87f9495d8e6c181ba00276ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.103724 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_726ead7412294be6bad3cfa42c5ae0f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.104403 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_726ead7412294be6bad3cfa42c5ae0f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.105854 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_209919aed84e471482c567000b1c92df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.106545 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_209919aed84e471482c567000b1c92df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.108043 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_581abe6dd7674411b70ec21510a3e561"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.108726 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_581abe6dd7674411b70ec21510a3e561 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.112329 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_942bba051c55418bb021f58dd6283657"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:23.112550 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_caf1cb860e2f4abf8dd10dbf55c13cfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.112937 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_942bba051c55418bb021f58dd6283657 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:23.113195 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_caf1cb860e2f4abf8dd10dbf55c13cfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.017143 894 tablet_service.cc:1511] Processing CreateTablet for tablet d33aa1557757437d98bfcec7b2ae3574 (DEFAULT_TABLE table=default.Table_6e095d021cab4f88a830883e0542f165 [id=ab4df978bd1a435dba143d71c6f6741e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.116313 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33aa1557757437d98bfcec7b2ae3574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.018143 897 tablet_service.cc:1511] Processing CreateTablet for tablet e93e1bac4fc84ac7a2ceac8629c6c228 (DEFAULT_TABLE table=default.Table_d5eccea1d0de456b83b311d7f6d1bb67 [id=b233572d3a624085b7c4652dd7fe42d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.119474 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93e1bac4fc84ac7a2ceac8629c6c228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.018723 895 tablet_service.cc:1511] Processing CreateTablet for tablet 12e5d4b7833240a586feb639018bd1dc (DEFAULT_TABLE table=default.Table_4753eef8eb3a46d7b44782fdb93fda9a [id=c46f2dc4412c4c36870045eb21aaf3e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.123543 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e5d4b7833240a586feb639018bd1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.019484 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1830bc58a597465c9a16d3c4acd0e4cc (DEFAULT_TABLE table=default.Table_64b88d70f39445c6bac0b310308d8fcf [id=2c7bc7bc3c234a8b9681d7f6d70b2d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.127480 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1830bc58a597465c9a16d3c4acd0e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.127646 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f275496d91cd4c5ea0b9963b823740a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.128333 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f275496d91cd4c5ea0b9963b823740a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.130939 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b6a468ca001340e98addf91dd3829efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.030397 3273 raft_consensus.cc:493] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.031208 3290 consensus_queue.cc:1048] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:23.038926 1201 tablet_bootstrap.cc:492] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.131275 3273 raft_consensus.cc:515] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.131425 1201 ts_tablet_manager.cc:1403] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.178s user 0.004s sys 0.000s
I20260619 19:54:23.131944 3273 leader_election.cc:290] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.131930 753 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6f5c5dd6e948faacd96f75ef59e00e (DEFAULT_TABLE table=default.Table_0c58e59a4fc14af398679e836a1a2433 [id=7582d03c883a4d5880c3c6368bb4131b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.132330 1200 tablet_bootstrap.cc:492] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.132215 1201 raft_consensus.cc:359] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.132412 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6f5c5dd6e948faacd96f75ef59e00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.132408 1201 raft_consensus.cc:385] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.132464 1201 raft_consensus.cc:740] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.132627 1201 consensus_queue.cc:260] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.133023 1201 ts_tablet_manager.cc:1434] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 19:54:23.133286 1201 tablet_bootstrap.cc:492] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.133618 1200 ts_tablet_manager.cc:1403] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.166s user 0.003s sys 0.000s
I20260619 19:54:23.133994 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a39b06bad874a5d8c945c27c3552d43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.134991 1201 tablet_bootstrap.cc:654] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.040195 888 tablet_service.cc:1511] Processing CreateTablet for tablet c38f2572d06f420ea50239f469e597ec (DEFAULT_TABLE table=default.Table_d3a26aaf01ce4d99b77dcbad781234df [id=f644c08ced6148d7867fad193f73af17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.047317 885 tablet_service.cc:1511] Processing CreateTablet for tablet 11307ad5007243589df5737bb192d978 (DEFAULT_TABLE table=default.Table_c2bcaece76334759bdc9728add70e6ac [id=c4a6f9f4b1a94becb892716ffe1a6c74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.135535 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38f2572d06f420ea50239f469e597ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.135454 1200 raft_consensus.cc:359] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.135607 1200 raft_consensus.cc:385] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260619 19:54:23.135596 859 leader_election.cc:343] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.135656 1200 raft_consensus.cc:740] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.135908 885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11307ad5007243589df5737bb192d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.135876 1200 consensus_queue.cc:260] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.137301 1200 ts_tablet_manager.cc:1434] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:23.138356 1200 tablet_bootstrap.cc:492] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.047390 896 tablet_service.cc:1558] Processing DeleteTablet for tablet b6a468ca001340e98addf91dd3829efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.047508 900 tablet_service.cc:1558] Processing DeleteTablet for tablet d77de42bb514452a8dc6a4a71289dc59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.047690 899 tablet_service.cc:1511] Processing CreateTablet for tablet d936feda87f9495d8e6c181ba00276ba (DEFAULT_TABLE table=default.Table_56bba0889a534f4a990ab04ed0466ff2 [id=7dc875648bff4edcba95ce4f3e9ee90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.140451 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d936feda87f9495d8e6c181ba00276ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.049345 889 tablet_service.cc:1511] Processing CreateTablet for tablet 865ad7a596a442f4adbe841970000f19 (DEFAULT_TABLE table=default.Table_3baccc5fc88243f68eeabba0db3267e1 [id=e3d99960a334420f9e7bd846ef5fa230]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.143415 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865ad7a596a442f4adbe841970000f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.144909 1200 tablet_bootstrap.cc:654] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.049626 884 tablet_service.cc:1511] Processing CreateTablet for tablet 3cfca98e1f9a4699b793215adfee0bf0 (DEFAULT_TABLE table=default.Table_1799fca0666143c69fb6609f994859c7 [id=5ee200b29d214ce493eef2ab223c2084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.147419 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cfca98e1f9a4699b793215adfee0bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.149317 1994 tablet_replica.cc:333] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
W20260619 19:54:23.149302 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 3bf769db8f5d45bf9c409876322350b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bf769db8f5d45bf9c409876322350b3 already in progress: creating tablet
I20260619 19:54:23.149509 1994 raft_consensus.cc:2243] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260619 19:54:23.149657 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet e93e1bac4fc84ac7a2ceac8629c6c228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e93e1bac4fc84ac7a2ceac8629c6c228 already in progress: creating tablet
I20260619 19:54:23.149724 1994 raft_consensus.cc:2272] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.150445 1994 ts_tablet_manager.cc:1916] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.051779 2953 raft_consensus.cc:493] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.077859 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e93e1bac4fc84ac7a2ceac8629c6c228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.078058 887 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bf769db8f5d45bf9c409876322350b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.078187 886 tablet_service.cc:1558] Processing DeleteTablet for tablet a6433bc9150946d5b0bb7900cc30ed42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:22 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.078490 902 tablet_service.cc:1511] Processing CreateTablet for tablet ab2ec779d0f54014a7499ab7f367ab9f (DEFAULT_TABLE table=default.Table_1183649dbe10453396a71fc1e3f777ca [id=827b748965624a10a105e43b976d3183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.151258 2953 raft_consensus.cc:515] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.151600 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab2ec779d0f54014a7499ab7f367ab9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.151839 2953 leader_election.cc:290] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.153856 1208 tablet_bootstrap.cc:492] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.153923 3402 raft_consensus.cc:493] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.154043 3402 raft_consensus.cc:515] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.154632 3402 leader_election.cc:290] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.155032 3402 raft_consensus.cc:493] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.078831 892 tablet_service.cc:1511] Processing CreateTablet for tablet e0b17d9746bc4676934cd6684d379ab2 (DEFAULT_TABLE table=default.Table_1d2c0580999842a2bde0549107f0f6ee [id=dc3e955032bb44d5a3570ff5e169380e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.086470 898 tablet_service.cc:1511] Processing CreateTablet for tablet db4f8c148d7d45969ec77b02e885bcbe (DEFAULT_TABLE table=default.Table_dd9b3658130141a483de115227dfaf0d [id=770a75110e9c4dedb92fffffe93c2271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.155161 3402 raft_consensus.cc:515] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.155478 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b17d9746bc4676934cd6684d379ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.155652 3402 leader_election.cc:290] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.156757 1208 tablet_bootstrap.cc:654] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.158768 1200 tablet_bootstrap.cc:492] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.158952 1200 ts_tablet_manager.cc:1403] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260619 19:54:23.159472 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4f8c148d7d45969ec77b02e885bcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.159749 1200 raft_consensus.cc:359] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.159906 1200 raft_consensus.cc:385] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.159951 1200 raft_consensus.cc:740] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.160204 1200 consensus_queue.cc:260] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.161839 1200 ts_tablet_manager.cc:1434] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260619 19:54:23.163005 1200 tablet_bootstrap.cc:492] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
W20260619 19:54:23.164578 859 leader_election.cc:343] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 801f08f4daa842238460506ccd0c466f
I20260619 19:54:23.157670 1973 ts_tablet_manager.cc:1929] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:23.165874 1200 tablet_bootstrap.cc:654] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.165498 3248 raft_consensus.cc:493] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.166036 3248 raft_consensus.cc:515] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.166680 3248 leader_election.cc:290] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.167276 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc9c4167c58495fbfcf5fb60952c884" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.167945 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22e0f53008c4a96bf56b7f057f81cd5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:23.168665 720 leader_election.cc:343] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 74d8cd01251f4cfa93ecddb391c1c91e
W20260619 19:54:23.169289 996 leader_election.cc:343] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:23.169484 996 leader_election.cc:343] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.178725 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22e0f53008c4a96bf56b7f057f81cd5" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:23.179495 996 leader_election.cc:343] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.179631 996 leader_election.cc:304] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.180006 3406 raft_consensus.cc:2749] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.180482 757 tablet_service.cc:1511] Processing CreateTablet for tablet ddda494672344590a8467911d60d0f9a (DEFAULT_TABLE table=default.Table_6a13e6e937644610bc1fdc20c4ca45dc [id=40ddfa552cdd4582bcba3baa3df3c5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.180888 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddda494672344590a8467911d60d0f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.180851 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc9c4167c58495fbfcf5fb60952c884" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:23.181036 910 raft_consensus.cc:2468] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:23.181133 749 tablet_service.cc:1511] Processing CreateTablet for tablet 745c2ac28ff24969b778b5abd3f406af (DEFAULT_TABLE table=default.Table_19bc418b3c714dd09369d232f417db60 [id=bee345f6db96404cb9edfd320cb757b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.181488 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745c2ac28ff24969b778b5abd3f406af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.183266 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 745c2ac28ff24969b778b5abd3f406af (DEFAULT_TABLE table=default.Table_19bc418b3c714dd09369d232f417db60 [id=bee345f6db96404cb9edfd320cb757b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.183637 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745c2ac28ff24969b778b5abd3f406af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.186843 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6f5c5dd6e948faacd96f75ef59e00e (DEFAULT_TABLE table=default.Table_0c58e59a4fc14af398679e836a1a2433 [id=7582d03c883a4d5880c3c6368bb4131b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.187274 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6f5c5dd6e948faacd96f75ef59e00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.188050 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 08e578f5c21b4657bb9a5536f654c984 (DEFAULT_TABLE table=default.Table_3157ee54d08c4af5bb47202a85f9e9e2 [id=567b1e5dff914ca29357b2b8a025e266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.188413 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e578f5c21b4657bb9a5536f654c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.190518 1208 tablet_bootstrap.cc:492] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:23.190657 1208 ts_tablet_manager.cc:1403] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260619 19:54:23.191608 3276 raft_consensus.cc:493] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.191751 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_43005387944c49c8ab351b1f890fe8a7" } new_table_name: "default.Table_d9674ec73ac245d1aaf0d2b14b825f20" modify_external_catalogs: true
I20260619 19:54:23.191751 3276 raft_consensus.cc:515] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.192152 764 tablet_service.cc:1511] Processing CreateTablet for tablet 08e578f5c21b4657bb9a5536f654c984 (DEFAULT_TABLE table=default.Table_3157ee54d08c4af5bb47202a85f9e9e2 [id=567b1e5dff914ca29357b2b8a025e266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.192483 2026 log.cc:1199] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/bf175c80483346788a148b7277b9ca9d
I20260619 19:54:23.192519 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e578f5c21b4657bb9a5536f654c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.193290 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ca0a0c0ff3a24e1e996251051e9927e8" } new_table_name: "default.Table_a0398b4b99214a6685538691fb3dadb2" modify_external_catalogs: true
I20260619 19:54:23.194612 524 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1b4977d0526047a79425bc05e1582c45" } new_table_name: "default.Table_d560f7bdaa3e44bb950faa767526caaf" modify_external_catalogs: true
W20260619 19:54:23.195948 427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 147661us
I20260619 19:54:23.196175 996 leader_election.cc:304] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.196372 525 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:23.196672 3406 raft_consensus.cc:2804] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:23.196756 3406 raft_consensus.cc:493] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:23.196830 3406 raft_consensus.cc:3060] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.198694 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7877d111a0438da74b7bcf396e2c71" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.198905 1060 raft_consensus.cc:2468] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:23.199844 859 leader_election.cc:304] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:23.200115 3290 raft_consensus.cc:2804] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:23.200217 3290 raft_consensus.cc:493] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:23.200311 3290 raft_consensus.cc:3060] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.200259 3406 raft_consensus.cc:515] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.202045 1208 raft_consensus.cc:359] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.200678 1022 tablet_service.cc:1511] Processing CreateTablet for tablet ddda494672344590a8467911d60d0f9a (DEFAULT_TABLE table=default.Table_6a13e6e937644610bc1fdc20c4ca45dc [id=40ddfa552cdd4582bcba3baa3df3c5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.203508 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddda494672344590a8467911d60d0f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.204566 1208 raft_consensus.cc:385] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.205369 3276 leader_election.cc:290] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.204663 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc9c4167c58495fbfcf5fb60952c884" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:23.205672 1208 raft_consensus.cc:740] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.206137 1208 consensus_queue.cc:260] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:23.206264 996 leader_election.cc:343] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.206642 3406 leader_election.cc:290] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
W20260619 19:54:23.209040 516 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5 -> Peer 2d38b77ff37948e19592b36b6d884fe0 (127.0.105.188:44433): Couldn't send request to peer 2d38b77ff37948e19592b36b6d884fe0. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.188:44433: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260619 19:54:23.205160 758 tablet_service.cc:1511] Processing CreateTablet for tablet 8c110bf3613d488fad99db968ac2db46 (DEFAULT_TABLE table=default.Table_98009ff8de10458ab7ba699d2d89bea5 [id=eae42f5bc9974b69934233011c64de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.210328 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c110bf3613d488fad99db968ac2db46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.213109 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc9c4167c58495fbfcf5fb60952c884" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:23.213328 910 raft_consensus.cc:3060] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.220041 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_689a9b5fe2814be7abb33eaec0f6c9e0" } new_table_name: "default.Table_7759043aad544b97b5bf874d3bf2e56e" modify_external_catalogs: true
I20260619 19:54:23.220669 759 tablet_service.cc:1511] Processing CreateTablet for tablet 88d2da91229d4a5e815f37f5a607edd5 (DEFAULT_TABLE table=default.Table_10c903295c1d41ecb90fc2a5d717264b [id=2d104f8622614e6a81e02b157966c79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.220829 1208 ts_tablet_manager.cc:1434] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.030s user 0.003s sys 0.000s
I20260619 19:54:23.221130 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d2da91229d4a5e815f37f5a607edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.223318 3290 raft_consensus.cc:515] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.223968 3290 leader_election.cc:290] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.226248 910 raft_consensus.cc:2468] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:23.226827 996 leader_election.cc:304] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.227243 3406 raft_consensus.cc:2804] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:23.227362 3406 raft_consensus.cc:697] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:23.227551 3406 consensus_queue.cc:237] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.165513 1973 log.cc:1199] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/55404d15d42244c6b42272143c44ff9c
I20260619 19:54:23.230121 1973 ts_tablet_manager.cc:1950] T 55404d15d42244c6b42272143c44ff9c P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:23.230654 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7877d111a0438da74b7bcf396e2c71" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:23.230894 1053 raft_consensus.cc:3060] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.235095 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 198bde101e7b4eeeb8de58aebe208bb4 (table default.Table_a1c8ee1b3f864b24aacf7f9089b5411d [id=b050d865cd52491c97d748c78f0c83a5]). Expected version 2 got 0
I20260619 19:54:23.235821 895 tablet_service.cc:1511] Processing CreateTablet for tablet 08e578f5c21b4657bb9a5536f654c984 (DEFAULT_TABLE table=default.Table_3157ee54d08c4af5bb47202a85f9e9e2 [id=567b1e5dff914ca29357b2b8a025e266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.236232 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e578f5c21b4657bb9a5536f654c984. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:23.236454 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f46c12d092247589feabcd7825f7744 consensus state has no leader
I20260619 19:54:23.237918 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a16fdee448fb4975861b7cd46cbbc271 (table default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5]). Expected version 1 got 0
I20260619 19:54:23.238303 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 55404d15d42244c6b42272143c44ff9c (table default.Table_97f0e0bd83a94191a3339611d258d716 [id=e281514882fb422bbbe4d740eee2d029]) successfully deleted
I20260619 19:54:23.239440 902 tablet_service.cc:1511] Processing CreateTablet for tablet 4f6f5c5dd6e948faacd96f75ef59e00e (DEFAULT_TABLE table=default.Table_0c58e59a4fc14af398679e836a1a2433 [id=7582d03c883a4d5880c3c6368bb4131b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.239828 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6f5c5dd6e948faacd96f75ef59e00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.242372 1973 tablet_replica.cc:333] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:23.242596 1973 raft_consensus.cc:2243] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.242740 1973 raft_consensus.cc:2272] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.244485 1053 raft_consensus.cc:2468] T 9e7877d111a0438da74b7bcf396e2c71 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:23.246001 859 leader_election.cc:304] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:23.246454 3440 raft_consensus.cc:2804] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:23.246577 3440 raft_consensus.cc:697] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:23.246816 3440 consensus_queue.cc:237] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.247380 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 8c110bf3613d488fad99db968ac2db46 (DEFAULT_TABLE table=default.Table_98009ff8de10458ab7ba699d2d89bea5 [id=eae42f5bc9974b69934233011c64de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.247849 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet f39a95a0ac714de388ed04a8a14e4f6d) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.248708 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet ce68de8f421f4011ba9eafe4413d2294 (table default.Table_73012bddac2342c890794eda4a69443c [id=da90383254a64c8bb9a84858524084d2]). Expected version 1 got 0
I20260619 19:54:23.249187 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 9e7877d111a0438da74b7bcf396e2c71 (table default.Table_7adacc85728b464dbf461645536524d3 [id=e1f11bc6739d4427b75f310028bef998]). Expected version 1 got 0
I20260619 19:54:23.249440 530 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:23.250258 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c110bf3613d488fad99db968ac2db46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.252069 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 88d2da91229d4a5e815f37f5a607edd5 (DEFAULT_TABLE table=default.Table_10c903295c1d41ecb90fc2a5d717264b [id=2d104f8622614e6a81e02b157966c79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.252460 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d2da91229d4a5e815f37f5a607edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.255228 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (table default.Table_2e742d603b764daa86e93b4018379875 [id=33e3d383660b422582a47dcb68ae6be7]). Expected version 1 got 0
I20260619 19:54:23.256307 1201 tablet_bootstrap.cc:492] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.256420 889 tablet_service.cc:1511] Processing CreateTablet for tablet ddda494672344590a8467911d60d0f9a (DEFAULT_TABLE table=default.Table_6a13e6e937644610bc1fdc20c4ca45dc [id=40ddfa552cdd4582bcba3baa3df3c5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.256901 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddda494672344590a8467911d60d0f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.256526 1201 ts_tablet_manager.cc:1403] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.008s
I20260619 19:54:23.255795 531 catalog_manager.cc:5696] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:23.259624 531 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:23.260329 1201 raft_consensus.cc:359] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.260571 1201 raft_consensus.cc:385] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.260660 1201 raft_consensus.cc:740] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.260886 1201 consensus_queue.cc:260] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.261699 1201 ts_tablet_manager.cc:1434] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:23.262053 1201 tablet_bootstrap.cc:492] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.262403 890 tablet_service.cc:1511] Processing CreateTablet for tablet 8c110bf3613d488fad99db968ac2db46 (DEFAULT_TABLE table=default.Table_98009ff8de10458ab7ba699d2d89bea5 [id=eae42f5bc9974b69934233011c64de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.263237 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c110bf3613d488fad99db968ac2db46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:23.263612 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95f7527ee18540cea3d835e8988e6c5f consensus state has no leader
W20260619 19:54:23.264019 524 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 84986ae33a33426293a1a2c13c0a70fa consensus state has no leader
W20260619 19:54:23.265033 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 951dfc443c4944d0a44864184e0da9d4 consensus state has no leader
I20260619 19:54:23.265851 1973 ts_tablet_manager.cc:1916] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.269101 1994 ts_tablet_manager.cc:1929] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:23.269344 1994 log.cc:1199] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/d77de42bb514452a8dc6a4a71289dc59
I20260619 19:54:23.270298 1994 ts_tablet_manager.cc:1950] T d77de42bb514452a8dc6a4a71289dc59 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:23.270262 3417 tablet.cc:1724] T ce68de8f421f4011ba9eafe4413d2294 P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:23.276084 898 tablet_service.cc:1511] Processing CreateTablet for tablet 88d2da91229d4a5e815f37f5a607edd5 (DEFAULT_TABLE table=default.Table_10c903295c1d41ecb90fc2a5d717264b [id=2d104f8622614e6a81e02b157966c79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.276777 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d2da91229d4a5e815f37f5a607edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.277230 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_f3ac25c16c3d4b028bad4e868fbd7916"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.277768 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3ac25c16c3d4b028bad4e868fbd7916 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.278290 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_61900eacc07b48d18da9a94f78a4246f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.278728 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61900eacc07b48d18da9a94f78a4246f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.279181 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dd9b3658130141a483de115227dfaf0d" } modify_external_catalogs: true
I20260619 19:54:23.279520 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e0fd7432c9ca4d5f8d44743947ef4c65" } new_table_name: "default.Table_b92ae29ccbaa4eacad483e05b7944766" modify_external_catalogs: true
I20260619 19:54:23.279620 1201 tablet_bootstrap.cc:654] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.279935 532 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ccaf614a02d2417bb6703630eabddabe" } modify_external_catalogs: true
I20260619 19:54:23.280278 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d06bac02341e4e018a34562340ec7d74" } modify_external_catalogs: true
W20260619 19:54:23.285830 719 leader_election.cc:343] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Not found: Tablet not found: 74d8cd01251f4cfa93ecddb391c1c91e
I20260619 19:54:23.285977 719 leader_election.cc:304] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.285957 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 175d020b01ad47279407ea93a82d8f90 (DEFAULT_TABLE table=default.Table_8c3c636583ef494bbbf3e79fd60e9637 [id=c9998a17822f41c2aa62a04c01f5908e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.286355 3248 raft_consensus.cc:2749] T 74d8cd01251f4cfa93ecddb391c1c91e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.286392 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175d020b01ad47279407ea93a82d8f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.291826 3402 raft_consensus.cc:493] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.292029 3402 raft_consensus.cc:515] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.292695 3402 leader_election.cc:290] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.293066 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198bde101e7b4eeeb8de58aebe208bb4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:23.294127 996 leader_election.cc:343] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.295039 1994 tablet_replica.cc:333] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:23.295272 1208 tablet_bootstrap.cc:492] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.295451 1994 raft_consensus.cc:2243] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.295719 1994 raft_consensus.cc:2272] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.296461 1994 ts_tablet_manager.cc:1916] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.296705 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a39b06bad874a5d8c945c27c3552d43" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.297686 1208 tablet_bootstrap.cc:654] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.300078 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc77500e1774e3dafb9d7fe4d20f9f8 (DEFAULT_TABLE table=default.Table_fe3e51ff1bae43e9ac85ce9276811c5d [id=e3ef68b633dd478da71a802305824355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.300582 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc77500e1774e3dafb9d7fe4d20f9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.301767 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 9f46c12d092247589feabcd7825f7744 (DEFAULT_TABLE table=default.Table_d9674ec73ac245d1aaf0d2b14b825f20 [id=a15792e31a7a498b9a0c3ed7b3cb0fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.302327 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f46c12d092247589feabcd7825f7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.303535 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198bde101e7b4eeeb8de58aebe208bb4" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:23.304744 996 leader_election.cc:343] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.305213 996 leader_election.cc:304] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.305856 3402 raft_consensus.cc:2749] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.311048 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 78aa3459aa9441bcae40a2412793c9a3 (DEFAULT_TABLE table=default.Table_dfd28dcc8602420fa6d621c66de1acc1 [id=d6d7c1ee4db14fd89293408241d0b83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.311661 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aa3459aa9441bcae40a2412793c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.312068 3453 tablet.cc:1724] T ce68de8f421f4011ba9eafe4413d2294 P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:23.315964 1201 tablet_bootstrap.cc:492] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.316231 1201 ts_tablet_manager.cc:1403] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.002s
I20260619 19:54:23.317741 1201 raft_consensus.cc:359] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.318028 1201 raft_consensus.cc:385] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.318138 1201 raft_consensus.cc:740] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.317924 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7c2004721849415b9906895ce0b16400" } modify_external_catalogs: true
I20260619 19:54:23.318427 1201 consensus_queue.cc:260] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.319048 1201 ts_tablet_manager.cc:1434] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:23.319532 1201 tablet_bootstrap.cc:492] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.321461 1201 tablet_bootstrap.cc:654] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.324848 1208 tablet_bootstrap.cc:492] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:23.327184 1208 ts_tablet_manager.cc:1403] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260619 19:54:23.326728 527 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_49f1ac224667406c911df75e315f9f22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:23.330476 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_d06bac02341e4e018a34562340ec7d74" } modify_external_catalogs: true
I20260619 19:54:23.332538 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_dd9b3658130141a483de115227dfaf0d" } modify_external_catalogs: true
I20260619 19:54:23.334493 1208 raft_consensus.cc:359] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.334931 532 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ccaf614a02d2417bb6703630eabddabe" } modify_external_catalogs: true
I20260619 19:54:23.338157 1208 raft_consensus.cc:385] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.341138 1208 raft_consensus.cc:740] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.342319 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet d77de42bb514452a8dc6a4a71289dc59 (table default.Table_0258778fee574c1a9ed68d07e46694f4 [id=94a5aa43010a4086a2b9f24ceeaf4013]) successfully deleted
W20260619 19:54:23.342718 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet a6433bc9150946d5b0bb7900cc30ed42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6433bc9150946d5b0bb7900cc30ed42 already in progress: creating tablet
I20260619 19:54:23.337638 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7877d111a0438da74b7bcf396e2c71" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.341275 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e7877d111a0438da74b7bcf396e2c71" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:23.344542 773 raft_consensus.cc:2468] T 9e7877d111a0438da74b7bcf396e2c71 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:23.344811 526 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c45864e60c3c440687e7a576199bd321" } modify_external_catalogs: true
I20260619 19:54:23.345096 526 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_c45864e60c3c440687e7a576199bd321" } modify_external_catalogs: true
I20260619 19:54:23.345146 1208 consensus_queue.cc:260] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:23.346719 527 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49f1ac224667406c911df75e315f9f22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.349177 3248 raft_consensus.cc:493] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.349368 3248 raft_consensus.cc:515] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:23.350499 3248 leader_election.cc:290] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
I20260619 19:54:23.350665 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_7c2004721849415b9906895ce0b16400" } modify_external_catalogs: true
I20260619 19:54:23.350883 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056f7982f51f45a78d2b9b0a0b50576e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
W20260619 19:54:23.352478 720 leader_election.cc:343] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 056f7982f51f45a78d2b9b0a0b50576e
I20260619 19:54:23.352955 910 raft_consensus.cc:2393] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:23.354147 1208 ts_tablet_manager.cc:1434] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260619 19:54:23.354938 1201 tablet_bootstrap.cc:492] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.355206 1201 ts_tablet_manager.cc:1403] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.003s
I20260619 19:54:23.356252 1022 tablet_service.cc:1558] Processing DeleteTablet for tablet e22e0f53008c4a96bf56b7f057f81cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.356379 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.354401 719 leader_election.cc:304] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.356747 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1642bc8d3f984e1c9d60093fa7abcc53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:18 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.357055 3248 raft_consensus.cc:3060] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.357599 1994 ts_tablet_manager.cc:1929] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260619 19:54:23.357748 1994 log.cc:1199] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/b6a468ca001340e98addf91dd3829efa
I20260619 19:54:23.358146 1994 ts_tablet_manager.cc:1950] T b6a468ca001340e98addf91dd3829efa P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:23.360335 3248 raft_consensus.cc:2749] T 056f7982f51f45a78d2b9b0a0b50576e P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.360745 895 tablet_service.cc:1511] Processing CreateTablet for tablet 745c2ac28ff24969b778b5abd3f406af (DEFAULT_TABLE table=default.Table_19bc418b3c714dd09369d232f417db60 [id=bee345f6db96404cb9edfd320cb757b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.367954 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet b6a468ca001340e98addf91dd3829efa (table default.Table_eec88df8f25c46658bbd65c3076678bb [id=394d8c70bca54b0eb32990278e06cd91]) successfully deleted
I20260619 19:54:23.371865 1994 tablet_replica.cc:333] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:23.374539 1994 raft_consensus.cc:2243] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.374938 1994 raft_consensus.cc:2272] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.376163 3248 consensus_queue.cc:1048] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:23.381489 1994 ts_tablet_manager.cc:1916] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.336694 1973 ts_tablet_manager.cc:1929] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:23.384992 531 master_service.cc:960] ReplaceTablet: received request to replace tablet b57f64f97cdc493ea48e08d897bfc982 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:23.383189 1973 log.cc:1199] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/3ae6164970ec4977a8c0c9fd24ab7275
I20260619 19:54:23.387626 1973 ts_tablet_manager.cc:1950] T 3ae6164970ec4977a8c0c9fd24ab7275 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:23.387015 1208 tablet_bootstrap.cc:492] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.390981 1208 tablet_bootstrap.cc:654] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.392458 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745c2ac28ff24969b778b5abd3f406af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.394963 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.394785 1973 tablet_replica.cc:333] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:23.396817 1973 raft_consensus.cc:2243] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.397066 1973 raft_consensus.cc:2272] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.397655 1973 ts_tablet_manager.cc:1916] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:23.402765 720 consensus_peers.cc:597] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32ecd267aa34469cad9db0745178013b. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.405195 3406 raft_consensus.cc:493] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.405433 3406 raft_consensus.cc:515] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.406554 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16fdee448fb4975861b7cd46cbbc271" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:23.407383 996 leader_election.cc:343] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:23.392059 858 leader_election.cc:343] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.367515 1201 raft_consensus.cc:359] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.410161 1201 raft_consensus.cc:385] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.410288 1201 raft_consensus.cc:740] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.410596 3406 leader_election.cc:290] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.410544 1201 consensus_queue.cc:260] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.411336 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16fdee448fb4975861b7cd46cbbc271" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:23.411520 919 raft_consensus.cc:2468] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:23.399356 3442 raft_consensus.cc:493] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.411783 3442 raft_consensus.cc:515] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.412312 1201 ts_tablet_manager.cc:1434] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.057s user 0.002s sys 0.000s
I20260619 19:54:23.412595 3442 leader_election.cc:290] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.412971 996 leader_election.cc:304] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.413017 858 leader_election.cc:304] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.413791 3440 raft_consensus.cc:2749] T 0a39b06bad874a5d8c945c27c3552d43 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.414351 3406 raft_consensus.cc:2804] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:23.414433 3406 raft_consensus.cc:493] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:23.414487 3406 raft_consensus.cc:3060] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:23.415042 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5783716513840e0a046b23d245b5700 consensus state has no leader
I20260619 19:54:23.415450 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_e14ec5bd8bc44737b3b3721614b36dfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.415993 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e14ec5bd8bc44737b3b3721614b36dfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.417104 3406 raft_consensus.cc:515] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.417498 3440 raft_consensus.cc:493] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.417629 3440 raft_consensus.cc:515] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.417829 532 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 58c2959e96144fdf8f20c99ca7e4b415
I20260619 19:54:23.418169 1994 ts_tablet_manager.cc:1929] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:23.418279 1994 log.cc:1199] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/01fe4b37c74b4fb496f2842407c65eb1
I20260619 19:54:23.418274 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16fdee448fb4975861b7cd46cbbc271" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:23.418497 3440 leader_election.cc:290] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.418566 1994 ts_tablet_manager.cc:1950] T 01fe4b37c74b4fb496f2842407c65eb1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:23.418530 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3b986ac8d3e44c56b8639d922ad2dba9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.418725 996 leader_election.cc:343] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.412635 1201 tablet_bootstrap.cc:492] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
W20260619 19:54:23.419212 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b986ac8d3e44c56b8639d922ad2dba9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.421057 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 88dc27a9f1c7442bbe803120a5d043fe
I20260619 19:54:23.421970 1201 tablet_bootstrap.cc:654] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.422006 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_20a5ab23d8714167b6201b1755886c70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.422974 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20a5ab23d8714167b6201b1755886c70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.423338 3406 leader_election.cc:290] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.423913 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16fdee448fb4975861b7cd46cbbc271" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:23.424165 910 raft_consensus.cc:3060] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.425084 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_23809c4f6889440cb503fa3abf2e3d2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.425748 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23809c4f6889440cb503fa3abf2e3d2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 19:54:23.425930 858 leader_election.cc:343] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 801f08f4daa842238460506ccd0c466f
I20260619 19:54:23.426100 858 leader_election.cc:304] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.426396 3290 raft_consensus.cc:2749] T 801f08f4daa842238460506ccd0c466f P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260619 19:54:23.427562 858 consensus_peers.cc:597] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.427976 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet db4f8c148d7d45969ec77b02e885bcbe
I20260619 19:54:23.428785 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_3e1e2133ec5b4773ab8d1105a736cd90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.429483 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e1e2133ec5b4773ab8d1105a736cd90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.429889 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198bde101e7b4eeeb8de58aebe208bb4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.430449 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c5f9405d6a4a16bd49697001c201e1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:23.431208 858 leader_election.cc:343] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:23.431465 858 leader_election.cc:343] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.436296 529 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (table default.Table_2e742d603b764daa86e93b4018379875 [id=33e3d383660b422582a47dcb68ae6be7]). Expected version 1 got 0
I20260619 19:54:23.437125 1994 tablet_replica.cc:333] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:23.438855 910 raft_consensus.cc:2468] T a16fdee448fb4975861b7cd46cbbc271 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:23.439230 859 consensus_peers.cc:597] T d77de42bb514452a8dc6a4a71289dc59 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d77de42bb514452a8dc6a4a71289dc59. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.437898 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c5f9405d6a4a16bd49697001c201e1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.439684 1058 raft_consensus.cc:2468] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:23.439726 996 leader_election.cc:304] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.438112 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198bde101e7b4eeeb8de58aebe208bb4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.440075 1053 raft_consensus.cc:2468] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:23.440552 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c2959e96144fdf8f20c99ca7e4b415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.440856 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 88dc27a9f1c7442bbe803120a5d043fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.440840 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 01fe4b37c74b4fb496f2842407c65eb1 (table default.Table_8e9360a87f5a4f8b990df38ad739a3c5 [id=050ce6b1eee349318da902df45aa205e]) successfully deleted
I20260619 19:54:23.441062 3406 raft_consensus.cc:2804] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:23.441334 3406 raft_consensus.cc:697] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:23.440104 1994 raft_consensus.cc:2243] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.441617 3406 consensus_queue.cc:237] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.441745 859 leader_election.cc:304] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.441841 1994 raft_consensus.cc:2272] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.442209 859 leader_election.cc:304] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.442848 3440 raft_consensus.cc:2804] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:23.443039 3440 raft_consensus.cc:493] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:23.443122 3440 raft_consensus.cc:3060] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.443526 526 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 47eb6580ead349188460a0fb8ada1262
I20260619 19:54:23.444865 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 47eb6580ead349188460a0fb8ada1262 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.445961 3440 raft_consensus.cc:515] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.446906 3440 leader_election.cc:290] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.447093 3440 raft_consensus.cc:2804] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:23.447207 3440 raft_consensus.cc:493] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:23.447294 3440 raft_consensus.cc:3060] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.447546 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c5f9405d6a4a16bd49697001c201e1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:23.447769 1053 raft_consensus.cc:3060] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.447700 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5a0003dbf1994e22a2c7341e885faf2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.448491 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a0003dbf1994e22a2c7341e885faf2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.449930 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet db4f8c148d7d45969ec77b02e885bcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.450071 3276 raft_consensus.cc:493] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.450178 3276 raft_consensus.cc:515] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.450762 1053 raft_consensus.cc:2468] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:23.450845 3276 leader_election.cc:290] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.451247 859 leader_election.cc:304] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:23.451581 3276 raft_consensus.cc:2804] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:23.451696 3276 raft_consensus.cc:697] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:23.451856 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607e0d85a22e4d7bb8eda33a5a6b5d0f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.451982 3276 consensus_queue.cc:237] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.452176 1200 tablet_bootstrap.cc:492] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.452328 1200 ts_tablet_manager.cc:1403] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.289s user 0.004s sys 0.000s
I20260619 19:54:23.452989 1200 raft_consensus.cc:359] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.453174 1200 raft_consensus.cc:385] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.453243 1200 raft_consensus.cc:740] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.453466 1200 consensus_queue.cc:260] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.454285 1200 ts_tablet_manager.cc:1434] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:23.454634 1200 tablet_bootstrap.cc:492] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.456609 1200 tablet_bootstrap.cc:654] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.456671 1208 tablet_bootstrap.cc:492] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:23.457445 1994 ts_tablet_manager.cc:1916] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:23.457782 859 leader_election.cc:343] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.461763 3440 raft_consensus.cc:515] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.462307 531 master_service.cc:960] ReplaceTablet: received request to replace tablet e244971a6b0b424db6d16d233b32a96e from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:23.462878 1201 tablet_bootstrap.cc:492] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.463164 1201 ts_tablet_manager.cc:1403] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.000s
I20260619 19:54:23.464206 1201 raft_consensus.cc:359] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.468329 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198bde101e7b4eeeb8de58aebe208bb4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:23.468606 1053 raft_consensus.cc:3060] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.471422 1053 raft_consensus.cc:2468] T 198bde101e7b4eeeb8de58aebe208bb4 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:23.465827 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c5f9405d6a4a16bd49697001c201e1" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:23.473188 1208 ts_tablet_manager.cc:1403] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.086s user 0.007s sys 0.000s
I20260619 19:54:23.473912 1208 raft_consensus.cc:359] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.474545 1208 raft_consensus.cc:385] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.474681 1208 raft_consensus.cc:740] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.474972 1208 consensus_queue.cc:260] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.471900 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607e0d85a22e4d7bb8eda33a5a6b5d0f" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.472506 3463 tablet.cc:1724] T ce68de8f421f4011ba9eafe4413d2294 P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 19:54:23.468173 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "198bde101e7b4eeeb8de58aebe208bb4" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
I20260619 19:54:23.464686 1201 raft_consensus.cc:385] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.484004 1201 raft_consensus.cc:740] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.484524 1201 consensus_queue.cc:260] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.485332 1201 ts_tablet_manager.cc:1434] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260619 19:54:23.485492 1208 ts_tablet_manager.cc:1434] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260619 19:54:23.485785 1201 tablet_bootstrap.cc:492] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.488013 530 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 6f37e153b53c471da1f304ae1ada0b2d
W20260619 19:54:23.468972 859 consensus_peers.cc:597] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73029f4bc97349da9d5d2fae4321cd5f. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.489748 859 leader_election.cc:304] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:23.490762 3290 raft_consensus.cc:2804] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:23.490955 3290 raft_consensus.cc:697] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:23.486753 1973 ts_tablet_manager.cc:1929] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:23.491300 3290 consensus_queue.cc:237] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.491447 1973 log.cc:1199] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/495bafb07abe45da9f62138453dd6636
I20260619 19:54:23.466439 3440 leader_election.cc:290] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.497498 1201 tablet_bootstrap.cc:654] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.499537 1973 ts_tablet_manager.cc:1950] T 495bafb07abe45da9f62138453dd6636 P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:23.500677 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f37e153b53c471da1f304ae1ada0b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.502522 1973 tablet_replica.cc:333] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:23.504948 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_61c5a25012404c098fa35b67fe3de51c" } new_table_name: "default.Table_b3a59c590ca24606b7cfc1d6c617e1fa" modify_external_catalogs: true
I20260619 19:54:23.507246 1208 tablet_bootstrap.cc:492] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.509598 1973 raft_consensus.cc:2243] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:23.510818 1973 raft_consensus.cc:2272] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.509897 1208 tablet_bootstrap.cc:654] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:23.512217 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 273969us
I20260619 19:54:23.513128 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 056f7982f51f45a78d2b9b0a0b50576e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:10 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.513742 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 74d8cd01251f4cfa93ecddb391c1c91e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.514218 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd6b786bd844781af7fdc5849e90009 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.514806 1973 ts_tablet_manager.cc:1916] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:23.478993 858 leader_election.cc:343] T 02c5f9405d6a4a16bd49697001c201e1 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.513238 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 3091dd1a525a4f779c68b8b77afa5b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:09 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.513402 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 01fe4b37c74b4fb496f2842407c65eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet f39a95a0ac714de388ed04a8a14e4f6d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.513511 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 495bafb07abe45da9f62138453dd6636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:02 UTC) from {username='slave'} at 127.0.0.1:35892
W20260619 19:54:23.531811 858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 52828.4us
W20260619 19:54:23.532581 858 leader_election.cc:343] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.532783 858 leader_election.cc:304] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.533074 3442 raft_consensus.cc:2749] T 607e0d85a22e4d7bb8eda33a5a6b5d0f P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 19:54:23.533476 858 leader_election.cc:343] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.534612 749 tablet_service.cc:1511] Processing CreateTablet for tablet 9f46c12d092247589feabcd7825f7744 (DEFAULT_TABLE table=default.Table_d9674ec73ac245d1aaf0d2b14b825f20 [id=a15792e31a7a498b9a0c3ed7b3cb0fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.534647 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9f46c12d092247589feabcd7825f7744 (DEFAULT_TABLE table=default.Table_d9674ec73ac245d1aaf0d2b14b825f20 [id=a15792e31a7a498b9a0c3ed7b3cb0fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.535058 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f46c12d092247589feabcd7825f7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.535058 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f46c12d092247589feabcd7825f7744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.536209 1201 tablet_bootstrap.cc:492] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.536510 1201 ts_tablet_manager.cc:1403] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260619 19:54:23.537626 1201 raft_consensus.cc:359] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.537810 1201 raft_consensus.cc:385] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.537868 1201 raft_consensus.cc:740] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.538086 1201 consensus_queue.cc:260] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.544454 528 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ee5db39ab80c471994b4634a3071ec26" } new_table_name: "default.Table_21c4168205734c5c84641251e82ee4ef" modify_external_catalogs: true
I20260619 19:54:23.547609 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9f36b5de86014245b17ba026519b4848" } new_table_name: "default.Table_c77919fda8a24cb483c5663be572564d" modify_external_catalogs: true
I20260619 19:54:23.552070 749 tablet_service.cc:1511] Processing CreateTablet for tablet 78aa3459aa9441bcae40a2412793c9a3 (DEFAULT_TABLE table=default.Table_dfd28dcc8602420fa6d621c66de1acc1 [id=d6d7c1ee4db14fd89293408241d0b83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.552632 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aa3459aa9441bcae40a2412793c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.552874 1201 ts_tablet_manager.cc:1434] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260619 19:54:23.553337 1994 ts_tablet_manager.cc:1929] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:23.553529 1994 log.cc:1199] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/e22e0f53008c4a96bf56b7f057f81cd5
I20260619 19:54:23.553916 1994 ts_tablet_manager.cc:1950] T e22e0f53008c4a96bf56b7f057f81cd5 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:23.555218 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet e22e0f53008c4a96bf56b7f057f81cd5 (table default.Table_cdf577f46fe04a03b5ee265415239167 [id=b4dcc2ac85a7493ba006481f2746cb51]) successfully deleted
I20260619 19:54:23.559494 1201 tablet_bootstrap.cc:492] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.561888 895 tablet_service.cc:1511] Processing CreateTablet for tablet 78aa3459aa9441bcae40a2412793c9a3 (DEFAULT_TABLE table=default.Table_dfd28dcc8602420fa6d621c66de1acc1 [id=d6d7c1ee4db14fd89293408241d0b83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.562348 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aa3459aa9441bcae40a2412793c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.569182 1208 tablet_bootstrap.cc:492] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:23.569715 1201 tablet_bootstrap.cc:654] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.570289 1208 ts_tablet_manager.cc:1403] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.000s
I20260619 19:54:23.571269 1208 raft_consensus.cc:359] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.571552 1208 raft_consensus.cc:385] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.571666 1208 raft_consensus.cc:740] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.572376 1208 consensus_queue.cc:260] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.573778 764 tablet_service.cc:1511] Processing CreateTablet for tablet 175d020b01ad47279407ea93a82d8f90 (DEFAULT_TABLE table=default.Table_8c3c636583ef494bbbf3e79fd60e9637 [id=c9998a17822f41c2aa62a04c01f5908e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.574492 753 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc77500e1774e3dafb9d7fe4d20f9f8 (DEFAULT_TABLE table=default.Table_fe3e51ff1bae43e9ac85ce9276811c5d [id=e3ef68b633dd478da71a802305824355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.574790 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c2959e96144fdf8f20c99ca7e4b415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.575528 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 88dc27a9f1c7442bbe803120a5d043fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.575760 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175d020b01ad47279407ea93a82d8f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.576042 757 tablet_service.cc:1558] Processing DeleteTablet for tablet db4f8c148d7d45969ec77b02e885bcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.577026 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 47eb6580ead349188460a0fb8ada1262 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.577656 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f37e153b53c471da1f304ae1ada0b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.579610 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc77500e1774e3dafb9d7fe4d20f9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.581938 1200 tablet_bootstrap.cc:492] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.582124 1200 ts_tablet_manager.cc:1403] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.000s
I20260619 19:54:23.583066 1200 raft_consensus.cc:359] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.587962 1200 raft_consensus.cc:385] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.588115 1200 raft_consensus.cc:740] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.588426 1200 consensus_queue.cc:260] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.589385 1200 ts_tablet_manager.cc:1434] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260619 19:54:23.589775 1200 tablet_bootstrap.cc:492] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.574048 902 tablet_service.cc:1511] Processing CreateTablet for tablet 175d020b01ad47279407ea93a82d8f90 (DEFAULT_TABLE table=default.Table_8c3c636583ef494bbbf3e79fd60e9637 [id=c9998a17822f41c2aa62a04c01f5908e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.592041 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175d020b01ad47279407ea93a82d8f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.574607 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc77500e1774e3dafb9d7fe4d20f9f8 (DEFAULT_TABLE table=default.Table_fe3e51ff1bae43e9ac85ce9276811c5d [id=e3ef68b633dd478da71a802305824355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.595515 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc77500e1774e3dafb9d7fe4d20f9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.598891 1200 tablet_bootstrap.cc:654] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.575058 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c2959e96144fdf8f20c99ca7e4b415 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.577836 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 47eb6580ead349188460a0fb8ada1262 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.578814 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 88dc27a9f1c7442bbe803120a5d043fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.578951 885 tablet_service.cc:1558] Processing DeleteTablet for tablet db4f8c148d7d45969ec77b02e885bcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.579119 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f37e153b53c471da1f304ae1ada0b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.615964 3276 consensus_queue.cc:1048] T 73029f4bc97349da9d5d2fae4321cd5f P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:23.619727 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 3ae6164970ec4977a8c0c9fd24ab7275 (table default.Table_58686549f5974cedb2fc3a15c08d9207 [id=19f4b9169a634b9d8fc0212981f18682]) successfully deleted
I20260619 19:54:23.620307 3290 raft_consensus.cc:493] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1f5f240547f42ec82f57e6c8af5ea89)
I20260619 19:54:23.620507 3290 raft_consensus.cc:515] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
I20260619 19:54:23.620803 1208 ts_tablet_manager.cc:1434] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.050s user 0.002s sys 0.000s
I20260619 19:54:23.621166 1208 tablet_bootstrap.cc:492] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.621263 3290 leader_election.cc:290] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:23.622607 859 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:23.622988 1208 tablet_bootstrap.cc:654] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:23.625097 858 leader_election.cc:343] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: fde2b5d12ab7465791f26d214c2dc2f5
I20260619 19:54:23.625242 858 leader_election.cc:304] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.625485 3276 raft_consensus.cc:2749] T fde2b5d12ab7465791f26d214c2dc2f5 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 19:54:23.627671 1994 tablet_replica.cc:333] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:23.628368 1994 raft_consensus.cc:2243] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:23.628822 1994 pending_rounds.cc:70] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Trying to abort 1 pending ops.
I20260619 19:54:23.628935 1994 pending_rounds.cc:77] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298657743782191104 op_type: NO_OP noop_request { }
I20260619 19:54:23.629104 1994 raft_consensus.cc:2889] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 19:54:23.629280 1994 raft_consensus.cc:2272] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.630559 1994 ts_tablet_manager.cc:1916] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.638980 1201 tablet_bootstrap.cc:492] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.639185 1201 ts_tablet_manager.cc:1403] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.001s
I20260619 19:54:23.639899 1201 raft_consensus.cc:359] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.640091 1201 raft_consensus.cc:385] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.640141 1201 raft_consensus.cc:740] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.640384 1201 consensus_queue.cc:260] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.652436 1201 ts_tablet_manager.cc:1434] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260619 19:54:23.653368 1201 tablet_bootstrap.cc:492] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.657418 1973 ts_tablet_manager.cc:1929] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:23.657673 3460 raft_consensus.cc:493] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.657819 3460 raft_consensus.cc:515] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.658579 3460 leader_election.cc:290] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.659729 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:23.659767 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1642bc8d3f984e1c9d60093fa7abcc53" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.659968 910 raft_consensus.cc:2393] T 1642bc8d3f984e1c9d60093fa7abcc53 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate 95181cc281b946c8b81aa825232d9498 in this term.
I20260619 19:54:23.660152 1058 raft_consensus.cc:2393] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:23.660895 720 leader_election.cc:304] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.661376 3460 raft_consensus.cc:3060] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.638162 1200 tablet_bootstrap.cc:492] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.664119 1200 ts_tablet_manager.cc:1403] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.000s
I20260619 19:54:23.664403 3460 raft_consensus.cc:2749] T 1642bc8d3f984e1c9d60093fa7abcc53 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.665125 1200 raft_consensus.cc:359] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.665370 1200 raft_consensus.cc:385] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.665433 1200 raft_consensus.cc:740] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.665772 1200 consensus_queue.cc:260] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.666512 1200 ts_tablet_manager.cc:1434] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 19:54:23.668705 1200 tablet_bootstrap.cc:492] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.676818 1201 tablet_bootstrap.cc:654] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
W20260619 19:54:23.679581 859 consensus_peers.cc:597] T 41455237399b45efbe8190dcb01e764c P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41455237399b45efbe8190dcb01e764c. This is attempt 6: this message will repeat every 5th retry.
I20260619 19:54:23.683830 3402 consensus_queue.cc:1048] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:23.691872 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_b14adf8fae244e7ba3e4fe985bccbfce" } new_table_name: "default.Table_d602aa867a5f4217b09f29243f44a992" modify_external_catalogs: true
I20260619 19:54:23.693737 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_adf1e885539b4f19a7d39f3a9bbff88f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.694357 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adf1e885539b4f19a7d39f3a9bbff88f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.696712 2026 ts_tablet_manager.cc:1950] T bf175c80483346788a148b7277b9ca9d P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:23.697259 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 495bafb07abe45da9f62138453dd6636 (table default.Table_96b2c29bad4c4371b337dc4318ef79ff [id=ca34531aaa3d4fb3a1e303bdeb31a103]) successfully deleted
W20260619 19:54:23.697408 518 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.105.129:41107, user_credentials={real_user=slave}} blocked reactor thread for 77299.4us
I20260619 19:54:23.697576 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 459) took 13473 ms. Trace:
I20260619 19:54:23.697645 2026 rpcz_store.cc:276] 0619 19:54:10.223809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.224127 (+ 318us) service_pool.cc:224] Handling call
0619 19:54:22.918326 (+12694199us) ts_tablet_manager.cc:1151] Deleting tablet bf175c80483346788a148b7277b9ca9d
0619 19:54:22.918335 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:22.942756 (+ 24421us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:22.974617 (+ 31861us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:23.697556 (+722939us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12694012}
I20260619 19:54:23.698560 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet bf175c80483346788a148b7277b9ca9d (table default.Table_87768bcb7d2347faa2a8624f28911b02 [id=14dbea33ca974c8fa94e99d0d9f79272]) successfully deleted
I20260619 19:54:23.703094 1973 log.cc:1199] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/32ecd267aa34469cad9db0745178013b
I20260619 19:54:23.704272 1208 tablet_bootstrap.cc:492] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:23.711822 1208 ts_tablet_manager.cc:1403] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.091s user 0.000s sys 0.005s
W20260619 19:54:23.712534 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06037415255f4b958222296f53e58622 consensus state has no leader
W20260619 19:54:23.715231 996 consensus_peers.cc:597] T 526af16b6a6a4cac9c084900b22d9acf P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.712003 1973 ts_tablet_manager.cc:1950] T 32ecd267aa34469cad9db0745178013b P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:23.724386 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 919) took 1178 ms. Trace:
I20260619 19:54:23.724503 1973 rpcz_store.cc:276] 0619 19:54:22.546434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:22.546542 (+ 108us) service_pool.cc:224] Handling call
0619 19:54:23.502463 (+955921us) ts_tablet_manager.cc:1151] Deleting tablet 32ecd267aa34469cad9db0745178013b
0619 19:54:23.502476 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.564586 (+ 62110us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:23.657346 (+ 92760us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:23.724358 (+ 67012us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":955774}
I20260619 19:54:23.725565 1973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56684 (request call id 920) took 1066 ms. Trace:
I20260619 19:54:23.725652 1973 rpcz_store.cc:276] 0619 19:54:22.659063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:22.663555 (+ 4492us) service_pool.cc:224] Handling call
0619 19:54:23.725422 (+1061867us) ts_tablet_manager.cc:1151] Deleting tablet 2c512a30b4fa48fb89bc1ea968ad6536
0619 19:54:23.725433 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.725546 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061470}
I20260619 19:54:23.726329 1973 tablet_replica.cc:333] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:23.726579 1973 raft_consensus.cc:2243] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.726576 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 32ecd267aa34469cad9db0745178013b (table default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d [id=2bb6ef83e0904d7ca2ca88a5ef5f3094]) successfully deleted
I20260619 19:54:23.726810 1973 raft_consensus.cc:2272] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 19:54:23.726862 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet 2c512a30b4fa48fb89bc1ea968ad6536 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c512a30b4fa48fb89bc1ea968ad6536 already in progress: creating tablet
W20260619 19:54:23.727042 518 catalog_manager.cc:5007] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): delete failed for tablet e12ad1228ed5406e8ac6c82f7ac621d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e12ad1228ed5406e8ac6c82f7ac621d7 already in progress: creating tablet
I20260619 19:54:23.727588 1208 raft_consensus.cc:359] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:23.716260 532 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9faffd96d2e34ed49545b34c47a33405 consensus state has no leader
I20260619 19:54:23.712960 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_20009449913645dd94ed19d26c09bc80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:23.728389 1208 raft_consensus.cc:385] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.728456 1208 raft_consensus.cc:740] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.728691 1208 consensus_queue.cc:260] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.729213 785 raft_consensus.cc:3060] T e4688dc20317479e9c80f6f41b3ea35e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.729456 1208 ts_tablet_manager.cc:1434] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.016s user 0.000s sys 0.001s
I20260619 19:54:23.729599 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 460) took 13472 ms. Trace:
I20260619 19:54:23.729677 2026 rpcz_store.cc:276] 0619 19:54:10.256964 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.257038 (+ 74us) service_pool.cc:224] Handling call
0619 19:54:23.727044 (+13470006us) ts_tablet_manager.cc:1151] Deleting tablet 46c2a94a4d794f2aa94b77885812831f
0619 19:54:23.727058 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.729576 (+ 2518us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13469809}
W20260619 19:54:23.730258 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 46c2a94a4d794f2aa94b77885812831f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46c2a94a4d794f2aa94b77885812831f already in progress: creating tablet
I20260619 19:54:23.731105 1200 tablet_bootstrap.cc:654] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.731544 3453 tablet.cc:1724] T 84dbba24094d4630be45b7febe8cb29e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:23.733304 3417 tablet.cc:1724] T 84dbba24094d4630be45b7febe8cb29e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260619 19:54:23.734135 528 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 953d7b48670e4b54b9489ff679f248ec consensus state has no leader
I20260619 19:54:23.734521 528 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_73012bddac2342c890794eda4a69443c" } modify_external_catalogs: true
I20260619 19:54:23.734665 528 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_73012bddac2342c890794eda4a69443c" } modify_external_catalogs: true
W20260619 19:54:23.735219 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20009449913645dd94ed19d26c09bc80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.735934 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet e244971a6b0b424db6d16d233b32a96e
I20260619 19:54:23.736379 531 catalog_manager.cc:6784] ReplaceTablet: tablet e244971a6b0b424db6d16d233b32a96e deleted and replaced by tablet da040231c3ef4ab7afa8b8f952f3f98d
I20260619 19:54:23.736642 531 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5df77d322daf403ba382436b5192ca95" } modify_external_catalogs: true
I20260619 19:54:23.736769 531 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_5df77d322daf403ba382436b5192ca95" } modify_external_catalogs: true
I20260619 19:54:23.737411 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e244971a6b0b424db6d16d233b32a96e with delete_type TABLET_DATA_DELETED (replaced by tablet da040231c3ef4ab7afa8b8f952f3f98d) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.740808 532 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_f5566dfcba0c4225b2a141d7bcb7d135" } new_table_name: "default.Table_95eea0b25d30489c8eb7a012f04a53ec" modify_external_catalogs: true
I20260619 19:54:23.741926 895 tablet_service.cc:1558] Processing DeleteTablet for tablet e244971a6b0b424db6d16d233b32a96e with delete_type TABLET_DATA_DELETED (replaced by tablet da040231c3ef4ab7afa8b8f952f3f98d) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.742076 749 tablet_service.cc:1558] Processing DeleteTablet for tablet e244971a6b0b424db6d16d233b32a96e with delete_type TABLET_DATA_DELETED (replaced by tablet da040231c3ef4ab7afa8b8f952f3f98d) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.745270 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_ab5c9fe748af4186891c8d32fa3a7418"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:23.745635 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 465) took 13378 ms. Trace:
I20260619 19:54:23.745723 2026 rpcz_store.cc:276] 0619 19:54:10.366893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.366950 (+ 57us) service_pool.cc:224] Handling call
0619 19:54:23.745498 (+13378548us) ts_tablet_manager.cc:1151] Deleting tablet 5e5c1ffd83c944ada87d59439b6a9cb3
0619 19:54:23.745508 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.745614 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13378271}
I20260619 19:54:23.747529 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 466) took 13361 ms. Trace:
I20260619 19:54:23.747682 2026 rpcz_store.cc:276] 0619 19:54:10.386115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.386716 (+ 601us) service_pool.cc:224] Handling call
0619 19:54:23.747416 (+13360700us) ts_tablet_manager.cc:1151] Deleting tablet c3c0937d5fea430da4dbdf9381157268
0619 19:54:23.747425 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.747511 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13360495}
W20260619 19:54:23.748029 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab5c9fe748af4186891c8d32fa3a7418 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.748513 1208 tablet_bootstrap.cc:492] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.749836 2026 tablet_replica.cc:333] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:23.750232 2026 raft_consensus.cc:2243] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.750880 773 raft_consensus.cc:3060] T 4cd6b786bd844781af7fdc5849e90009 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.751827 2026 raft_consensus.cc:2272] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.752417 2026 ts_tablet_manager.cc:1916] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.754487 3463 tablet.cc:1724] T 84dbba24094d4630be45b7febe8cb29e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 19:54:23.756606 1200 tablet_bootstrap.cc:492] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.756738 1200 ts_tablet_manager.cc:1403] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.090s user 0.001s sys 0.002s
I20260619 19:54:23.757423 1200 raft_consensus.cc:359] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.757581 1200 raft_consensus.cc:385] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.757629 1200 raft_consensus.cc:740] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.757588 526 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
W20260619 19:54:23.759093 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 5e5c1ffd83c944ada87d59439b6a9cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e5c1ffd83c944ada87d59439b6a9cb3 already in progress: creating tablet
W20260619 19:54:23.759364 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet c3c0937d5fea430da4dbdf9381157268 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3c0937d5fea430da4dbdf9381157268 already in progress: creating tablet
I20260619 19:54:23.759977 3290 consensus_queue.cc:1048] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:23.765769 1208 tablet_bootstrap.cc:654] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.767642 1200 consensus_queue.cc:260] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:23.769688 518 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 06037415255f4b958222296f53e58622 (table default.Table_b3a59c590ca24606b7cfc1d6c617e1fa [id=9aa815ccd2154e3085a68236b18e7e59], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 06037415255f4b958222296f53e58622 consensus state has no leader
I20260619 19:54:23.770332 1994 ts_tablet_manager.cc:1929] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:23.771270 1994 log.cc:1199] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/dcc9c4167c58495fbfcf5fb60952c884
I20260619 19:54:23.771895 1994 ts_tablet_manager.cc:1950] T dcc9c4167c58495fbfcf5fb60952c884 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:23.772814 1200 ts_tablet_manager.cc:1434] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260619 19:54:23.770213 1973 ts_tablet_manager.cc:1916] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:23.779476 859 consensus_peers.cc:597] T 4cd6b786bd844781af7fdc5849e90009 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cd6b786bd844781af7fdc5849e90009. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.784674 1200 tablet_bootstrap.cc:492] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.791033 1201 tablet_bootstrap.cc:492] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.791606 1201 ts_tablet_manager.cc:1403] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.139s user 0.003s sys 0.005s
I20260619 19:54:23.792399 1201 raft_consensus.cc:359] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.792666 1201 raft_consensus.cc:385] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.792785 1201 raft_consensus.cc:740] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.793114 1201 consensus_queue.cc:260] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.794911 1201 ts_tablet_manager.cc:1434] T b57f64f97cdc493ea48e08d897bfc982 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:23.796222 1201 tablet_bootstrap.cc:492] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.796842 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet dcc9c4167c58495fbfcf5fb60952c884 (table default.Table_b266c44afc08423a88490ec2db873941 [id=7da3c534cd594bad9810cd0d62a77d8a]) successfully deleted
I20260619 19:54:23.797295 1994 tablet_replica.cc:333] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:23.797565 1994 raft_consensus.cc:2243] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.797791 1994 raft_consensus.cc:2272] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.797942 1201 tablet_bootstrap.cc:654] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.798571 1994 ts_tablet_manager.cc:1916] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.799842 1200 tablet_bootstrap.cc:654] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.815446 1208 tablet_bootstrap.cc:492] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:23.817582 1208 ts_tablet_manager.cc:1403] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.000s
I20260619 19:54:23.817927 3460 raft_consensus.cc:493] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.818099 3460 raft_consensus.cc:515] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.818845 3460 leader_election.cc:290] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.819773 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6532bdfd3c844ff2a25bee6ff1e0c25e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:23.820720 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6532bdfd3c844ff2a25bee6ff1e0c25e" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.821389 720 leader_election.cc:304] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.821831 3460 raft_consensus.cc:2749] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.822212 1208 raft_consensus.cc:359] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.824455 1201 tablet_bootstrap.cc:492] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.824673 1201 ts_tablet_manager.cc:1403] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20260619 19:54:23.825459 1201 raft_consensus.cc:359] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.826282 1208 raft_consensus.cc:385] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.826402 1208 raft_consensus.cc:740] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.826683 1208 consensus_queue.cc:260] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.828017 1208 ts_tablet_manager.cc:1434] T 02c5f9405d6a4a16bd49697001c201e1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260619 19:54:23.828040 1201 raft_consensus.cc:385] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.828114 1201 raft_consensus.cc:740] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.829290 1208 tablet_bootstrap.cc:492] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:23.830328 1201 consensus_queue.cc:260] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
W20260619 19:54:23.832372 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22e7bbccbd2a4be2af5d6f1be32657aa consensus state has no leader
I20260619 19:54:23.832756 523 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4f5e69e26c3542fbaa09da0518fd84c4" } modify_external_catalogs: true
I20260619 19:54:23.832911 523 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4f5e69e26c3542fbaa09da0518fd84c4" } modify_external_catalogs: true
I20260619 19:54:23.833002 1973 ts_tablet_manager.cc:1929] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:23.833129 1973 log.cc:1199] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-0/wal/wals/73029f4bc97349da9d5d2fae4321cd5f
I20260619 19:54:23.833515 1973 ts_tablet_manager.cc:1950] T 73029f4bc97349da9d5d2fae4321cd5f P b1f5f240547f42ec82f57e6c8af5ea89: Deleting consensus metadata
I20260619 19:54:23.833972 1973 tablet_replica.cc:333] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: stopping tablet replica
I20260619 19:54:23.834177 1973 raft_consensus.cc:2243] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:23.833899 3440 raft_consensus.cc:493] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.834590 525 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ec7afef29b0741c89176856851dbff59" } modify_external_catalogs: true
I20260619 19:54:23.834743 525 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ec7afef29b0741c89176856851dbff59" } modify_external_catalogs: true
I20260619 19:54:23.834762 3440 raft_consensus.cc:515] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.835402 3440 leader_election.cc:290] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.837105 518 catalog_manager.cc:5027] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): tablet 73029f4bc97349da9d5d2fae4321cd5f (table default.Table_c682fd0a9e8b4654b45a9c3705b5eb92 [id=462f117547284b4c9751113325444d99]) successfully deleted
I20260619 19:54:23.837399 1201 ts_tablet_manager.cc:1434] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260619 19:54:23.837703 1201 tablet_bootstrap.cc:492] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.838457 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a8462edb54df2aa0343ecea6dd761" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.839075 3460 raft_consensus.cc:493] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 19:54:23.839195 858 leader_election.cc:343] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.839236 3460 raft_consensus.cc:515] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.839811 3460 leader_election.cc:290] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.840207 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7f825e5f84d5985427e83ee6a989d" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:23.840410 910 raft_consensus.cc:2393] T 8ce7f825e5f84d5985427e83ee6a989d P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
W20260619 19:54:23.841280 720 leader_election.cc:343] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 8ce7f825e5f84d5985427e83ee6a989d
I20260619 19:54:23.836078 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a8462edb54df2aa0343ecea6dd761" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:23.841645 1200 tablet_bootstrap.cc:492] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.841661 1058 raft_consensus.cc:2468] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:23.841817 1200 ts_tablet_manager.cc:1403] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260619 19:54:23.842182 2026 ts_tablet_manager.cc:1929] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 19:54:23.842227 859 leader_election.cc:304] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:23.842370 2026 log.cc:1199] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9f6ec149e1ac475f8038b328dae4af2a
I20260619 19:54:23.842622 3440 raft_consensus.cc:2804] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:23.842697 3440 raft_consensus.cc:493] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:23.842737 2026 ts_tablet_manager.cc:1950] T 9f6ec149e1ac475f8038b328dae4af2a P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:23.842761 3440 raft_consensus.cc:3060] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.843605 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 472) took 13411 ms. Trace:
I20260619 19:54:23.843719 2026 rpcz_store.cc:276] 0619 19:54:10.432153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.432209 (+ 56us) service_pool.cc:224] Handling call
0619 19:54:23.749786 (+13317577us) ts_tablet_manager.cc:1151] Deleting tablet 9f6ec149e1ac475f8038b328dae4af2a
0619 19:54:23.749796 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.808038 (+ 58242us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:23.842119 (+ 34081us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:23.843586 (+ 1467us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13317380}
I20260619 19:54:23.844271 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9f6ec149e1ac475f8038b328dae4af2a (table default.Table_7d5f049a07fe4b8f9e0ea01960b23386 [id=eca1b1736bd04aa595d4f5976bde7a16]) successfully deleted
I20260619 19:54:23.845283 3440 raft_consensus.cc:515] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.845680 1208 tablet_bootstrap.cc:654] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.846439 3440 leader_election.cc:290] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.847123 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a8462edb54df2aa0343ecea6dd761" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"
I20260619 19:54:23.847343 1058 raft_consensus.cc:3060] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.847491 719 leader_election.cc:304] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.847699 1200 raft_consensus.cc:359] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.847851 1200 raft_consensus.cc:385] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.847899 1200 raft_consensus.cc:740] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.847957 3460 raft_consensus.cc:3060] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.848136 1200 consensus_queue.cc:260] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.849815 1200 ts_tablet_manager.cc:1434] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260619 19:54:23.849879 1058 raft_consensus.cc:2468] T 6f2a8462edb54df2aa0343ecea6dd761 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 1.
I20260619 19:54:23.850436 3460 raft_consensus.cc:2749] T 8ce7f825e5f84d5985427e83ee6a989d P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.851166 859 leader_election.cc:304] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:23.851509 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f2a8462edb54df2aa0343ecea6dd761" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:23.852067 858 leader_election.cc:343] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.852185 3440 raft_consensus.cc:2804] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:23.852303 3440 raft_consensus.cc:697] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [term 1 LEADER]: Becoming Leader. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Running, Role: LEADER
I20260619 19:54:23.852552 3440 consensus_queue.cc:237] T 6f2a8462edb54df2aa0343ecea6dd761 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.855661 1994 ts_tablet_manager.cc:1929] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:23.857365 1973 raft_consensus.cc:2272] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.857815 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 473) took 13338 ms. Trace:
I20260619 19:54:23.858714 1973 ts_tablet_manager.cc:1916] T b6a468ca001340e98addf91dd3829efa P b1f5f240547f42ec82f57e6c8af5ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.858865 2026 rpcz_store.cc:276] 0619 19:54:10.519478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.519532 (+ 54us) service_pool.cc:224] Handling call
0619 19:54:23.857643 (+13338111us) ts_tablet_manager.cc:1151] Deleting tablet 8b2e40a7328d42dd864703db24c1fa3c
0619 19:54:23.857658 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:23.857790 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13337907}
W20260619 19:54:23.859622 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet 8b2e40a7328d42dd864703db24c1fa3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2e40a7328d42dd864703db24c1fa3c already in progress: creating tablet
I20260619 19:54:23.860215 532 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_2a184867b3e74fd0888c2b6066b160c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.860769 532 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a184867b3e74fd0888c2b6066b160c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.862327 524 master_service.cc:960] ReplaceTablet: received request to replace tablet 0f3a48eabb574be3bc6883cf555b657f from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:23.862937 524 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8332957764724490802823ff562a7fe0" } modify_external_catalogs: true
I20260619 19:54:23.863104 524 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_8332957764724490802823ff562a7fe0" } modify_external_catalogs: true
I20260619 19:54:23.864764 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8b0f6ae8957c4fe5aaf98662c9eebc97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.865439 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b0f6ae8957c4fe5aaf98662c9eebc97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.870661 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:23.872157 2026 tablet_replica.cc:333] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
I20260619 19:54:23.872388 2026 raft_consensus.cc:2243] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.872587 2026 raft_consensus.cc:2272] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.873155 2026 ts_tablet_manager.cc:1916] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:23.872891 3180 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 19:54:23.873348 3180 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 19:54:23.873502 3180 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260619 19:54:23.879372 523 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 913f4e0c705a494e8f9514f34579ea69
I20260619 19:54:23.880410 523 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_47de2813a5104e45b91ec71f06392fb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.880966 523 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47de2813a5104e45b91ec71f06392fb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.881225 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 913f4e0c705a494e8f9514f34579ea69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:23.881680 1201 tablet_bootstrap.cc:654] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.882563 1994 log.cc:1199] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/1642bc8d3f984e1c9d60093fa7abcc53
I20260619 19:54:23.882567 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 913f4e0c705a494e8f9514f34579ea69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:23.882910 1994 ts_tablet_manager.cc:1950] T 1642bc8d3f984e1c9d60093fa7abcc53 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:23.883322 3440 raft_consensus.cc:493] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.883453 3440 raft_consensus.cc:515] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.884038 3440 leader_election.cc:290] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:23.884793 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb4e51cce643fab695507af03800af" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:23.885277 859 leader_election.cc:343] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.885480 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd8d45bb7664eb7af533a8215f69fc2 (DEFAULT_TABLE table=default.Table_581abe6dd7674411b70ec21510a3e561 [id=65e63161fa164abab139ebc9010bd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.885826 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd8d45bb7664eb7af533a8215f69fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.885819 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 1642bc8d3f984e1c9d60093fa7abcc53 (table default.Table_f1436f5ff9b34985976f95675a904bc5 [id=83cf7db2f6054464813d2bc3c268af46]) successfully deleted
I20260619 19:54:23.889456 1994 tablet_replica.cc:333] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:23.889678 1994 raft_consensus.cc:2243] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:23.889814 1994 raft_consensus.cc:2272] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:23.890336 1994 ts_tablet_manager.cc:1916] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:23.863953 1200 tablet_bootstrap.cc:492] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.880285 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 913f4e0c705a494e8f9514f34579ea69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.892165 1200 tablet_bootstrap.cc:654] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.892666 895 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd8d45bb7664eb7af533a8215f69fc2 (DEFAULT_TABLE table=default.Table_581abe6dd7674411b70ec21510a3e561 [id=65e63161fa164abab139ebc9010bd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.892999 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bb4e51cce643fab695507af03800af" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:23.893080 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd8d45bb7664eb7af533a8215f69fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.893783 749 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd8d45bb7664eb7af533a8215f69fc2 (DEFAULT_TABLE table=default.Table_581abe6dd7674411b70ec21510a3e561 [id=65e63161fa164abab139ebc9010bd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.894140 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd8d45bb7664eb7af533a8215f69fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.895407 753 tablet_service.cc:1511] Processing CreateTablet for tablet f2a432df61bb4e8e80bb8d38fa665457 (DEFAULT_TABLE table=default.Table_04090ce3031a4deda0868de2baa4eb37 [id=49d3cd160c6a41888bce1b5047bb781f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.895784 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a432df61bb4e8e80bb8d38fa665457. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:23.899014 858 leader_election.cc:343] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:23.899657 858 leader_election.cc:304] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.900132 3442 raft_consensus.cc:2749] T b1bb4e51cce643fab695507af03800af P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.903920 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f2a432df61bb4e8e80bb8d38fa665457 (DEFAULT_TABLE table=default.Table_04090ce3031a4deda0868de2baa4eb37 [id=49d3cd160c6a41888bce1b5047bb781f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.904834 3417 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P e78a44e2c8824fe7bce462e9d33f660c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260619 19:54:23.906497 3180 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260619 19:54:23.907316 1200 tablet_bootstrap.cc:492] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.907544 1200 ts_tablet_manager.cc:1403] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260619 19:54:23.909497 1200 raft_consensus.cc:359] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.909560 898 tablet_service.cc:1511] Processing CreateTablet for tablet f2a432df61bb4e8e80bb8d38fa665457 (DEFAULT_TABLE table=default.Table_04090ce3031a4deda0868de2baa4eb37 [id=49d3cd160c6a41888bce1b5047bb781f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:23.909850 3180 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 19:54:23.909976 3180 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260619 19:54:23.910025 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a432df61bb4e8e80bb8d38fa665457. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:23.910044 3180 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 19:54:23.910403 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet a16fdee448fb4975861b7cd46cbbc271 (table default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5]). Expected version 1 got 0
I20260619 19:54:23.910565 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 198bde101e7b4eeeb8de58aebe208bb4 (table default.Table_a1c8ee1b3f864b24aacf7f9089b5411d [id=b050d865cd52491c97d748c78f0c83a5]). Expected version 2 got 0
I20260619 19:54:23.910669 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 0a39b06bad874a5d8c945c27c3552d43 (table default.Table_292bcfbb97fc40f3a4f90f8ad274fb83 [id=b1eb763e7d5b46d59c93910b686d06a1]). Expected version 2 got 0
I20260619 19:54:23.910771 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 61adf222e10c490c9c8dd6f83edc1643 (table default.Table_abbfebb4e0fe42d4b046d4c687349c1d [id=97b96e6c0f164ede83066539b1713846]). Expected version 3 got 0
I20260619 19:54:23.910953 527 catalog_manager.cc:5696] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95181cc281b946c8b81aa825232d9498 (127.0.105.130). New cstate: current_term: 1 leader_uuid: "95181cc281b946c8b81aa825232d9498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: HEALTHY } } }
I20260619 19:54:23.911338 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 9e7877d111a0438da74b7bcf396e2c71 (table default.Table_7adacc85728b464dbf461645536524d3 [id=e1f11bc6739d4427b75f310028bef998]). Expected version 1 got 0
I20260619 19:54:23.911546 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (table default.Table_2e742d603b764daa86e93b4018379875 [id=33e3d383660b422582a47dcb68ae6be7]). Expected version 1 got 0
I20260619 19:54:23.911738 527 catalog_manager.cc:5788] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:23.915500 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfbad0095c946cb91f8e14d4c8812d7 (DEFAULT_TABLE table=default.Table_b27ad212aa214c329caac903c09686b5 [id=ddd11f6222be459a9fbfda8067033bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.915963 1200 raft_consensus.cc:385] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.916086 1200 raft_consensus.cc:740] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.916363 1200 consensus_queue.cc:260] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.916694 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfbad0095c946cb91f8e14d4c8812d7 (DEFAULT_TABLE table=default.Table_b27ad212aa214c329caac903c09686b5 [id=ddd11f6222be459a9fbfda8067033bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.917187 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfbad0095c946cb91f8e14d4c8812d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.917241 1200 ts_tablet_manager.cc:1434] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260619 19:54:23.917533 1200 tablet_bootstrap.cc:492] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.918977 1200 tablet_bootstrap.cc:654] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.921176 529 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: default.Table_73012bddac2342c890794eda4a69443c [id=da90383254a64c8bb9a84858524084d2] alter complete (version 1)
I20260619 19:54:23.922025 529 master_service.cc:960] ReplaceTablet: received request to replace tablet 10c73b679e394f31b9e5d51681e06976 from {username='slave'} at 127.0.0.1:37030
I20260619 19:54:23.922556 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_8cf0dca862e74ac592b3f2b0754d66e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:23.923111 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cf0dca862e74ac592b3f2b0754d66e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:23.926054 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:23.927423 764 tablet_service.cc:1511] Processing CreateTablet for tablet 11df691cfcfd4d60b1cc97d19acbb70e (DEFAULT_TABLE table=default.Table_2529830b430142c7b8ec4b4044aeefe9 [id=2bf80b3b98f14eb1b02b40e7198516ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.927848 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11df691cfcfd4d60b1cc97d19acbb70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.928009 898 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfbad0095c946cb91f8e14d4c8812d7 (DEFAULT_TABLE table=default.Table_b27ad212aa214c329caac903c09686b5 [id=ddd11f6222be459a9fbfda8067033bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.928360 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfbad0095c946cb91f8e14d4c8812d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.930959 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 11df691cfcfd4d60b1cc97d19acbb70e (DEFAULT_TABLE table=default.Table_2529830b430142c7b8ec4b4044aeefe9 [id=2bf80b3b98f14eb1b02b40e7198516ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.931360 3453 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P 95181cc281b946c8b81aa825232d9498: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:54:23.932670 1201 tablet_bootstrap.cc:492] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:23.932904 1201 ts_tablet_manager.cc:1403] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.002s
I20260619 19:54:23.933894 1201 raft_consensus.cc:359] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.934247 1201 raft_consensus.cc:385] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.934333 1201 raft_consensus.cc:740] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.934598 1201 consensus_queue.cc:260] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.934973 749 tablet_service.cc:1511] Processing CreateTablet for tablet 9a755b45d055425399b4bcc7ef7e7f2c (DEFAULT_TABLE table=default.Table_daa000613964454db46ad8b5388cb7f0 [id=def86d455e814290915d9b223083bca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.935760 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a755b45d055425399b4bcc7ef7e7f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.936544 895 tablet_service.cc:1511] Processing CreateTablet for tablet 11df691cfcfd4d60b1cc97d19acbb70e (DEFAULT_TABLE table=default.Table_2529830b430142c7b8ec4b4044aeefe9 [id=2bf80b3b98f14eb1b02b40e7198516ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.937094 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11df691cfcfd4d60b1cc97d19acbb70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.939706 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 9a755b45d055425399b4bcc7ef7e7f2c (DEFAULT_TABLE table=default.Table_daa000613964454db46ad8b5388cb7f0 [id=def86d455e814290915d9b223083bca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.943476 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9a755b45d055425399b4bcc7ef7e7f2c (DEFAULT_TABLE table=default.Table_daa000613964454db46ad8b5388cb7f0 [id=def86d455e814290915d9b223083bca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.943892 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a755b45d055425399b4bcc7ef7e7f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.947431 3180 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.148:38937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.190:46791,127.0.105.189:45849,127.0.105.188:44433
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.188:44433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.188
--webserver_port=42109
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 19:43:25 UTC on bdcb31816ec0
build id 12474
ASAN enabled
W20260619 19:54:23.949304 516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.105.190:46791, user_credentials={real_user=slave}} blocked reactor thread for 96613.7us
I20260619 19:54:23.949383 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2f25bf2e10924634a8bdbd59108b5c53 (DEFAULT_TABLE table=default.Table_ca38ddcae2624dd78470cd6754a48a56 [id=93f09248ad70420f943c5bf3b80237e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.949621 3180 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 19:54:23.956902 1201 ts_tablet_manager.cc:1434] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.024s user 0.001s sys 0.000s
I20260619 19:54:23.959656 1201 tablet_bootstrap.cc:492] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:23.960204 3180 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260619 19:54:23.961596 764 tablet_service.cc:1511] Processing CreateTablet for tablet 2f25bf2e10924634a8bdbd59108b5c53 (DEFAULT_TABLE table=default.Table_ca38ddcae2624dd78470cd6754a48a56 [id=93f09248ad70420f943c5bf3b80237e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.962138 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f25bf2e10924634a8bdbd59108b5c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.964475 3460 raft_consensus.cc:493] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.964612 3460 raft_consensus.cc:515] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.965464 3460 leader_election.cc:290] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:23.966526 3440 raft_consensus.cc:493] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:23.966686 3440 raft_consensus.cc:515] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } } peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } }
W20260619 19:54:23.966836 720 leader_election.cc:343] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: dcc9c4167c58495fbfcf5fb60952c884
I20260619 19:54:23.967360 3440 leader_election.cc:290] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819)
W20260619 19:54:23.968418 859 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Not found: Tablet not found: 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:23.968744 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc9c4167c58495fbfcf5fb60952c884" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:23.969017 910 raft_consensus.cc:2393] T dcc9c4167c58495fbfcf5fb60952c884 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1f5f240547f42ec82f57e6c8af5ea89 in current term 1: Already voted for candidate e78a44e2c8824fe7bce462e9d33f660c in this term.
I20260619 19:54:23.969635 719 leader_election.cc:304] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.969664 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2f25bf2e10924634a8bdbd59108b5c53 (DEFAULT_TABLE table=default.Table_ca38ddcae2624dd78470cd6754a48a56 [id=93f09248ad70420f943c5bf3b80237e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.970183 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f25bf2e10924634a8bdbd59108b5c53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:23.970274 858 leader_election.cc:343] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Not found: Tablet not found: 42b0e811cf2a4bf4a23351f9ba5b6173
I20260619 19:54:23.970534 3460 raft_consensus.cc:3060] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:23.970566 858 leader_election.cc:304] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:23.971251 3440 raft_consensus.cc:2749] T 42b0e811cf2a4bf4a23351f9ba5b6173 P 95181cc281b946c8b81aa825232d9498 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260619 19:54:23.972678 858 consensus_peers.cc:597] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.974041 3460 raft_consensus.cc:2749] T dcc9c4167c58495fbfcf5fb60952c884 P b1f5f240547f42ec82f57e6c8af5ea89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:23.974329 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3ca5344ce2466792554a6333bfd7a6 (DEFAULT_TABLE table=default.Table_dea5c54bb7474dbfb49a1ebd57ec9baa [id=403bb6f341ce47cca975358170b8f4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.973984 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3ca5344ce2466792554a6333bfd7a6 (DEFAULT_TABLE table=default.Table_dea5c54bb7474dbfb49a1ebd57ec9baa [id=403bb6f341ce47cca975358170b8f4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.974982 889 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3ca5344ce2466792554a6333bfd7a6 (DEFAULT_TABLE table=default.Table_dea5c54bb7474dbfb49a1ebd57ec9baa [id=403bb6f341ce47cca975358170b8f4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.975368 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3ca5344ce2466792554a6333bfd7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.975518 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3ca5344ce2466792554a6333bfd7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:23.976410 759 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7276a4d9894b6b820d2424ac09e141 (DEFAULT_TABLE table=default.Table_d82892edc1b64e63be683298591749d4 [id=6caafc9aa14b41238770b20e44cda547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:23.976773 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7276a4d9894b6b820d2424ac09e141. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:23.980630 859 consensus_peers.cc:597] T 01fe4b37c74b4fb496f2842407c65eb1 P 95181cc281b946c8b81aa825232d9498 -> Peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Couldn't send request to peer e78a44e2c8824fe7bce462e9d33f660c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01fe4b37c74b4fb496f2842407c65eb1. This is attempt 1: this message will repeat every 5th retry.
I20260619 19:54:23.986900 1200 tablet_bootstrap.cc:492] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:23.987093 1200 ts_tablet_manager.cc:1403] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.010s
I20260619 19:54:23.987884 1201 tablet_bootstrap.cc:654] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:23.987844 1200 raft_consensus.cc:359] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.988036 1200 raft_consensus.cc:385] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:23.988093 1200 raft_consensus.cc:740] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:23.988310 1200 consensus_queue.cc:260] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:23.988662 3463 tablet.cc:1724] T 108f1b2e9ec74271889ffff65d8e852e P b1f5f240547f42ec82f57e6c8af5ea89: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260619 19:54:23.988792 1200 ts_tablet_manager.cc:1434] T b1bb4e51cce643fab695507af03800af P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260619 19:54:23.989064 1200 tablet_bootstrap.cc:492] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:23.990437 1200 tablet_bootstrap.cc:654] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.001421 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7276a4d9894b6b820d2424ac09e141 (DEFAULT_TABLE table=default.Table_d82892edc1b64e63be683298591749d4 [id=6caafc9aa14b41238770b20e44cda547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.002369 889 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7276a4d9894b6b820d2424ac09e141 (DEFAULT_TABLE table=default.Table_d82892edc1b64e63be683298591749d4 [id=6caafc9aa14b41238770b20e44cda547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.002808 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 6601af3816564aa7a5ffedb428e8bd0d (DEFAULT_TABLE table=default.Table_942bba051c55418bb021f58dd6283657 [id=a4b37484392c41d092521e352ed12cee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.003032 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7276a4d9894b6b820d2424ac09e141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.003417 897 tablet_service.cc:1511] Processing CreateTablet for tablet 6601af3816564aa7a5ffedb428e8bd0d (DEFAULT_TABLE table=default.Table_942bba051c55418bb021f58dd6283657 [id=a4b37484392c41d092521e352ed12cee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.003770 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6601af3816564aa7a5ffedb428e8bd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.009186 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a432df61bb4e8e80bb8d38fa665457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.009816 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfbad0095c946cb91f8e14d4c8812d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.010336 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a755b45d055425399b4bcc7ef7e7f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.010859 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11df691cfcfd4d60b1cc97d19acbb70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.011302 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f25bf2e10924634a8bdbd59108b5c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.011674 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3ca5344ce2466792554a6333bfd7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.012754 1200 tablet_bootstrap.cc:492] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:24.012898 1200 ts_tablet_manager.cc:1403] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.000s
I20260619 19:54:24.013415 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7276a4d9894b6b820d2424ac09e141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.018963 1200 raft_consensus.cc:359] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.020285 1200 raft_consensus.cc:385] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:24.020390 1200 raft_consensus.cc:740] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:24.020617 1200 consensus_queue.cc:260] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.022861 1200 ts_tablet_manager.cc:1434] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260619 19:54:24.025275 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6601af3816564aa7a5ffedb428e8bd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.032863 1200 tablet_bootstrap.cc:492] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:24.034528 1200 tablet_bootstrap.cc:654] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.044193 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf0c32e2038407b8b9858d53c232cbd (DEFAULT_TABLE table=default.Table_7d54d0f6a2fe4de0b53dd22ace0baed0 [id=6f8614786f6b4351bec9f8814864b20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.044741 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf0c32e2038407b8b9858d53c232cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.046738 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 09ebeb9faa22429896c693a0c7beeee4 (DEFAULT_TABLE table=default.Table_caf1cb860e2f4abf8dd10dbf55c13cfa [id=09cc41dafe6b4ffc9b31521e4917b65a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.047170 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ebeb9faa22429896c693a0c7beeee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.047562 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 89e94aa9ec714e689fe046c31eff5c67 (DEFAULT_TABLE table=default.Table_deb77daf83c147f0b5863523294bf70f [id=6a06db1bdd0d4e06bbaf3cc4acd1c23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.047700 757 tablet_service.cc:1511] Processing CreateTablet for tablet 89e94aa9ec714e689fe046c31eff5c67 (DEFAULT_TABLE table=default.Table_deb77daf83c147f0b5863523294bf70f [id=6a06db1bdd0d4e06bbaf3cc4acd1c23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.047947 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e94aa9ec714e689fe046c31eff5c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.048384 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e94aa9ec714e689fe046c31eff5c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.052584 897 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf0c32e2038407b8b9858d53c232cbd (DEFAULT_TABLE table=default.Table_7d54d0f6a2fe4de0b53dd22ace0baed0 [id=6f8614786f6b4351bec9f8814864b20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.053328 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf0c32e2038407b8b9858d53c232cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.053592 1208 tablet_bootstrap.cc:492] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:24.053736 1208 ts_tablet_manager.cc:1403] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.225s user 0.006s sys 0.000s
I20260619 19:54:24.054454 1208 raft_consensus.cc:359] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.054634 1208 raft_consensus.cc:385] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:24.054687 1208 raft_consensus.cc:740] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:24.054924 1208 consensus_queue.cc:260] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.057330 889 tablet_service.cc:1511] Processing CreateTablet for tablet 09ebeb9faa22429896c693a0c7beeee4 (DEFAULT_TABLE table=default.Table_caf1cb860e2f4abf8dd10dbf55c13cfa [id=09cc41dafe6b4ffc9b31521e4917b65a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.058432 753 tablet_service.cc:1511] Processing CreateTablet for tablet 09ebeb9faa22429896c693a0c7beeee4 (DEFAULT_TABLE table=default.Table_caf1cb860e2f4abf8dd10dbf55c13cfa [id=09cc41dafe6b4ffc9b31521e4917b65a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.058815 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ebeb9faa22429896c693a0c7beeee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.059368 764 tablet_service.cc:1511] Processing CreateTablet for tablet 6601af3816564aa7a5ffedb428e8bd0d (DEFAULT_TABLE table=default.Table_942bba051c55418bb021f58dd6283657 [id=a4b37484392c41d092521e352ed12cee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.059662 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6601af3816564aa7a5ffedb428e8bd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.062265 785 raft_consensus.cc:3060] T 6532bdfd3c844ff2a25bee6ff1e0c25e P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:24.062827 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ebeb9faa22429896c693a0c7beeee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.067018 1994 ts_tablet_manager.cc:1929] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:24.070998 749 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf0c32e2038407b8b9858d53c232cbd (DEFAULT_TABLE table=default.Table_7d54d0f6a2fe4de0b53dd22ace0baed0 [id=6f8614786f6b4351bec9f8814864b20f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.071538 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf0c32e2038407b8b9858d53c232cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.077811 1208 ts_tablet_manager.cc:1434] T 01fe4b37c74b4fb496f2842407c65eb1 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260619 19:54:24.086032 524 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 71ddb48c4b48459791bd3aaa7982a7e6
I20260619 19:54:24.086694 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_5656876f5b02409ab319fcdb31b2659c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:24.087589 530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_89a0c7fa0edb4acc95d97e889e218c95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:24.088021 530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89a0c7fa0edb4acc95d97e889e218c95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.089141 531 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet 92ca1721fd3c4bcea2fa43780a570dc7
I20260619 19:54:24.089664 531 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9bca1b1d70944f1fb9df39ee8c10c573" } new_table_name: "default.Table_f225c326b6df4c4390b305aefed35bfa" modify_external_catalogs: true
I20260619 19:54:24.090739 525 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ebb013fe22fd4021a84e85813ca7484a
I20260619 19:54:24.091831 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_9b2db7fc24bd4e6b89758838f60b0ac5" } new_table_name: "default.Table_f07959540489460f940a8a29d7d643b7" modify_external_catalogs: true
I20260619 19:54:24.093505 1208 tablet_bootstrap.cc:492] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:24.095121 1208 tablet_bootstrap.cc:654] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.095758 525 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_eaefb5c915d34ab79e4f47c839fd0ade" } new_table_name: "default.Table_9745b9e9f4a84744b0d5554bef771766" modify_external_catalogs: true
W20260619 19:54:24.098032 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5656876f5b02409ab319fcdb31b2659c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.100829 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ddb48c4b48459791bd3aaa7982a7e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.101205 885 tablet_service.cc:1558] Processing DeleteTablet for tablet ebb013fe22fd4021a84e85813ca7484a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.101445 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ca1721fd3c4bcea2fa43780a570dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:24.101547 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ca1721fd3c4bcea2fa43780a570dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.101673 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ebb013fe22fd4021a84e85813ca7484a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:24.101936 898 tablet_service.cc:1511] Processing CreateTablet for tablet 89e94aa9ec714e689fe046c31eff5c67 (DEFAULT_TABLE table=default.Table_deb77daf83c147f0b5863523294bf70f [id=6a06db1bdd0d4e06bbaf3cc4acd1c23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.103524 529 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_60aea483d16b47e1bc2404cae482f5e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:24.104308 529 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60aea483d16b47e1bc2404cae482f5e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.106449 758 tablet_service.cc:1511] Processing CreateTablet for tablet f0378abd70a344e990c4a7713cdd778e (DEFAULT_TABLE table=default.Table_16dcaa6bce9744e1a978dc75e97efdf1 [id=2320b43d8fb74184b424744e921499ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.106902 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0378abd70a344e990c4a7713cdd778e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.114706 759 tablet_service.cc:1511] Processing CreateTablet for tablet fdf920b61d1f4233b0e1246c1663a636 (DEFAULT_TABLE table=default.Table_441a980b1f344c8fa0793dba5e99d57e [id=031cb879115c4858bdc9bedd2a162213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.115196 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf920b61d1f4233b0e1246c1663a636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.116207 895 tablet_service.cc:1511] Processing CreateTablet for tablet fdf920b61d1f4233b0e1246c1663a636 (DEFAULT_TABLE table=default.Table_441a980b1f344c8fa0793dba5e99d57e [id=031cb879115c4858bdc9bedd2a162213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.119186 902 tablet_service.cc:1511] Processing CreateTablet for tablet f0378abd70a344e990c4a7713cdd778e (DEFAULT_TABLE table=default.Table_16dcaa6bce9744e1a978dc75e97efdf1 [id=2320b43d8fb74184b424744e921499ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.119918 532 catalog_manager.cc:5696] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c reported cstate change: term changed from 0 to 1, leader changed from <none> to e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131). New cstate: current_term: 1 leader_uuid: "e78a44e2c8824fe7bce462e9d33f660c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } health_report { overall_health: UNKNOWN } } }
I20260619 19:54:24.120477 532 catalog_manager.cc:5788] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819) does not have the latest schema for tablet a16fdee448fb4975861b7cd46cbbc271 (table default.Table_b4e382f7a7df4dc5b57ba16132be7f6c [id=52daadc447e441e6a36e1b2e4c672da5]). Expected version 1 got 0
I20260619 19:54:24.122128 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf920b61d1f4233b0e1246c1663a636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.122128 2026 ts_tablet_manager.cc:1929] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:24.122900 2026 log.cc:1199] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/9f33c2c00b414fbebf1965510e1e2b96
I20260619 19:54:24.123373 2026 ts_tablet_manager.cc:1950] T 9f33c2c00b414fbebf1965510e1e2b96 P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:24.124964 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0378abd70a344e990c4a7713cdd778e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.126047 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89e94aa9ec714e689fe046c31eff5c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.129854 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 474) took 13608 ms. Trace:
I20260619 19:54:24.130044 2026 rpcz_store.cc:276] 0619 19:54:10.521486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.521557 (+ 71us) service_pool.cc:224] Handling call
0619 19:54:23.872097 (+13350540us) ts_tablet_manager.cc:1151] Deleting tablet 9f33c2c00b414fbebf1965510e1e2b96
0619 19:54:23.872110 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.004618 (+132508us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:24.122052 (+117434us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:24.129718 (+ 7666us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13350334}
I20260619 19:54:24.130707 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 475) took 13591 ms. Trace:
I20260619 19:54:24.130861 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 9f33c2c00b414fbebf1965510e1e2b96 (table default.Table_c1244375c2df41a68f9e4cff4248af68 [id=873b5cd9ab3549b482db039d3920caee]) successfully deleted
I20260619 19:54:24.130860 2026 rpcz_store.cc:276] 0619 19:54:10.539074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.540995 (+ 1921us) service_pool.cc:224] Handling call
0619 19:54:24.130565 (+13589570us) ts_tablet_manager.cc:1151] Deleting tablet ac55fd703e184730ab053e045b0f4e2c
0619 19:54:24.130578 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.130689 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13589316}
W20260619 19:54:24.131336 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet ac55fd703e184730ab053e045b0f4e2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac55fd703e184730ab053e045b0f4e2c already in progress: creating tablet
I20260619 19:54:24.131397 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 477) took 13573 ms. Trace:
I20260619 19:54:24.131467 2026 rpcz_store.cc:276] 0619 19:54:10.558023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.558093 (+ 70us) service_pool.cc:224] Handling call
0619 19:54:24.131284 (+13573191us) ts_tablet_manager.cc:1151] Deleting tablet fcb37eed280c48e8931b6fc94f7600dd
0619 19:54:24.131294 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.131381 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13572973}
W20260619 19:54:24.131835 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet fcb37eed280c48e8931b6fc94f7600dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcb37eed280c48e8931b6fc94f7600dd already in progress: creating tablet
I20260619 19:54:24.131908 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 484) took 13440 ms. Trace:
I20260619 19:54:24.132139 2026 rpcz_store.cc:276] 0619 19:54:10.691504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.727780 (+ 36276us) service_pool.cc:224] Handling call
0619 19:54:24.131801 (+13404021us) ts_tablet_manager.cc:1151] Deleting tablet de6c34ec79d24bfe926f90b8067db558
0619 19:54:24.131812 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.131893 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13403779}
W20260619 19:54:24.132750 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet de6c34ec79d24bfe926f90b8067db558 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de6c34ec79d24bfe926f90b8067db558 already in progress: creating tablet
I20260619 19:54:24.132844 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 497) took 13430 ms. Trace:
I20260619 19:54:24.132917 2026 rpcz_store.cc:276] 0619 19:54:10.702222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.728629 (+ 26407us) service_pool.cc:224] Handling call
0619 19:54:24.132739 (+13404110us) ts_tablet_manager.cc:1151] Deleting tablet eb43742411444ecaa62f74fc729c7745
0619 19:54:24.132749 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.132827 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13403929}
I20260619 19:54:24.133316 2026 tablet_replica.cc:333] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: stopping tablet replica
W20260619 19:54:24.133281 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet eb43742411444ecaa62f74fc729c7745 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb43742411444ecaa62f74fc729c7745 already in progress: creating tablet
I20260619 19:54:24.133553 2026 raft_consensus.cc:2243] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 19:54:24.133720 2026 raft_consensus.cc:2272] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:24.134299 2026 ts_tablet_manager.cc:1916] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 19:54:24.140175 1208 tablet_bootstrap.cc:492] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:24.140436 1208 ts_tablet_manager.cc:1403] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.005s
I20260619 19:54:24.141351 1208 raft_consensus.cc:359] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.141726 1208 raft_consensus.cc:385] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:24.141839 1208 raft_consensus.cc:740] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:24.142122 1208 consensus_queue.cc:260] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.143350 1208 ts_tablet_manager.cc:1434] T 526af16b6a6a4cac9c084900b22d9acf P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:24.143872 1208 tablet_bootstrap.cc:492] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:24.146368 1208 tablet_bootstrap.cc:654] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.095335 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ddb48c4b48459791bd3aaa7982a7e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:24.096583 3406 raft_consensus.cc:493] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.099666 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet ebb013fe22fd4021a84e85813ca7484a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:24.099844 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ca1721fd3c4bcea2fa43780a570dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
I20260619 19:54:24.111662 3404 raft_consensus.cc:493] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.114269 1022 tablet_service.cc:1511] Processing CreateTablet for tablet f0378abd70a344e990c4a7713cdd778e (DEFAULT_TABLE table=default.Table_16dcaa6bce9744e1a978dc75e97efdf1 [id=2320b43d8fb74184b424744e921499ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.152019 3406 raft_consensus.cc:515] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.152275 3404 raft_consensus.cc:515] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.152559 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0378abd70a344e990c4a7713cdd778e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.152793 3406 leader_election.cc:290] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.151911 1994 log.cc:1199] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-2/wal/wals/02c5f9405d6a4a16bd49697001c201e1
I20260619 19:54:24.153383 1994 ts_tablet_manager.cc:1950] T 02c5f9405d6a4a16bd49697001c201e1 P e78a44e2c8824fe7bce462e9d33f660c: Deleting consensus metadata
I20260619 19:54:24.152794 3404 leader_election.cc:290] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.115446 1037 tablet_service.cc:1511] Processing CreateTablet for tablet fdf920b61d1f4233b0e1246c1663a636 (DEFAULT_TABLE table=default.Table_441a980b1f344c8fa0793dba5e99d57e [id=031cb879115c4858bdc9bedd2a162213]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.155099 519 catalog_manager.cc:5027] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): tablet 02c5f9405d6a4a16bd49697001c201e1 (table default.Table_122ef08337114140a4943c821d049ffb [id=b8f9efa202184597a36c5b4dcfa46084]) successfully deleted
I20260619 19:54:24.156101 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ddb48c4b48459791bd3aaa7982a7e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:24.156116 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 58c2959e96144fdf8f20c99ca7e4b415 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c2959e96144fdf8f20c99ca7e4b415 already in progress: creating tablet
I20260619 19:54:24.156579 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3780418b3854889868cf428b2800ab0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:24.156968 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2156cf3d7664ffc9b4b3f47fa750226" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:24.156941 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 88dc27a9f1c7442bbe803120a5d043fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88dc27a9f1c7442bbe803120a5d043fe already in progress: creating tablet
I20260619 19:54:24.157552 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf920b61d1f4233b0e1246c1663a636. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:24.157835 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 47eb6580ead349188460a0fb8ada1262 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47eb6580ead349188460a0fb8ada1262 already in progress: creating tablet
W20260619 19:54:24.158595 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet db4f8c148d7d45969ec77b02e885bcbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4f8c148d7d45969ec77b02e885bcbe already in progress: creating tablet
W20260619 19:54:24.159333 519 catalog_manager.cc:5007] TS e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): delete failed for tablet 6f37e153b53c471da1f304ae1ada0b2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f37e153b53c471da1f304ae1ada0b2d already in progress: creating tablet
I20260619 19:54:24.159696 1994 tablet_replica.cc:333] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: stopping tablet replica
I20260619 19:54:24.159991 1994 raft_consensus.cc:2243] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Raft consensus shutting down.
I20260619 19:54:24.160360 1994 raft_consensus.cc:2272] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 19:54:24.161149 1994 ts_tablet_manager.cc:1916] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 19:54:24.161628 996 leader_election.cc:343] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:24.161842 996 leader_election.cc:343] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.167922 530 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ddcc39f5e0f447cb8e5c3e5417b5c13d" } new_table_name: "default.Table_75e9579322e2483abf9e4f363bc1fb3c" modify_external_catalogs: true
I20260619 19:54:24.179639 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c936ebb77fa744e59b7b2b322193b230 (DEFAULT_TABLE table=default.Table_726ead7412294be6bad3cfa42c5ae0f6 [id=606405f52dcc4cf89f95869b67e8b991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.180130 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3780418b3854889868cf428b2800ab0" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:24.180249 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c936ebb77fa744e59b7b2b322193b230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.180349 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2156cf3d7664ffc9b4b3f47fa750226" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:24.180585 910 raft_consensus.cc:2468] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:24.181310 895 tablet_service.cc:1511] Processing CreateTablet for tablet c936ebb77fa744e59b7b2b322193b230 (DEFAULT_TABLE table=default.Table_726ead7412294be6bad3cfa42c5ae0f6 [id=606405f52dcc4cf89f95869b67e8b991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.181706 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c936ebb77fa744e59b7b2b322193b230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.181866 897 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9f353865ba4d809558cfe130a3d5c8 (DEFAULT_TABLE table=default.Table_55e13a20644949dfadb14fd4db5bf822 [id=1585a5d590214c1b95c33b707c3f568f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.182283 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9f353865ba4d809558cfe130a3d5c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:24.183002 996 leader_election.cc:343] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.183180 996 leader_election.cc:304] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e78a44e2c8824fe7bce462e9d33f660c; no voters: 95181cc281b946c8b81aa825232d9498, b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:24.183630 996 leader_election.cc:304] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:24.184021 3404 raft_consensus.cc:2749] T c3780418b3854889868cf428b2800ab0 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:24.184194 3404 raft_consensus.cc:2804] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:24.184262 3404 raft_consensus.cc:493] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:24.184331 3404 raft_consensus.cc:3060] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:24.188935 3404 raft_consensus.cc:515] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.189095 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9f353865ba4d809558cfe130a3d5c8 (DEFAULT_TABLE table=default.Table_55e13a20644949dfadb14fd4db5bf822 [id=1585a5d590214c1b95c33b707c3f568f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.189543 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9f353865ba4d809558cfe130a3d5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.190814 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2156cf3d7664ffc9b4b3f47fa750226" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89"
W20260619 19:54:24.191471 996 leader_election.cc:343] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.189576 1022 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9f353865ba4d809558cfe130a3d5c8 (DEFAULT_TABLE table=default.Table_55e13a20644949dfadb14fd4db5bf822 [id=1585a5d590214c1b95c33b707c3f568f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.191979 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9f353865ba4d809558cfe130a3d5c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.195798 3290 raft_consensus.cc:493] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.195955 3290 raft_consensus.cc:515] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.196053 3404 leader_election.cc:290] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.196552 3290 leader_election.cc:290] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:24.197418 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2156cf3d7664ffc9b4b3f47fa750226" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:24.197589 910 raft_consensus.cc:3060] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:24.197706 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61adf222e10c490c9c8dd6f83edc1643" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:24.200232 910 raft_consensus.cc:2468] T d2156cf3d7664ffc9b4b3f47fa750226 P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
I20260619 19:54:24.200718 996 leader_election.cc:304] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
W20260619 19:54:24.200865 859 leader_election.cc:343] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:24.201256 531 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet adb07e9a7bf44c49bc0f1cd328dd2b63 consensus state has no leader
I20260619 19:54:24.201555 3404 raft_consensus.cc:2804] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:24.201808 3404 raft_consensus.cc:697] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:24.202181 3404 consensus_queue.cc:237] T d2156cf3d7664ffc9b4b3f47fa750226 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.202704 1201 tablet_bootstrap.cc:492] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498: No bootstrap required, opened a new log
I20260619 19:54:24.203027 1201 ts_tablet_manager.cc:1403] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498: Time spent bootstrapping tablet: real 0.243s user 0.005s sys 0.000s
I20260619 19:54:24.205433 764 tablet_service.cc:1511] Processing CreateTablet for tablet c936ebb77fa744e59b7b2b322193b230 (DEFAULT_TABLE table=default.Table_726ead7412294be6bad3cfa42c5ae0f6 [id=606405f52dcc4cf89f95869b67e8b991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.205462 1201 raft_consensus.cc:359] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.205802 1201 raft_consensus.cc:385] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:24.205914 1201 raft_consensus.cc:740] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95181cc281b946c8b81aa825232d9498, State: Initialized, Role: FOLLOWER
I20260619 19:54:24.205950 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c936ebb77fa744e59b7b2b322193b230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.206241 1201 consensus_queue.cc:260] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.207607 1201 ts_tablet_manager.cc:1434] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260619 19:54:24.208145 1201 tablet_bootstrap.cc:492] T c3780418b3854889868cf428b2800ab0 P 95181cc281b946c8b81aa825232d9498: Bootstrap starting.
I20260619 19:54:24.210266 1201 tablet_bootstrap.cc:654] T c3780418b3854889868cf428b2800ab0 P 95181cc281b946c8b81aa825232d9498: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.211215 531 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_a8650b287dd343b78d8d890475a9ba78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:24.211920 531 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8650b287dd343b78d8d890475a9ba78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.212118 773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61adf222e10c490c9c8dd6f83edc1643" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:24.214105 996 consensus_peers.cc:597] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c -> Peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Couldn't send request to peer b1f5f240547f42ec82f57e6c8af5ea89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260619 19:54:24.214948 858 leader_election.cc:343] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.215085 858 leader_election.cc:304] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:24.215308 3273 raft_consensus.cc:2749] T 61adf222e10c490c9c8dd6f83edc1643 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:24.221285 3273 raft_consensus.cc:493] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.221486 3273 raft_consensus.cc:515] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.222834 3273 leader_election.cc:290] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:24.223702 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb5b67e240242e696f583cb9c00f610" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
W20260619 19:54:24.224321 859 leader_election.cc:343] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.225162 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb5b67e240242e696f583cb9c00f610" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
W20260619 19:54:24.226390 858 leader_election.cc:343] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.226512 858 leader_election.cc:304] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95181cc281b946c8b81aa825232d9498; no voters: b1f5f240547f42ec82f57e6c8af5ea89, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:24.226773 3273 raft_consensus.cc:2749] T 7cb5b67e240242e696f583cb9c00f610 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:24.233247 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 68b874ea8fad47e198320e130426d2fa (DEFAULT_TABLE table=default.Table_02290bf8017c40a59f163ad3ea446590 [id=75562f88848e446e9ebbd0cd9c899e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.234382 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b874ea8fad47e198320e130426d2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.235229 753 tablet_service.cc:1511] Processing CreateTablet for tablet 68b874ea8fad47e198320e130426d2fa (DEFAULT_TABLE table=default.Table_02290bf8017c40a59f163ad3ea446590 [id=75562f88848e446e9ebbd0cd9c899e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.235643 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b874ea8fad47e198320e130426d2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.235956 1200 tablet_bootstrap.cc:492] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c: No bootstrap required, opened a new log
I20260619 19:54:24.236095 1200 ts_tablet_manager.cc:1403] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent bootstrapping tablet: real 0.203s user 0.006s sys 0.026s
I20260619 19:54:24.236801 1200 raft_consensus.cc:359] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.236979 1200 raft_consensus.cc:385] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:24.237062 1200 raft_consensus.cc:740] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Initialized, Role: FOLLOWER
I20260619 19:54:24.237305 1200 consensus_queue.cc:260] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.238842 1200 ts_tablet_manager.cc:1434] T e68808ad4f64475782f8fba579fdb8bd P e78a44e2c8824fe7bce462e9d33f660c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 19:54:24.252089 3460 raft_consensus.cc:493] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.252292 3460 raft_consensus.cc:515] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.252996 3460 leader_election.cc:290] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.253995 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbbdc92de4e40daa3b5c3dd98c4ee88" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:24.260810 2026 ts_tablet_manager.cc:1929] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 19:54:24.261010 2026 log.cc:1199] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Deleting WAL directory at /tmp/dist-test-task38CK2r/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781898822466894-422-0/minicluster-data/ts-1/wal/wals/056f7982f51f45a78d2b9b0a0b50576e
I20260619 19:54:24.261387 2026 ts_tablet_manager.cc:1950] T 056f7982f51f45a78d2b9b0a0b50576e P 95181cc281b946c8b81aa825232d9498: Deleting consensus metadata
I20260619 19:54:24.262348 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 478) took 13579 ms. Trace:
I20260619 19:54:24.262475 2026 rpcz_store.cc:276] 0619 19:54:10.683171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.734328 (+ 51157us) service_pool.cc:224] Handling call
0619 19:54:24.133269 (+13398941us) ts_tablet_manager.cc:1151] Deleting tablet 056f7982f51f45a78d2b9b0a0b50576e
0619 19:54:24.133280 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.174455 (+ 41175us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:24.260736 (+ 86281us) tablet_metadata.cc:665] Metadata flushed
0619 19:54:24.262324 (+ 1588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13398690}
I20260619 19:54:24.262962 2026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35892 (request call id 498) took 13488 ms. Trace:
I20260619 19:54:24.263242 518 catalog_manager.cc:5027] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): tablet 056f7982f51f45a78d2b9b0a0b50576e (table default.Table_f2b0b2441f6d42e4bbd5c7d0bab60653 [id=c9d2abc12da548f5b301569c99271360]) successfully deleted
I20260619 19:54:24.265700 749 tablet_service.cc:1511] Processing CreateTablet for tablet 2739932741f94e98963105e40c4b99b6 (DEFAULT_TABLE table=default.Table_c4ba9f8c4587464fac2e97ecad5d4dff [id=c6bf5f02b025409e980ead3f969611b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.266352 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2739932741f94e98963105e40c4b99b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.274611 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dbbdc92de4e40daa3b5c3dd98c4ee88" candidate_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:24.275641 720 leader_election.cc:304] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1f5f240547f42ec82f57e6c8af5ea89; no voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c
I20260619 19:54:24.276242 3460 raft_consensus.cc:2749] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 19:54:24.277168 1200 tablet_bootstrap.cc:492] T 7cb5b67e240242e696f583cb9c00f610 P e78a44e2c8824fe7bce462e9d33f660c: Bootstrap starting.
I20260619 19:54:24.278851 1200 tablet_bootstrap.cc:654] T 7cb5b67e240242e696f583cb9c00f610 P e78a44e2c8824fe7bce462e9d33f660c: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.282294 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 2739932741f94e98963105e40c4b99b6 (DEFAULT_TABLE table=default.Table_c4ba9f8c4587464fac2e97ecad5d4dff [id=c6bf5f02b025409e980ead3f969611b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.282907 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2739932741f94e98963105e40c4b99b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.286046 785 raft_consensus.cc:3060] T 5dbbdc92de4e40daa3b5c3dd98c4ee88 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Advancing to term 1
W20260619 19:54:24.289832 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ca9b32b723442ca984900317b442a66 consensus state has no leader
I20260619 19:54:24.290128 3404 raft_consensus.cc:493] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.290268 3404 raft_consensus.cc:515] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.290277 523 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_4920911a4b9b4696a3fa06c1033f9024" } new_table_name: "default.Table_0c504d136aa640bbaa8a97c014455d1e" modify_external_catalogs: true
I20260619 19:54:24.290897 3404 leader_election.cc:290] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.291531 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca68b755bf841509b6ffcfbe212278c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:24.292375 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_9a5b74abe3c049c18f9be0d77af35723"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:24.292876 996 leader_election.cc:343] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
W20260619 19:54:24.292941 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a5b74abe3c049c18f9be0d77af35723 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.294649 524 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_cce8b876dc444e1d97cf328dcbf25c1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:24.295331 524 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce8b876dc444e1d97cf328dcbf25c1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.297133 529 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e393cb60e992410aba1eb02e3ddcf790" } modify_external_catalogs: true
I20260619 19:54:24.297366 529 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_e393cb60e992410aba1eb02e3ddcf790" } modify_external_catalogs: true
I20260619 19:54:24.299104 528 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6cc90ee2d59d4dddae6790dd92b20cb5: Sending DeleteTablet for 3 replicas of tablet ce68de8f421f4011ba9eafe4413d2294
W20260619 19:54:24.301601 530 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a390cfff6c24509ab2a07a622dd7ca9 consensus state has no leader
I20260619 19:54:24.304857 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet ce68de8f421f4011ba9eafe4413d2294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:33622
W20260619 19:54:24.307184 527 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.105.130:53243 (request call id 225) took 875 ms (client timeout 1000 ms). Trace:
W20260619 19:54:24.307430 527 rpcz_store.cc:269] 0619 19:54:23.431467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:23.445391 (+ 13924us) service_pool.cc:224] Handling call
0619 19:54:24.307072 (+861681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 19:54:24.109679 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 19:54:24.110883 (+ 1204us) write_op.cc:432] Acquiring schema lock in shared mode
0619 19:54:24.110890 (+ 7us) write_op.cc:435] Acquired schema lock
0619 19:54:24.110892 (+ 2us) tablet.cc:662] Decoding operations
0619 19:54:24.111014 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0619 19:54:24.111031 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0619 19:54:24.111038 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0619 19:54:24.111152 (+ 114us) tablet.cc:701] Row locks acquired
0619 19:54:24.111156 (+ 4us) write_op.cc:260] PREPARE: finished
0619 19:54:24.111202 (+ 46us) write_op.cc:270] Start()
0619 19:54:24.111246 (+ 44us) write_op.cc:276] Timestamp: P: 1781898864111152 usec, L: 0
0619 19:54:24.111256 (+ 10us) op_driver.cc:348] REPLICATION: starting
0619 19:54:24.111676 (+ 420us) log.cc:844] Serialized 533 byte log entry
0619 19:54:24.115369 (+ 3693us) op_driver.cc:464] REPLICATION: finished
0619 19:54:24.115559 (+ 190us) write_op.cc:301] APPLY: starting
0619 19:54:24.115596 (+ 37us) tablet.cc:1367] starting BulkCheckPresence
0619 19:54:24.115661 (+ 65us) tablet.cc:1370] finished BulkCheckPresence
0619 19:54:24.115692 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 19:54:24.115752 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 19:54:24.115787 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0619 19:54:24.115794 (+ 7us) write_op.cc:312] APPLY: finished
0619 19:54:24.115879 (+ 85us) log.cc:844] Serialized 23 byte log entry
0619 19:54:24.115946 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:24.115966 (+ 20us) write_op.cc:454] Released schema lock
0619 19:54:24.115973 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 19:54:24.122870 (+ 6897us) write_op.cc:489] Releasing partition, row and schema locks
0619 19:54:24.122879 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":482,"apply.run_wall_time_us":482,"num_ops":1,"prepare.queue_time_us":183718,"prepare.run_cpu_time_us":984,"prepare.run_wall_time_us":13165,"raft.queue_time_us":64,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":293,"replication_time_us":4081}]]}
I20260619 19:54:24.308686 528 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_7fdd43901ce94a22b5b679b08862134c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:24.308810 527 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1799fca0666143c69fb6609f994859c7" } modify_external_catalogs: true
I20260619 19:54:24.308988 527 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_1799fca0666143c69fb6609f994859c7" } modify_external_catalogs: true
W20260619 19:54:24.309336 528 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fdd43901ce94a22b5b679b08862134c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.308271 530 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ff3a1abe6e54481ebeafa310778691f3" } modify_external_catalogs: true
I20260619 19:54:24.310786 530 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "default.Table_ff3a1abe6e54481ebeafa310778691f3" } modify_external_catalogs: true
I20260619 19:54:24.312793 526 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_816e301d5d874963b16549899fd31e1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 19:54:24.313426 526 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_816e301d5d874963b16549899fd31e1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.316409 758 tablet_service.cc:1558] Processing DeleteTablet for tablet ce68de8f421f4011ba9eafe4413d2294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:56684
W20260619 19:54:24.316455 3512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:54:24.317147 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7f825e5f84d5985427e83ee6a989d with delete_type TABLET_DATA_DELETED (replaced by tablet bb514fda80e64ac9abc147d9a6adce76) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:24.317893 758 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:24.318142 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 32ecd267aa34469cad9db0745178013b with delete_type TABLET_DATA_DELETED (replaced by tablet 8a390cfff6c24509ab2a07a622dd7ca9) from {username='slave'} at 127.0.0.1:56684
I20260619 19:54:24.337343 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 7d975d697c6e4c6ead7cb58f2583a992 (DEFAULT_TABLE table=default.Table_778707e4af024d919d54ac17e12e77cc [id=c734fec9e1a7463d96bf1e821ddeae0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.337417 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet e4688dc20317479e9c80f6f41b3ea35e (table default.Table_046de0d4671a46d8a07dec6be2d5a520 [id=5f5c0c7e04dc4074a0f02a592ac590ed]). Expected version 1 got 0
I20260619 19:54:24.337621 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 6532bdfd3c844ff2a25bee6ff1e0c25e (table default.Table_5cc2ed9473b1439cbc4c9f82fcd0fdf9 [id=7066539595c04958818108ac6cf39581]). Expected version 1 got 0
I20260619 19:54:24.337658 1994 ts_tablet_manager.cc:1929] T e244971a6b0b424db6d16d233b32a96e P e78a44e2c8824fe7bce462e9d33f660c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 19:54:24.337759 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d975d697c6e4c6ead7cb58f2583a992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.337874 531 catalog_manager.cc:5788] TS b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107) does not have the latest schema for tablet 5dbbdc92de4e40daa3b5c3dd98c4ee88 (table default.Table_2e742d603b764daa86e93b4018379875 [id=33e3d383660b422582a47dcb68ae6be7]). Expected version 1 got 0
I20260619 19:54:24.339417 3404 raft_consensus.cc:493] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.339551 3404 raft_consensus.cc:515] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.339783 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 3847dba794ee49b493ed02510f7df696 (DEFAULT_TABLE table=default.Table_36bdd320ec4a4179a4610abc0d2924b0 [id=413b0d92c29045b886efb6ce98ccbadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.340130 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3847dba794ee49b493ed02510f7df696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.340129 3404 leader_election.cc:290] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.340682 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7d975d697c6e4c6ead7cb58f2583a992 (DEFAULT_TABLE table=default.Table_778707e4af024d919d54ac17e12e77cc [id=c734fec9e1a7463d96bf1e821ddeae0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.340786 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a6ffdcd55d4db6870fe032f72ab3b1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" is_pre_election: true
I20260619 19:54:24.341075 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d975d697c6e4c6ead7cb58f2583a992. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:24.341378 996 leader_election.cc:343] T d6a6ffdcd55d4db6870fe032f72ab3b1 P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107): Illegal state: must be running to vote when last-logged opid is not known
I20260619 19:54:24.343611 1022 tablet_service.cc:1511] Processing CreateTablet for tablet b7dbe54b7d4043749676775981db5515 (DEFAULT_TABLE table=default.Table_ec1311d5f64141778f8ed22e96d0f360 [id=2241d4baaf5043c6945692f7bf9d1de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.344241 1022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dbe54b7d4043749676775981db5515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.346041 1208 tablet_bootstrap.cc:492] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89: No bootstrap required, opened a new log
I20260619 19:54:24.346165 1208 ts_tablet_manager.cc:1403] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent bootstrapping tablet: real 0.203s user 0.025s sys 0.029s
I20260619 19:54:24.346834 1208 raft_consensus.cc:359] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.346979 1208 raft_consensus.cc:385] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 19:54:24.347028 1208 raft_consensus.cc:740] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f5f240547f42ec82f57e6c8af5ea89, State: Initialized, Role: FOLLOWER
I20260619 19:54:24.347429 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3847dba794ee49b493ed02510f7df696 (DEFAULT_TABLE table=default.Table_36bdd320ec4a4179a4610abc0d2924b0 [id=413b0d92c29045b886efb6ce98ccbadc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260619 19:54:24.347472 3517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:54:24.347824 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3847dba794ee49b493ed02510f7df696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.347981 1208 consensus_queue.cc:260] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.348510 1208 ts_tablet_manager.cc:1434] T 74813bf79789451f90bcf7779aff9290 P b1f5f240547f42ec82f57e6c8af5ea89: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 19:54:24.348771 1208 tablet_bootstrap.cc:492] T a16fdee448fb4975861b7cd46cbbc271 P b1f5f240547f42ec82f57e6c8af5ea89: Bootstrap starting.
I20260619 19:54:24.350358 3404 consensus_queue.cc:1048] T a16fdee448fb4975861b7cd46cbbc271 P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 19:54:24.347492 3509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 19:54:24.355666 759 tablet_service.cc:1511] Processing CreateTablet for tablet b7dbe54b7d4043749676775981db5515 (DEFAULT_TABLE table=default.Table_ec1311d5f64141778f8ed22e96d0f360 [id=2241d4baaf5043c6945692f7bf9d1de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.356130 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dbe54b7d4043749676775981db5515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.366819 1208 tablet_bootstrap.cc:654] T a16fdee448fb4975861b7cd46cbbc271 P b1f5f240547f42ec82f57e6c8af5ea89: Neither blocks nor log segments found. Creating new log.
I20260619 19:54:24.368185 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 1865d2470a9e4cd4afe5ff4fdcde9b42 (DEFAULT_TABLE table=default.Table_40ad5f74c95f4e9cb88aeab9826fe454 [id=4c82a13020864defb500960301606d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.368563 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1865d2470a9e4cd4afe5ff4fdcde9b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.368837 757 tablet_service.cc:1511] Processing CreateTablet for tablet 1865d2470a9e4cd4afe5ff4fdcde9b42 (DEFAULT_TABLE table=default.Table_40ad5f74c95f4e9cb88aeab9826fe454 [id=4c82a13020864defb500960301606d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.264014 898 tablet_service.cc:1511] Processing CreateTablet for tablet 68b874ea8fad47e198320e130426d2fa (DEFAULT_TABLE table=default.Table_02290bf8017c40a59f163ad3ea446590 [id=75562f88848e446e9ebbd0cd9c899e53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.283010 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2739932741f94e98963105e40c4b99b6 (DEFAULT_TABLE table=default.Table_c4ba9f8c4587464fac2e97ecad5d4dff [id=c6bf5f02b025409e980ead3f969611b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.292464 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca68b755bf841509b6ffcfbe212278c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:24.369380 910 raft_consensus.cc:2468] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:24.369472 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b874ea8fad47e198320e130426d2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.316787 895 tablet_service.cc:1558] Processing DeleteTablet for tablet ce68de8f421f4011ba9eafe4413d2294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:23 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.316982 885 tablet_service.cc:1558] Processing DeleteTablet for tablet 607e0d85a22e4d7bb8eda33a5a6b5d0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:06 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.317116 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 02c5f9405d6a4a16bd49697001c201e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.369961 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2739932741f94e98963105e40c4b99b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.317446 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd6b786bd844781af7fdc5849e90009 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 19:54:03 UTC) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.371503 996 leader_election.cc:304] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters: b1f5f240547f42ec82f57e6c8af5ea89
I20260619 19:54:24.371928 3404 raft_consensus.cc:2804] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:24.372004 3404 raft_consensus.cc:493] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:24.372077 3404 raft_consensus.cc:3060] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:24.374488 3404 raft_consensus.cc:515] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.375334 3404 leader_election.cc:290] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Requested vote from peers b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107), 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425)
I20260619 19:54:24.376497 910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca68b755bf841509b6ffcfbe212278c" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498"
I20260619 19:54:24.376686 910 raft_consensus.cc:3060] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:24.377354 2026 rpcz_store.cc:276] 0619 19:54:10.774106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 19:54:10.774183 (+ 77us) service_pool.cc:224] Handling call
0619 19:54:24.262829 (+13488646us) ts_tablet_manager.cc:1151] Deleting tablet e22e0f53008c4a96bf56b7f057f81cd5
0619 19:54:24.262840 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0619 19:54:24.262948 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13488430}
W20260619 19:54:24.378120 518 catalog_manager.cc:5007] TS 95181cc281b946c8b81aa825232d9498 (127.0.105.130:37425): delete failed for tablet e22e0f53008c4a96bf56b7f057f81cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e22e0f53008c4a96bf56b7f057f81cd5 already in progress: creating tablet
I20260619 19:54:24.381582 910 raft_consensus.cc:2468] T 1ca68b755bf841509b6ffcfbe212278c P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 1.
W20260619 19:54:24.381888 523 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e2d05f5175346f9b21958b139ae80f1 consensus state has no leader
I20260619 19:54:24.382130 996 leader_election.cc:304] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:24.385944 3404 raft_consensus.cc:2804] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 19:54:24.386189 3404 raft_consensus.cc:697] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [term 1 LEADER]: Becoming Leader. State: Replica: e78a44e2c8824fe7bce462e9d33f660c, State: Running, Role: LEADER
I20260619 19:54:24.386459 3404 consensus_queue.cc:237] T 1ca68b755bf841509b6ffcfbe212278c P e78a44e2c8824fe7bce462e9d33f660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.324726 889 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc9c4167c58495fbfcf5fb60952c884 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d1b35a09aad46039677eb3d800b0051) from {username='slave'} at 127.0.0.1:35892
I20260619 19:54:24.336014 3442 consensus_queue.cc:1048] T 198bde101e7b4eeeb8de58aebe208bb4 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:24.388093 3442 raft_consensus.cc:493] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 19:54:24.388218 3442 raft_consensus.cc:515] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.388761 3442 leader_election.cc:290] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:24.341894 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a6ffdcd55d4db6870fe032f72ab3b1" candidate_uuid: "e78a44e2c8824fe7bce462e9d33f660c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95181cc281b946c8b81aa825232d9498" is_pre_election: true
I20260619 19:54:24.390035 919 raft_consensus.cc:2468] T d6a6ffdcd55d4db6870fe032f72ab3b1 P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e78a44e2c8824fe7bce462e9d33f660c in term 0.
I20260619 19:54:24.341995 884 tablet_service.cc:1511] Processing CreateTablet for tablet b7dbe54b7d4043749676775981db5515 (DEFAULT_TABLE table=default.Table_ec1311d5f64141778f8ed22e96d0f360 [id=2241d4baaf5043c6945692f7bf9d1de9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.347221 897 tablet_service.cc:1511] Processing CreateTablet for tablet 7d975d697c6e4c6ead7cb58f2583a992 (DEFAULT_TABLE table=default.Table_778707e4af024d919d54ac17e12e77cc [id=c734fec9e1a7463d96bf1e821ddeae0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.390422 884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dbe54b7d4043749676775981db5515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.390484 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 040f9f1109b24f21b20360350bb5497e (DEFAULT_TABLE table=default.Table_209919aed84e471482c567000b1c92df [id=18c25cc0341a4f88a2310e4a9620993c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.390607 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d975d697c6e4c6ead7cb58f2583a992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.390812 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040f9f1109b24f21b20360350bb5497e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.360193 899 tablet_service.cc:1511] Processing CreateTablet for tablet 3847dba794ee49b493ed02510f7df696 (DEFAULT_TABLE table=default.Table_36bdd320ec4a4179a4610abc0d2924b0 [id=413b0d92c29045b886efb6ce98ccbadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.367333 3290 consensus_queue.cc:1048] T 9e7877d111a0438da74b7bcf396e2c71 P 95181cc281b946c8b81aa825232d9498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 19:54:24.391908 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3847dba794ee49b493ed02510f7df696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.368148 894 tablet_service.cc:1511] Processing CreateTablet for tablet 1865d2470a9e4cd4afe5ff4fdcde9b42 (DEFAULT_TABLE table=default.Table_40ad5f74c95f4e9cb88aeab9826fe454 [id=4c82a13020864defb500960301606d8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.395428 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1865d2470a9e4cd4afe5ff4fdcde9b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 19:54:24.405419 1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904e20649a5f4c49a93bb084c1d3bb9a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c" is_pre_election: true
I20260619 19:54:24.405645 1053 raft_consensus.cc:2468] T 904e20649a5f4c49a93bb084c1d3bb9a P e78a44e2c8824fe7bce462e9d33f660c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95181cc281b946c8b81aa825232d9498 in term 0.
I20260619 19:54:24.412005 859 leader_election.cc:304] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95181cc281b946c8b81aa825232d9498, e78a44e2c8824fe7bce462e9d33f660c; no voters:
I20260619 19:54:24.412492 3273 raft_consensus.cc:2804] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 19:54:24.412576 3273 raft_consensus.cc:493] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 19:54:24.412637 3273 raft_consensus.cc:3060] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 0 FOLLOWER]: Advancing to term 1
I20260619 19:54:24.415477 3273 raft_consensus.cc:515] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e78a44e2c8824fe7bce462e9d33f660c" member_type: VOTER last_known_addr { host: "127.0.105.131" port: 34819 } } peers { permanent_uuid: "b1f5f240547f42ec82f57e6c8af5ea89" member_type: VOTER last_known_addr { host: "127.0.105.129" port: 41107 } } peers { permanent_uuid: "95181cc281b946c8b81aa825232d9498" member_type: VOTER last_known_addr { host: "127.0.105.130" port: 37425 } }
I20260619 19:54:24.419514 3273 leader_election.cc:290] T 904e20649a5f4c49a93bb084c1d3bb9a P 95181cc281b946c8b81aa825232d9498 [CANDIDATE]: Term 1 election: Requested vote from peers e78a44e2c8824fe7bce462e9d33f660c (127.0.105.131:34819), b1f5f240547f42ec82f57e6c8af5ea89 (127.0.105.129:41107)
I20260619 19:54:24.419365 525 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "default.Table_eb6d3758585d4cb89f54ae15626a86d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 19:54:24.419713 889 tablet_service.cc:1511] Processing CreateTablet for tablet 040f9f1109b24f21b20360350bb5497e (DEFAULT_TABLE table=default.Table_209919aed84e471482c567000b1c92df [id=18c25cc0341a4f88a2310e4a9620993c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 19:54:24.420169 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040f9f1109b24f21b20360350bb5497e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 19:54:24.420203 525 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb6d3758585d4cb89f54ae15626a86d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 19:54:24.421952 1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904e20649a5f4c49a93bb084c1d3bb9a" candidate_uuid: "95181cc281b946c8b81aa825232d9498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e78a44e2c8824fe7bce462e9d33f660c"